Max level shown:
12026-04-17T14:00:23.069ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::15]:32345 remote_addr = [fd00:1122:3344:101::c]:57298
22026-04-17T14:00:23.099ZINFOcrucible-agent (datafile): region 6ace0f7b-f809-48a6-a1f2-555a89d3ee92 state: Requested
32026-04-17T14:00:23.102ZINFOcrucible-agent (worker): Region size:1073741824 reservation:1342177280 quota:3221225472
42026-04-17T14:00:23.102ZINFOcrucible-agent (dropshot): request completed latency_us = 15910 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:57298 req_id = 780abc69-a97d-4c8c-a59b-67d309bf1904 response_code = 200 uri = /crucible/0/regions
52026-04-17T14:00:23.112ZINFOcrucible-agent (worker): zfs set reservation of 1342177280 for oxp_3ab12f3d-2695-4a3a-afd4-abd9e8e3051c/crucible/regions/6ace0f7b-f809-48a6-a1f2-555a89d3ee92
62026-04-17T14:00:23.112ZINFOcrucible-agent (worker): zfs set quota of 3221225472 for oxp_3ab12f3d-2695-4a3a-afd4-abd9e8e3051c/crucible/regions/6ace0f7b-f809-48a6-a1f2-555a89d3ee92
72026-04-17T14:00:23.173ZINFOcrucible-agent (worker): creating region Region { id: RegionId("6ace0f7b-f809-48a6-a1f2-555a89d3ee92"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 16, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/6ace0f7b-f809-48a6-a1f2-555a89d3ee92" region = 6ace0f7b-f809-48a6-a1f2-555a89d3ee92
82026-04-17T14:00:23.175ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "6ace0f7b-f809-48a6-a1f2-555a89d3ee92" "--data" "/data/regions/6ace0f7b-f809-48a6-a1f2-555a89d3ee92" "--block-size" "512" "--extent-size" "131072" "--extent-count" "16" "--encrypted" region = 6ace0f7b-f809-48a6-a1f2-555a89d3ee92
92026-04-17T14:00:23.439ZINFOcrucible-agent (dropshot): request completed latency_us = 55 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:57298 req_id = 7a09330c-84bc-4b73-a296-217514e91b13 response_code = 200 uri = /crucible/0/regions
102026-04-17T14:00:23.517ZINFOcrucible-agent (worker): region files created ok region = 6ace0f7b-f809-48a6-a1f2-555a89d3ee92
112026-04-17T14:00:23.517ZINFOcrucible-agent (datafile): region 6ace0f7b-f809-48a6-a1f2-555a89d3ee92 state: Requested -> Created
122026-04-17T14:00:23.517ZINFOcrucible-agent (worker): applying SMF actions post create...
132026-04-17T14:00:23.517ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-6ace0f7b-f809-48a6-a1f2-555a89d3ee92
142026-04-17T14:00:23.525ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-6ace0f7b-f809-48a6-a1f2-555a89d3ee92
152026-04-17T14:00:23.538ZINFOcrucible-agent (worker): creating config property group
162026-04-17T14:00:23.541ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-6ace0f7b-f809-48a6-a1f2-555a89d3ee92
172026-04-17T14:00:23.542ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/6ace0f7b-f809-48a6-a1f2-555a89d3ee92
182026-04-17T14:00:23.542ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
192026-04-17T14:00:23.542ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::15
202026-04-17T14:00:23.542ZINFOcrucible-agent (worker): commit
212026-04-17T14:00:23.547ZINFOcrucible-agent (worker): ok!
222026-04-17T14:00:23.551ZINFOcrucible-agent (worker): SMF ok!
232026-04-17T14:00:23.769ZINFOcrucible-agent (dropshot): request completed latency_us = 59 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:57298 req_id = e08345c5-6ded-4bad-911d-848d4e168637 response_code = 200 uri = /crucible/0/regions
242026-04-17T14:00:24.224ZINFOcrucible-agent (dropshot): request completed latency_us = 83 local_addr = [fd00:1122:3344:101::15]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:57298 req_id = 52251383-c626-4b0f-ae32-61196da9f43e response_code = 200 uri = /crucible/0/regions/6ace0f7b-f809-48a6-a1f2-555a89d3ee92
252026-04-17T14:00:24.228ZINFOcrucible-agent (datafile): path is "/data/regions/6ace0f7b-f809-48a6-a1f2-555a89d3ee92"
262026-04-17T14:00:24.236ZINFOcrucible-agent (datafile): dataset is oxp_3ab12f3d-2695-4a3a-afd4-abd9e8e3051c/crucible/regions/6ace0f7b-f809-48a6-a1f2-555a89d3ee92
272026-04-17T14:00:24.243ZINFOcrucible-agent (datafile): region 6ace0f7b-f809-48a6-a1f2-555a89d3ee92 state: Created -> Tombstoned
282026-04-17T14:00:24.244ZINFOcrucible-agent (dropshot): request completed latency_us = 16158 local_addr = [fd00:1122:3344:101::15]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::c]:57298 req_id = c62a5a41-aee6-407b-a1a0-f8b775c7c6f0 response_code = 204 uri = /crucible/0/regions/6ace0f7b-f809-48a6-a1f2-555a89d3ee92
292026-04-17T14:00:24.244ZINFOcrucible-agent (worker): applying SMF actions before removal...
302026-04-17T14:00:24.245ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-6ace0f7b-f809-48a6-a1f2-555a89d3ee92 (instance states: (Some(Online), None))
312026-04-17T14:00:24.250ZINFOcrucible-agent (worker): SMF ok!
322026-04-17T14:00:24.252ZINFOcrucible-agent (dropshot): request completed latency_us = 27 local_addr = [fd00:1122:3344:101::15]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:57298 req_id = a1e236ea-605c-4e51-8c94-3039a4061ccd response_code = 200 uri = /crucible/0/regions/6ace0f7b-f809-48a6-a1f2-555a89d3ee92
332026-04-17T14:00:24.258ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_3ab12f3d-2695-4a3a-afd4-abd9e8e3051c/crucible/regions/6ace0f7b-f809-48a6-a1f2-555a89d3ee92" region = 6ace0f7b-f809-48a6-a1f2-555a89d3ee92
342026-04-17T14:00:24.315ZINFOcrucible-agent (dropshot): request completed latency_us = 51 local_addr = [fd00:1122:3344:101::15]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:57298 req_id = a7e857c0-16a2-410e-8386-84d425827df5 response_code = 200 uri = /crucible/0/regions/6ace0f7b-f809-48a6-a1f2-555a89d3ee92
352026-04-17T14:00:24.336ZINFOcrucible-agent (datafile): region 6ace0f7b-f809-48a6-a1f2-555a89d3ee92 state: Tombstoned -> Destroyed
362026-04-17T14:00:24.448ZINFOcrucible-agent (dropshot): request completed latency_us = 36 local_addr = [fd00:1122:3344:101::15]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:57298 req_id = d6183a4e-daf0-49e4-b145-52465fd0e049 response_code = 200 uri = /crucible/0/regions/6ace0f7b-f809-48a6-a1f2-555a89d3ee92
372026-04-17T14:10:51.704ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::15]:32345 remote_addr = [fd00:1122:3344:101::c]:33253
382026-04-17T14:10:51.706ZINFOcrucible-agent (datafile): region c5a56beb-915e-45b9-9a62-51fc3ad00c88 state: Requested
392026-04-17T14:10:51.706ZINFOcrucible-agent (dropshot): request completed latency_us = 1037 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:33253 req_id = 0915f95a-0e92-477b-9fb4-ca2ce779c6f2 response_code = 200 uri = /crucible/0/regions
402026-04-17T14:10:51.706ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
412026-04-17T14:10:51.714ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_3ab12f3d-2695-4a3a-afd4-abd9e8e3051c/crucible/regions/c5a56beb-915e-45b9-9a62-51fc3ad00c88
422026-04-17T14:10:51.714ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_3ab12f3d-2695-4a3a-afd4-abd9e8e3051c/crucible/regions/c5a56beb-915e-45b9-9a62-51fc3ad00c88
432026-04-17T14:10:51.772ZINFOcrucible-agent (worker): creating region Region { id: RegionId("c5a56beb-915e-45b9-9a62-51fc3ad00c88"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/c5a56beb-915e-45b9-9a62-51fc3ad00c88" region = c5a56beb-915e-45b9-9a62-51fc3ad00c88
442026-04-17T14:10:51.772ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "c5a56beb-915e-45b9-9a62-51fc3ad00c88" "--data" "/data/regions/c5a56beb-915e-45b9-9a62-51fc3ad00c88" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = c5a56beb-915e-45b9-9a62-51fc3ad00c88
452026-04-17T14:10:51.863ZINFOcrucible-agent (worker): region files created ok region = c5a56beb-915e-45b9-9a62-51fc3ad00c88
462026-04-17T14:10:51.863ZINFOcrucible-agent (datafile): region c5a56beb-915e-45b9-9a62-51fc3ad00c88 state: Requested -> Created
472026-04-17T14:10:51.863ZINFOcrucible-agent (worker): applying SMF actions post create...
482026-04-17T14:10:51.863ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-c5a56beb-915e-45b9-9a62-51fc3ad00c88
492026-04-17T14:10:51.873ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-c5a56beb-915e-45b9-9a62-51fc3ad00c88
502026-04-17T14:10:51.897ZINFOcrucible-agent (worker): creating config property group
512026-04-17T14:10:51.901ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-c5a56beb-915e-45b9-9a62-51fc3ad00c88
522026-04-17T14:10:51.901ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/c5a56beb-915e-45b9-9a62-51fc3ad00c88
532026-04-17T14:10:51.901ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
542026-04-17T14:10:51.901ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::15
552026-04-17T14:10:51.901ZINFOcrucible-agent (worker): commit
562026-04-17T14:10:51.904ZINFOcrucible-agent (worker): ok!
572026-04-17T14:10:51.910ZINFOcrucible-agent (worker): SMF ok!
582026-04-17T14:10:52.037ZINFOcrucible-agent (dropshot): request completed latency_us = 62 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:33253 req_id = 58b4a756-a848-4711-86fa-af172cfc953d response_code = 200 uri = /crucible/0/regions