Max level shown:
12026-05-06T02:04:11.766ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::17]:32345 remote_addr = [fd00:1122:3344:101::c]:46400
22026-05-06T02:04:11.766ZINFOcrucible-agent (datafile): region 25855c5e-9a6f-4930-b058-d4fedc615c4a state: Requested
32026-05-06T02:04:11.767ZINFOcrucible-agent (dropshot): request completed latency_us = 994 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:46400 req_id = 48923637-470d-4093-853d-8c2bff7bf5c8 response_code = 200 uri = /crucible/0/regions
42026-05-06T02:04:11.767ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
52026-05-06T02:04:11.774ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_d77abc97-6377-4ad4-aca3-de577566ff91/crucible/regions/25855c5e-9a6f-4930-b058-d4fedc615c4a
62026-05-06T02:04:11.774ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_d77abc97-6377-4ad4-aca3-de577566ff91/crucible/regions/25855c5e-9a6f-4930-b058-d4fedc615c4a
72026-05-06T02:04:11.819ZINFOcrucible-agent (worker): creating region Region { id: RegionId("25855c5e-9a6f-4930-b058-d4fedc615c4a"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/25855c5e-9a6f-4930-b058-d4fedc615c4a" region = 25855c5e-9a6f-4930-b058-d4fedc615c4a
82026-05-06T02:04:11.819ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "25855c5e-9a6f-4930-b058-d4fedc615c4a" "--data" "/data/regions/25855c5e-9a6f-4930-b058-d4fedc615c4a" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 25855c5e-9a6f-4930-b058-d4fedc615c4a
92026-05-06T02:04:11.896ZINFOcrucible-agent (worker): region files created ok region = 25855c5e-9a6f-4930-b058-d4fedc615c4a
102026-05-06T02:04:11.896ZINFOcrucible-agent (datafile): region 25855c5e-9a6f-4930-b058-d4fedc615c4a state: Requested -> Created
112026-05-06T02:04:11.897ZINFOcrucible-agent (worker): applying SMF actions post create...
122026-05-06T02:04:11.897ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-25855c5e-9a6f-4930-b058-d4fedc615c4a
132026-05-06T02:04:11.907ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-25855c5e-9a6f-4930-b058-d4fedc615c4a
142026-05-06T02:04:11.927ZINFOcrucible-agent (worker): creating config property group
152026-05-06T02:04:11.930ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-25855c5e-9a6f-4930-b058-d4fedc615c4a
162026-05-06T02:04:11.930ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/25855c5e-9a6f-4930-b058-d4fedc615c4a
172026-05-06T02:04:11.931ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
182026-05-06T02:04:11.931ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::17
192026-05-06T02:04:11.931ZINFOcrucible-agent (worker): commit
202026-05-06T02:04:11.934ZINFOcrucible-agent (worker): ok!
212026-05-06T02:04:11.938ZINFOcrucible-agent (worker): SMF ok!
222026-05-06T02:04:11.971ZINFOcrucible-agent (dropshot): request completed latency_us = 58 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:46400 req_id = e072cc89-eb36-4f56-b7ad-2175f619854b response_code = 200 uri = /crucible/0/regions
232026-05-06T02:04:18.616ZINFOcrucible-agent (datafile): region fceed9d5-1392-4fa8-9592-832f5262335b state: Requested
242026-05-06T02:04:18.616ZINFOcrucible-agent (dropshot): request completed latency_us = 230 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:46400 req_id = 954510c3-6b52-451c-831b-b83378b42f55 response_code = 200 uri = /crucible/0/regions
252026-05-06T02:04:18.616ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
262026-05-06T02:04:18.623ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_d77abc97-6377-4ad4-aca3-de577566ff91/crucible/regions/fceed9d5-1392-4fa8-9592-832f5262335b
272026-05-06T02:04:18.623ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_d77abc97-6377-4ad4-aca3-de577566ff91/crucible/regions/fceed9d5-1392-4fa8-9592-832f5262335b
282026-05-06T02:04:18.662ZINFOcrucible-agent (worker): creating region Region { id: RegionId("fceed9d5-1392-4fa8-9592-832f5262335b"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/fceed9d5-1392-4fa8-9592-832f5262335b" region = fceed9d5-1392-4fa8-9592-832f5262335b
292026-05-06T02:04:18.662ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "fceed9d5-1392-4fa8-9592-832f5262335b" "--data" "/data/regions/fceed9d5-1392-4fa8-9592-832f5262335b" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = fceed9d5-1392-4fa8-9592-832f5262335b
302026-05-06T02:04:18.738ZINFOcrucible-agent (worker): region files created ok region = fceed9d5-1392-4fa8-9592-832f5262335b
312026-05-06T02:04:18.738ZINFOcrucible-agent (datafile): region fceed9d5-1392-4fa8-9592-832f5262335b state: Requested -> Created
322026-05-06T02:04:18.738ZINFOcrucible-agent (worker): applying SMF actions post create...
332026-05-06T02:04:18.743ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-fceed9d5-1392-4fa8-9592-832f5262335b
342026-05-06T02:04:18.751ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-fceed9d5-1392-4fa8-9592-832f5262335b
352026-05-06T02:04:18.758ZINFOcrucible-agent (worker): creating config property group
362026-05-06T02:04:18.761ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-fceed9d5-1392-4fa8-9592-832f5262335b
372026-05-06T02:04:18.762ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/fceed9d5-1392-4fa8-9592-832f5262335b
382026-05-06T02:04:18.762ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
392026-05-06T02:04:18.762ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::17
402026-05-06T02:04:18.762ZINFOcrucible-agent (worker): commit
412026-05-06T02:04:18.762ZINFOcrucible-agent (dropshot): request completed latency_us = 66 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:46400 req_id = b72da42c-23ac-473a-8d94-c475cd02e2e4 response_code = 200 uri = /crucible/0/regions
422026-05-06T02:04:18.766ZINFOcrucible-agent (worker): ok!
432026-05-06T02:04:18.771ZINFOcrucible-agent (worker): SMF ok!
442026-05-06T02:04:43.826ZINFOcrucible-agent (dropshot): request completed latency_us = 52 local_addr = [fd00:1122:3344:101::17]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:46400 req_id = 7b02749c-89fc-46be-b7e5-a707e1e5a508 response_code = 200 uri = /crucible/0/regions/fceed9d5-1392-4fa8-9592-832f5262335b
452026-05-06T02:04:43.829ZINFOcrucible-agent (datafile): path is "/data/regions/fceed9d5-1392-4fa8-9592-832f5262335b"
462026-05-06T02:04:43.840ZINFOcrucible-agent (datafile): dataset is oxp_d77abc97-6377-4ad4-aca3-de577566ff91/crucible/regions/fceed9d5-1392-4fa8-9592-832f5262335b
472026-05-06T02:04:43.847ZINFOcrucible-agent (datafile): region fceed9d5-1392-4fa8-9592-832f5262335b state: Created -> Tombstoned
482026-05-06T02:04:43.847ZINFOcrucible-agent (dropshot): request completed latency_us = 18055 local_addr = [fd00:1122:3344:101::17]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::c]:46400 req_id = 67008abf-7870-4230-8535-fff64a4775eb response_code = 204 uri = /crucible/0/regions/fceed9d5-1392-4fa8-9592-832f5262335b
492026-05-06T02:04:43.847ZINFOcrucible-agent (worker): applying SMF actions before removal...
502026-05-06T02:04:43.848ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-fceed9d5-1392-4fa8-9592-832f5262335b (instance states: (Some(Online), None))
512026-05-06T02:04:43.850ZINFOcrucible-agent (dropshot): request completed latency_us = 46 local_addr = [fd00:1122:3344:101::17]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:46400 req_id = a18819c9-6314-4fe1-84fe-f56c2269c97c response_code = 200 uri = /crucible/0/regions/fceed9d5-1392-4fa8-9592-832f5262335b
522026-05-06T02:04:43.857ZINFOcrucible-agent (worker): SMF ok!
532026-05-06T02:04:43.864ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_d77abc97-6377-4ad4-aca3-de577566ff91/crucible/regions/fceed9d5-1392-4fa8-9592-832f5262335b" region = fceed9d5-1392-4fa8-9592-832f5262335b
542026-05-06T02:04:43.908ZINFOcrucible-agent (dropshot): request completed latency_us = 36 local_addr = [fd00:1122:3344:101::17]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:46400 req_id = 8bde08f9-3288-4565-941c-17b706ff7385 response_code = 200 uri = /crucible/0/regions/fceed9d5-1392-4fa8-9592-832f5262335b
552026-05-06T02:04:43.910ZINFOcrucible-agent (datafile): region fceed9d5-1392-4fa8-9592-832f5262335b state: Tombstoned -> Destroyed
562026-05-06T02:04:44.051ZINFOcrucible-agent (dropshot): request completed latency_us = 31 local_addr = [fd00:1122:3344:101::17]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:46400 req_id = c09b4ca7-30aa-4b7e-8581-d2b9f7494d72 response_code = 200 uri = /crucible/0/regions/fceed9d5-1392-4fa8-9592-832f5262335b