Max level shown:
12026-06-12T00:08:35.246ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::16]:32345 remote_addr = [fd00:1122:3344:101::a]:42764
22026-06-12T00:08:35.246ZINFOcrucible-agent (datafile): region 894025a7-d922-4338-8f3c-2e242861c389 state: Requested
32026-06-12T00:08:35.247ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42026-06-12T00:08:35.247ZINFOcrucible-agent (dropshot): request completed latency_us = 828 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:42764 req_id = ac33e08b-04a8-4561-9016-22e900bec2ab response_code = 200 uri = /crucible/0/regions
52026-06-12T00:08:35.255ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_6d6ed0b2-3129-4dcb-aa02-eb303cba94fe/crucible/regions/894025a7-d922-4338-8f3c-2e242861c389
62026-06-12T00:08:35.255ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_6d6ed0b2-3129-4dcb-aa02-eb303cba94fe/crucible/regions/894025a7-d922-4338-8f3c-2e242861c389
72026-06-12T00:08:35.304ZINFOcrucible-agent (worker): creating region Region { id: RegionId("894025a7-d922-4338-8f3c-2e242861c389"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/894025a7-d922-4338-8f3c-2e242861c389" region = 894025a7-d922-4338-8f3c-2e242861c389
82026-06-12T00:08:35.304ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "894025a7-d922-4338-8f3c-2e242861c389" "--data" "/data/regions/894025a7-d922-4338-8f3c-2e242861c389" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 894025a7-d922-4338-8f3c-2e242861c389
92026-06-12T00:08:35.350ZINFOcrucible-agent (worker): region files created ok region = 894025a7-d922-4338-8f3c-2e242861c389
102026-06-12T00:08:35.350ZINFOcrucible-agent (datafile): region 894025a7-d922-4338-8f3c-2e242861c389 state: Requested -> Created
112026-06-12T00:08:35.351ZINFOcrucible-agent (worker): applying SMF actions post create...
122026-06-12T00:08:35.351ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-894025a7-d922-4338-8f3c-2e242861c389
132026-06-12T00:08:35.367ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-894025a7-d922-4338-8f3c-2e242861c389
142026-06-12T00:08:35.373ZINFOcrucible-agent (worker): creating config property group
152026-06-12T00:08:35.374ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-894025a7-d922-4338-8f3c-2e242861c389
162026-06-12T00:08:35.374ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/894025a7-d922-4338-8f3c-2e242861c389
172026-06-12T00:08:35.374ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
182026-06-12T00:08:35.374ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::16
192026-06-12T00:08:35.374ZINFOcrucible-agent (worker): commit
202026-06-12T00:08:35.376ZINFOcrucible-agent (worker): ok!
212026-06-12T00:08:35.380ZINFOcrucible-agent (worker): SMF ok!
222026-06-12T00:08:35.610ZINFOcrucible-agent (dropshot): request completed latency_us = 70 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:42764 req_id = 660b0a4c-3801-4f00-945e-955b22523034 response_code = 200 uri = /crucible/0/regions
232026-06-12T00:08:36.654ZINFOcrucible-agent (dropshot): request completed latency_us = 50 local_addr = [fd00:1122:3344:101::16]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:42764 req_id = 234b422a-e58a-4fde-9f5d-8b845818d281 response_code = 200 uri = /crucible/0/regions/ffaa92d7-77da-4f73-b375-626df92ca0d7
242026-06-12T00:08:36.658ZINFOcrucible-agent (datafile): path is "/data/regions/ffaa92d7-77da-4f73-b375-626df92ca0d7"
252026-06-12T00:08:36.664ZINFOcrucible-agent (datafile): dataset is oxp_6d6ed0b2-3129-4dcb-aa02-eb303cba94fe/crucible/regions/ffaa92d7-77da-4f73-b375-626df92ca0d7
262026-06-12T00:08:36.669ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_6d6ed0b2-3129-4dcb-aa02-eb303cba94fe/crucible/regions/ffaa92d7-77da-4f73-b375-626df92ca0d7@9084cea5-f53f-4b9a-8e06-c1f473249406
272026-06-12T00:08:36.669ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_6d6ed0b2-3129-4dcb-aa02-eb303cba94fe/crucible/regions/ffaa92d7-77da-4f73-b375-626df92ca0d7", "9084cea5-f53f-4b9a-8e06-c1f473249406"]
282026-06-12T00:08:36.678ZINFOcrucible-agent (dropshot): request completed latency_us = 19945 local_addr = [fd00:1122:3344:101::16]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:42764 req_id = f96ddabd-aeb2-452f-99dd-556de651c43c response_code = 200 uri = /crucible/0/regions/ffaa92d7-77da-4f73-b375-626df92ca0d7/snapshots/9084cea5-f53f-4b9a-8e06-c1f473249406
292026-06-12T00:08:36.681ZINFOcrucible-agent (datafile): path is "/data/regions/ffaa92d7-77da-4f73-b375-626df92ca0d7"
302026-06-12T00:08:36.686ZINFOcrucible-agent (datafile): dataset is oxp_6d6ed0b2-3129-4dcb-aa02-eb303cba94fe/crucible/regions/ffaa92d7-77da-4f73-b375-626df92ca0d7
312026-06-12T00:08:36.691ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_6d6ed0b2-3129-4dcb-aa02-eb303cba94fe/crucible/regions/ffaa92d7-77da-4f73-b375-626df92ca0d7@9084cea5-f53f-4b9a-8e06-c1f473249406
322026-06-12T00:08:36.691ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_6d6ed0b2-3129-4dcb-aa02-eb303cba94fe/crucible/regions/ffaa92d7-77da-4f73-b375-626df92ca0d7", "9084cea5-f53f-4b9a-8e06-c1f473249406"]
332026-06-12T00:08:36.698ZINFOcrucible-agent (datafile): requesting running snapshot ffaa92d7-77da-4f73-b375-626df92ca0d7-9084cea5-f53f-4b9a-8e06-c1f473249406 state: Requested
342026-06-12T00:08:36.698ZINFOcrucible-agent (worker): applying SMF actions for region ffaa92d7-77da-4f73-b375-626df92ca0d7 running snapshot 9084cea5-f53f-4b9a-8e06-c1f473249406 (state Requested)...
352026-06-12T00:08:36.698ZINFOcrucible-agent (dropshot): request completed latency_us = 16873 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:42764 req_id = 8fbe7487-efc6-435e-b278-5ed5861e9605 response_code = 200 uri = /crucible/0/regions/ffaa92d7-77da-4f73-b375-626df92ca0d7/snapshots/9084cea5-f53f-4b9a-8e06-c1f473249406/run
362026-06-12T00:08:36.703ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-ffaa92d7-77da-4f73-b375-626df92ca0d7-9084cea5-f53f-4b9a-8e06-c1f473249406
372026-06-12T00:08:36.705ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-ffaa92d7-77da-4f73-b375-626df92ca0d7-9084cea5-f53f-4b9a-8e06-c1f473249406
382026-06-12T00:08:36.709ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-ffaa92d7-77da-4f73-b375-626df92ca0d7-9084cea5-f53f-4b9a-8e06-c1f473249406
392026-06-12T00:08:36.710ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/ffaa92d7-77da-4f73-b375-626df92ca0d7/.zfs/snapshot/9084cea5-f53f-4b9a-8e06-c1f473249406
402026-06-12T00:08:36.710ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
412026-06-12T00:08:36.710ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
422026-06-12T00:08:36.710ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::16
432026-06-12T00:08:36.710ZINFOcrucible-agent (worker): commit
442026-06-12T00:08:36.712ZINFOcrucible-agent (worker): ok!
452026-06-12T00:08:36.715ZINFOcrucible-agent (worker): SMF ok!
462026-06-12T00:08:36.715ZINFOcrucible-agent (datafile): region ffaa92d7-77da-4f73-b375-626df92ca0d7 running snapshot 9084cea5-f53f-4b9a-8e06-c1f473249406 state: Requested -> Created
472026-06-12T00:08:37.053ZINFOcrucible-agent (datafile): path is "/data/regions/ffaa92d7-77da-4f73-b375-626df92ca0d7"
482026-06-12T00:08:37.059ZINFOcrucible-agent (datafile): dataset is oxp_6d6ed0b2-3129-4dcb-aa02-eb303cba94fe/crucible/regions/ffaa92d7-77da-4f73-b375-626df92ca0d7
492026-06-12T00:08:37.066ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_6d6ed0b2-3129-4dcb-aa02-eb303cba94fe/crucible/regions/ffaa92d7-77da-4f73-b375-626df92ca0d7@9084cea5-f53f-4b9a-8e06-c1f473249406
502026-06-12T00:08:37.066ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_6d6ed0b2-3129-4dcb-aa02-eb303cba94fe/crucible/regions/ffaa92d7-77da-4f73-b375-626df92ca0d7", "9084cea5-f53f-4b9a-8e06-c1f473249406"]
512026-06-12T00:08:37.071ZINFOcrucible-agent (dropshot): request completed latency_us = 17926 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:42764 req_id = 1719519c-73b9-4581-9785-26e18262a41f response_code = 200 uri = /crucible/0/regions/ffaa92d7-77da-4f73-b375-626df92ca0d7/snapshots/9084cea5-f53f-4b9a-8e06-c1f473249406/run