Max level shown:
12026-09-05T00:00:38.750ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::18]:32345 remote_addr = [fd00:1122:3344:101::b]:57727
22026-09-05T00:00:38.750ZINFOcrucible-agent (datafile): region 937e9072-93f6-459b-8b47-82a52b875c95 state: Requested
32026-09-05T00:00:38.751ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42026-09-05T00:00:38.751ZINFOcrucible-agent (dropshot): request completed latency_us = 649 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:57727 req_id = 80cbda9a-6305-4731-99cf-feddfd8731a7 response_code = 200 uri = /crucible/0/regions
52026-09-05T00:00:38.759ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_220386fa-f243-4210-91c9-500ea14894a3/crucible/regions/937e9072-93f6-459b-8b47-82a52b875c95
62026-09-05T00:00:38.759ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_220386fa-f243-4210-91c9-500ea14894a3/crucible/regions/937e9072-93f6-459b-8b47-82a52b875c95
72026-09-05T00:00:38.807ZINFOcrucible-agent (worker): creating region Region { id: RegionId("937e9072-93f6-459b-8b47-82a52b875c95"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/937e9072-93f6-459b-8b47-82a52b875c95" region = 937e9072-93f6-459b-8b47-82a52b875c95
82026-09-05T00:00:38.807ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "937e9072-93f6-459b-8b47-82a52b875c95" "--data" "/data/regions/937e9072-93f6-459b-8b47-82a52b875c95" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 937e9072-93f6-459b-8b47-82a52b875c95
92026-09-05T00:00:38.854ZINFOcrucible-agent (worker): region files created ok region = 937e9072-93f6-459b-8b47-82a52b875c95
102026-09-05T00:00:38.854ZINFOcrucible-agent (datafile): region 937e9072-93f6-459b-8b47-82a52b875c95 state: Requested -> Created
112026-09-05T00:00:38.854ZINFOcrucible-agent (worker): applying SMF actions post create...
122026-09-05T00:00:38.854ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-937e9072-93f6-459b-8b47-82a52b875c95
132026-09-05T00:00:38.857ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-937e9072-93f6-459b-8b47-82a52b875c95
142026-09-05T00:00:38.867ZINFOcrucible-agent (worker): creating config property group
152026-09-05T00:00:38.868ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-937e9072-93f6-459b-8b47-82a52b875c95
162026-09-05T00:00:38.868ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/937e9072-93f6-459b-8b47-82a52b875c95
172026-09-05T00:00:38.869ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
182026-09-05T00:00:38.869ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::18
192026-09-05T00:00:38.869ZINFOcrucible-agent (worker): commit
202026-09-05T00:00:38.870ZINFOcrucible-agent (worker): ok!
212026-09-05T00:00:38.874ZINFOcrucible-agent (worker): SMF ok!
222026-09-05T00:00:38.943ZINFOcrucible-agent (dropshot): request completed latency_us = 62 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:57727 req_id = ebad99ce-3973-4f41-8b6e-ed58930edd79 response_code = 200 uri = /crucible/0/regions
232026-09-05T00:00:39.930ZINFOcrucible-agent (dropshot): request completed latency_us = 75 local_addr = [fd00:1122:3344:101::18]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:57727 req_id = af6c5003-b5f5-43c4-ab69-738e0523d0db response_code = 200 uri = /crucible/0/regions/b9e88acb-c585-4353-ad1f-bdbc05096e28
242026-09-05T00:00:39.936ZINFOcrucible-agent (datafile): path is "/data/regions/b9e88acb-c585-4353-ad1f-bdbc05096e28"
252026-09-05T00:00:39.943ZINFOcrucible-agent (datafile): dataset is oxp_220386fa-f243-4210-91c9-500ea14894a3/crucible/regions/b9e88acb-c585-4353-ad1f-bdbc05096e28
262026-09-05T00:00:39.950ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_220386fa-f243-4210-91c9-500ea14894a3/crucible/regions/b9e88acb-c585-4353-ad1f-bdbc05096e28@7e99f99d-ccb2-48af-9d2e-b1b489c1945c
272026-09-05T00:00:39.950ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_220386fa-f243-4210-91c9-500ea14894a3/crucible/regions/b9e88acb-c585-4353-ad1f-bdbc05096e28", "7e99f99d-ccb2-48af-9d2e-b1b489c1945c"]
282026-09-05T00:00:39.961ZINFOcrucible-agent (dropshot): request completed latency_us = 25448 local_addr = [fd00:1122:3344:101::18]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:57727 req_id = 5df15724-6c42-46c7-906d-ae18df74c3ae response_code = 200 uri = /crucible/0/regions/b9e88acb-c585-4353-ad1f-bdbc05096e28/snapshots/7e99f99d-ccb2-48af-9d2e-b1b489c1945c
292026-09-05T00:00:39.971ZINFOcrucible-agent (datafile): path is "/data/regions/b9e88acb-c585-4353-ad1f-bdbc05096e28"
302026-09-05T00:00:39.978ZINFOcrucible-agent (datafile): dataset is oxp_220386fa-f243-4210-91c9-500ea14894a3/crucible/regions/b9e88acb-c585-4353-ad1f-bdbc05096e28
312026-09-05T00:00:39.983ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_220386fa-f243-4210-91c9-500ea14894a3/crucible/regions/b9e88acb-c585-4353-ad1f-bdbc05096e28@7e99f99d-ccb2-48af-9d2e-b1b489c1945c
322026-09-05T00:00:39.983ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_220386fa-f243-4210-91c9-500ea14894a3/crucible/regions/b9e88acb-c585-4353-ad1f-bdbc05096e28", "7e99f99d-ccb2-48af-9d2e-b1b489c1945c"]
332026-09-05T00:00:39.991ZINFOcrucible-agent (datafile): requesting running snapshot b9e88acb-c585-4353-ad1f-bdbc05096e28-7e99f99d-ccb2-48af-9d2e-b1b489c1945c state: Requested
342026-09-05T00:00:39.996ZINFOcrucible-agent (dropshot): request completed latency_us = 25569 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:57727 req_id = 9ab75198-7092-40e5-88e3-095a6586878e response_code = 200 uri = /crucible/0/regions/b9e88acb-c585-4353-ad1f-bdbc05096e28/snapshots/7e99f99d-ccb2-48af-9d2e-b1b489c1945c/run
352026-09-05T00:00:39.996ZINFOcrucible-agent (worker): applying SMF actions for region b9e88acb-c585-4353-ad1f-bdbc05096e28 running snapshot 7e99f99d-ccb2-48af-9d2e-b1b489c1945c (state Requested)...
362026-09-05T00:00:39.998ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-b9e88acb-c585-4353-ad1f-bdbc05096e28-7e99f99d-ccb2-48af-9d2e-b1b489c1945c
372026-09-05T00:00:40.004ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-b9e88acb-c585-4353-ad1f-bdbc05096e28-7e99f99d-ccb2-48af-9d2e-b1b489c1945c
382026-09-05T00:00:40.008ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-b9e88acb-c585-4353-ad1f-bdbc05096e28-7e99f99d-ccb2-48af-9d2e-b1b489c1945c
392026-09-05T00:00:40.009ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/b9e88acb-c585-4353-ad1f-bdbc05096e28/.zfs/snapshot/7e99f99d-ccb2-48af-9d2e-b1b489c1945c
402026-09-05T00:00:40.009ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
412026-09-05T00:00:40.009ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
422026-09-05T00:00:40.009ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::18
432026-09-05T00:00:40.009ZINFOcrucible-agent (worker): commit
442026-09-05T00:00:40.011ZINFOcrucible-agent (worker): ok!
452026-09-05T00:00:40.014ZINFOcrucible-agent (worker): SMF ok!
462026-09-05T00:00:40.014ZINFOcrucible-agent (datafile): region b9e88acb-c585-4353-ad1f-bdbc05096e28 running snapshot 7e99f99d-ccb2-48af-9d2e-b1b489c1945c state: Requested -> Created
472026-09-05T00:00:40.244ZINFOcrucible-agent (datafile): path is "/data/regions/b9e88acb-c585-4353-ad1f-bdbc05096e28"
482026-09-05T00:00:40.252ZINFOcrucible-agent (datafile): dataset is oxp_220386fa-f243-4210-91c9-500ea14894a3/crucible/regions/b9e88acb-c585-4353-ad1f-bdbc05096e28
492026-09-05T00:00:40.257ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_220386fa-f243-4210-91c9-500ea14894a3/crucible/regions/b9e88acb-c585-4353-ad1f-bdbc05096e28@7e99f99d-ccb2-48af-9d2e-b1b489c1945c
502026-09-05T00:00:40.258ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_220386fa-f243-4210-91c9-500ea14894a3/crucible/regions/b9e88acb-c585-4353-ad1f-bdbc05096e28", "7e99f99d-ccb2-48af-9d2e-b1b489c1945c"]
512026-09-05T00:00:40.263ZINFOcrucible-agent (dropshot): request completed latency_us = 18911 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:57727 req_id = ba262a4a-870a-4903-bc5d-80c1f80cd80e response_code = 200 uri = /crucible/0/regions/b9e88acb-c585-4353-ad1f-bdbc05096e28/snapshots/7e99f99d-ccb2-48af-9d2e-b1b489c1945c/run