Max level shown:
12026-05-19T20:15:08.937ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::12]:32345 remote_addr = [fd00:1122:3344:101::a]:36523
22026-05-19T20:15:08.937ZINFOcrucible-agent (datafile): region 66f4e69c-5d66-4b07-827f-5323ef08b44e state: Requested
32026-05-19T20:15:08.938ZINFOcrucible-agent (dropshot): request completed latency_us = 708 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:36523 req_id = ed04eef5-eab2-4e5d-9f96-84a5e8094d3f response_code = 200 uri = /crucible/0/regions
42026-05-19T20:15:08.938ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
52026-05-19T20:15:08.962ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_b9bfae8b-54c6-4db3-b43b-d8ebe732d491/crucible/regions/66f4e69c-5d66-4b07-827f-5323ef08b44e
62026-05-19T20:15:08.962ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_b9bfae8b-54c6-4db3-b43b-d8ebe732d491/crucible/regions/66f4e69c-5d66-4b07-827f-5323ef08b44e
72026-05-19T20:15:09.099ZINFOcrucible-agent (dropshot): request completed latency_us = 53 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:36523 req_id = 06227dc6-4c54-46fe-9594-3c2428226e1c response_code = 200 uri = /crucible/0/regions
82026-05-19T20:15:09.685ZINFOcrucible-agent (worker): creating region Region { id: RegionId("66f4e69c-5d66-4b07-827f-5323ef08b44e"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/66f4e69c-5d66-4b07-827f-5323ef08b44e" region = 66f4e69c-5d66-4b07-827f-5323ef08b44e
92026-05-19T20:15:09.685ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "66f4e69c-5d66-4b07-827f-5323ef08b44e" "--data" "/data/regions/66f4e69c-5d66-4b07-827f-5323ef08b44e" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 66f4e69c-5d66-4b07-827f-5323ef08b44e
102026-05-19T20:15:09.731ZINFOcrucible-agent (dropshot): request completed latency_us = 56 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:36523 req_id = 34111678-5660-49de-86ed-5f23ad5719b5 response_code = 200 uri = /crucible/0/regions
112026-05-19T20:15:09.769ZINFOcrucible-agent (worker): region files created ok region = 66f4e69c-5d66-4b07-827f-5323ef08b44e
122026-05-19T20:15:09.769ZINFOcrucible-agent (datafile): region 66f4e69c-5d66-4b07-827f-5323ef08b44e state: Requested -> Created
132026-05-19T20:15:09.769ZINFOcrucible-agent (worker): applying SMF actions post create...
142026-05-19T20:15:09.792ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-66f4e69c-5d66-4b07-827f-5323ef08b44e
152026-05-19T20:15:09.801ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-66f4e69c-5d66-4b07-827f-5323ef08b44e
162026-05-19T20:15:09.811ZINFOcrucible-agent (worker): creating config property group
172026-05-19T20:15:09.814ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-66f4e69c-5d66-4b07-827f-5323ef08b44e
182026-05-19T20:15:09.814ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/66f4e69c-5d66-4b07-827f-5323ef08b44e
192026-05-19T20:15:09.814ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
202026-05-19T20:15:09.814ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::12
212026-05-19T20:15:09.814ZINFOcrucible-agent (worker): commit
222026-05-19T20:15:09.818ZINFOcrucible-agent (worker): ok!
232026-05-19T20:15:09.823ZINFOcrucible-agent (worker): SMF ok!
242026-05-19T20:15:10.522ZINFOcrucible-agent (dropshot): request completed latency_us = 56 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:36523 req_id = bf026429-0b5c-4309-ad16-48392af1bd43 response_code = 200 uri = /crucible/0/regions
252026-05-19T20:15:10.924ZINFOcrucible-agent (dropshot): request completed latency_us = 64 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:36523 req_id = 40106efd-bc13-444d-83eb-a68c901adb68 response_code = 200 uri = /crucible/0/regions/01cf3375-8b08-4766-8a0f-51ddb8ea6e41
262026-05-19T20:15:10.932ZINFOcrucible-agent (datafile): path is "/data/regions/01cf3375-8b08-4766-8a0f-51ddb8ea6e41"
272026-05-19T20:15:10.939ZINFOcrucible-agent (datafile): dataset is oxp_b9bfae8b-54c6-4db3-b43b-d8ebe732d491/crucible/regions/01cf3375-8b08-4766-8a0f-51ddb8ea6e41
282026-05-19T20:15:10.945ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_b9bfae8b-54c6-4db3-b43b-d8ebe732d491/crucible/regions/01cf3375-8b08-4766-8a0f-51ddb8ea6e41@67819a7a-9ac6-41e3-9914-01e877dd2567
292026-05-19T20:15:10.945ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_b9bfae8b-54c6-4db3-b43b-d8ebe732d491/crucible/regions/01cf3375-8b08-4766-8a0f-51ddb8ea6e41", "67819a7a-9ac6-41e3-9914-01e877dd2567"]
302026-05-19T20:15:10.954ZINFOcrucible-agent (dropshot): request completed latency_us = 22206 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:36523 req_id = 55a984ce-6463-4ece-86d8-bb1feff61ccb response_code = 200 uri = /crucible/0/regions/01cf3375-8b08-4766-8a0f-51ddb8ea6e41/snapshots/67819a7a-9ac6-41e3-9914-01e877dd2567
312026-05-19T20:15:10.960ZINFOcrucible-agent (datafile): path is "/data/regions/01cf3375-8b08-4766-8a0f-51ddb8ea6e41"
322026-05-19T20:15:10.966ZINFOcrucible-agent (datafile): dataset is oxp_b9bfae8b-54c6-4db3-b43b-d8ebe732d491/crucible/regions/01cf3375-8b08-4766-8a0f-51ddb8ea6e41
332026-05-19T20:15:10.973ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_b9bfae8b-54c6-4db3-b43b-d8ebe732d491/crucible/regions/01cf3375-8b08-4766-8a0f-51ddb8ea6e41@67819a7a-9ac6-41e3-9914-01e877dd2567
342026-05-19T20:15:10.973ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_b9bfae8b-54c6-4db3-b43b-d8ebe732d491/crucible/regions/01cf3375-8b08-4766-8a0f-51ddb8ea6e41", "67819a7a-9ac6-41e3-9914-01e877dd2567"]
352026-05-19T20:15:10.981ZINFOcrucible-agent (datafile): requesting running snapshot 01cf3375-8b08-4766-8a0f-51ddb8ea6e41-67819a7a-9ac6-41e3-9914-01e877dd2567 state: Requested
362026-05-19T20:15:10.982ZINFOcrucible-agent (dropshot): request completed latency_us = 21133 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:36523 req_id = 4da5d71d-fd5b-40b1-8bc7-6ff3176dbb63 response_code = 200 uri = /crucible/0/regions/01cf3375-8b08-4766-8a0f-51ddb8ea6e41/snapshots/67819a7a-9ac6-41e3-9914-01e877dd2567/run
372026-05-19T20:15:10.982ZINFOcrucible-agent (worker): applying SMF actions for region 01cf3375-8b08-4766-8a0f-51ddb8ea6e41 running snapshot 67819a7a-9ac6-41e3-9914-01e877dd2567 (state Requested)...
382026-05-19T20:15:10.987ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-01cf3375-8b08-4766-8a0f-51ddb8ea6e41-67819a7a-9ac6-41e3-9914-01e877dd2567
392026-05-19T20:15:10.990ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-01cf3375-8b08-4766-8a0f-51ddb8ea6e41-67819a7a-9ac6-41e3-9914-01e877dd2567
402026-05-19T20:15:10.999ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-01cf3375-8b08-4766-8a0f-51ddb8ea6e41-67819a7a-9ac6-41e3-9914-01e877dd2567
412026-05-19T20:15:10.999ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/01cf3375-8b08-4766-8a0f-51ddb8ea6e41/.zfs/snapshot/67819a7a-9ac6-41e3-9914-01e877dd2567
422026-05-19T20:15:10.999ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
432026-05-19T20:15:10.999ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
442026-05-19T20:15:10.999ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::12
452026-05-19T20:15:10.999ZINFOcrucible-agent (worker): commit
462026-05-19T20:15:11.003ZINFOcrucible-agent (worker): ok!
472026-05-19T20:15:11.007ZINFOcrucible-agent (worker): SMF ok!
482026-05-19T20:15:11.007ZINFOcrucible-agent (datafile): region 01cf3375-8b08-4766-8a0f-51ddb8ea6e41 running snapshot 67819a7a-9ac6-41e3-9914-01e877dd2567 state: Requested -> Created
492026-05-19T20:15:11.340ZINFOcrucible-agent (datafile): path is "/data/regions/01cf3375-8b08-4766-8a0f-51ddb8ea6e41"
502026-05-19T20:15:11.346ZINFOcrucible-agent (datafile): dataset is oxp_b9bfae8b-54c6-4db3-b43b-d8ebe732d491/crucible/regions/01cf3375-8b08-4766-8a0f-51ddb8ea6e41
512026-05-19T20:15:11.353ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_b9bfae8b-54c6-4db3-b43b-d8ebe732d491/crucible/regions/01cf3375-8b08-4766-8a0f-51ddb8ea6e41@67819a7a-9ac6-41e3-9914-01e877dd2567
522026-05-19T20:15:11.353ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_b9bfae8b-54c6-4db3-b43b-d8ebe732d491/crucible/regions/01cf3375-8b08-4766-8a0f-51ddb8ea6e41", "67819a7a-9ac6-41e3-9914-01e877dd2567"]
532026-05-19T20:15:11.360ZINFOcrucible-agent (dropshot): request completed latency_us = 20440 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:36523 req_id = 6fb2163b-3131-4060-8c77-174b39ea9a3c response_code = 200 uri = /crucible/0/regions/01cf3375-8b08-4766-8a0f-51ddb8ea6e41/snapshots/67819a7a-9ac6-41e3-9914-01e877dd2567/run