Max level shown:
12026-05-04T20:09:57.233ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::15]:32345 remote_addr = [fd00:1122:3344:101::b]:36029
22026-05-04T20:09:57.233ZINFOcrucible-agent (datafile): region c60c58e0-626c-4305-a82f-58c07eb9ce3c state: Requested
32026-05-04T20:09:57.234ZINFOcrucible-agent (dropshot): request completed latency_us = 604 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:36029 req_id = 4b99096e-3554-4498-9b69-3966a6927424 response_code = 200 uri = /crucible/0/regions
42026-05-04T20:09:57.234ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
52026-05-04T20:09:57.243ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_ac7d0fc5-5531-404b-a9d2-73a3626fdb19/crucible/regions/c60c58e0-626c-4305-a82f-58c07eb9ce3c
62026-05-04T20:09:57.243ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_ac7d0fc5-5531-404b-a9d2-73a3626fdb19/crucible/regions/c60c58e0-626c-4305-a82f-58c07eb9ce3c
72026-05-04T20:09:57.298ZINFOcrucible-agent (worker): creating region Region { id: RegionId("c60c58e0-626c-4305-a82f-58c07eb9ce3c"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/c60c58e0-626c-4305-a82f-58c07eb9ce3c" region = c60c58e0-626c-4305-a82f-58c07eb9ce3c
82026-05-04T20:09:57.298ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "c60c58e0-626c-4305-a82f-58c07eb9ce3c" "--data" "/data/regions/c60c58e0-626c-4305-a82f-58c07eb9ce3c" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = c60c58e0-626c-4305-a82f-58c07eb9ce3c
92026-05-04T20:09:57.372ZINFOcrucible-agent (worker): region files created ok region = c60c58e0-626c-4305-a82f-58c07eb9ce3c
102026-05-04T20:09:57.372ZINFOcrucible-agent (datafile): region c60c58e0-626c-4305-a82f-58c07eb9ce3c state: Requested -> Created
112026-05-04T20:09:57.372ZINFOcrucible-agent (worker): applying SMF actions post create...
122026-05-04T20:09:57.373ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-c60c58e0-626c-4305-a82f-58c07eb9ce3c
132026-05-04T20:09:57.386ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-c60c58e0-626c-4305-a82f-58c07eb9ce3c
142026-05-04T20:09:57.409ZINFOcrucible-agent (worker): creating config property group
152026-05-04T20:09:57.413ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-c60c58e0-626c-4305-a82f-58c07eb9ce3c
162026-05-04T20:09:57.413ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/c60c58e0-626c-4305-a82f-58c07eb9ce3c
172026-05-04T20:09:57.413ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
182026-05-04T20:09:57.413ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::15
192026-05-04T20:09:57.414ZINFOcrucible-agent (worker): commit
202026-05-04T20:09:57.418ZINFOcrucible-agent (worker): ok!
212026-05-04T20:09:57.438ZINFOcrucible-agent (worker): SMF ok!
222026-05-04T20:09:57.502ZINFOcrucible-agent (dropshot): request completed latency_us = 76 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:36029 req_id = 7bbfacfd-2ed9-4745-b457-4cd98901458c response_code = 200 uri = /crucible/0/regions
232026-05-04T20:09:58.582ZINFOcrucible-agent (dropshot): request completed latency_us = 74 local_addr = [fd00:1122:3344:101::15]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:36029 req_id = c015db8a-46c2-4b3f-b87f-0c6c0d7cabf8 response_code = 200 uri = /crucible/0/regions/ffc41183-dce3-4762-b258-e7051b1ba514
242026-05-04T20:09:58.586ZINFOcrucible-agent (datafile): path is "/data/regions/ffc41183-dce3-4762-b258-e7051b1ba514"
252026-05-04T20:09:58.592ZINFOcrucible-agent (datafile): dataset is oxp_ac7d0fc5-5531-404b-a9d2-73a3626fdb19/crucible/regions/ffc41183-dce3-4762-b258-e7051b1ba514
262026-05-04T20:09:58.599ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_ac7d0fc5-5531-404b-a9d2-73a3626fdb19/crucible/regions/ffc41183-dce3-4762-b258-e7051b1ba514@4f77290d-2a39-45e8-bd81-6ae98ed0601a
272026-05-04T20:09:58.599ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_ac7d0fc5-5531-404b-a9d2-73a3626fdb19/crucible/regions/ffc41183-dce3-4762-b258-e7051b1ba514", "4f77290d-2a39-45e8-bd81-6ae98ed0601a"]
282026-05-04T20:09:58.607ZINFOcrucible-agent (dropshot): request completed latency_us = 21050 local_addr = [fd00:1122:3344:101::15]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:36029 req_id = 7746189f-0b51-4344-80e8-fbb13522e5cf response_code = 200 uri = /crucible/0/regions/ffc41183-dce3-4762-b258-e7051b1ba514/snapshots/4f77290d-2a39-45e8-bd81-6ae98ed0601a
292026-05-04T20:09:58.610ZINFOcrucible-agent (datafile): path is "/data/regions/ffc41183-dce3-4762-b258-e7051b1ba514"
302026-05-04T20:09:58.615ZINFOcrucible-agent (datafile): dataset is oxp_ac7d0fc5-5531-404b-a9d2-73a3626fdb19/crucible/regions/ffc41183-dce3-4762-b258-e7051b1ba514
312026-05-04T20:09:58.620ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_ac7d0fc5-5531-404b-a9d2-73a3626fdb19/crucible/regions/ffc41183-dce3-4762-b258-e7051b1ba514@4f77290d-2a39-45e8-bd81-6ae98ed0601a
322026-05-04T20:09:58.620ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_ac7d0fc5-5531-404b-a9d2-73a3626fdb19/crucible/regions/ffc41183-dce3-4762-b258-e7051b1ba514", "4f77290d-2a39-45e8-bd81-6ae98ed0601a"]
332026-05-04T20:09:58.627ZINFOcrucible-agent (datafile): requesting running snapshot ffc41183-dce3-4762-b258-e7051b1ba514-4f77290d-2a39-45e8-bd81-6ae98ed0601a state: Requested
342026-05-04T20:09:58.627ZINFOcrucible-agent (dropshot): request completed latency_us = 16763 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:36029 req_id = 2a9cd7e7-92b9-4769-af49-6f505dab8b0f response_code = 200 uri = /crucible/0/regions/ffc41183-dce3-4762-b258-e7051b1ba514/snapshots/4f77290d-2a39-45e8-bd81-6ae98ed0601a/run
352026-05-04T20:09:58.627ZINFOcrucible-agent (worker): applying SMF actions for region ffc41183-dce3-4762-b258-e7051b1ba514 running snapshot 4f77290d-2a39-45e8-bd81-6ae98ed0601a (state Requested)...
362026-05-04T20:09:58.631ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-ffc41183-dce3-4762-b258-e7051b1ba514-4f77290d-2a39-45e8-bd81-6ae98ed0601a
372026-05-04T20:09:58.639ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-ffc41183-dce3-4762-b258-e7051b1ba514-4f77290d-2a39-45e8-bd81-6ae98ed0601a
382026-05-04T20:09:58.648ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-ffc41183-dce3-4762-b258-e7051b1ba514-4f77290d-2a39-45e8-bd81-6ae98ed0601a
392026-05-04T20:09:58.649ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/ffc41183-dce3-4762-b258-e7051b1ba514/.zfs/snapshot/4f77290d-2a39-45e8-bd81-6ae98ed0601a
402026-05-04T20:09:58.649ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
412026-05-04T20:09:58.649ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
422026-05-04T20:09:58.649ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::15
432026-05-04T20:09:58.649ZINFOcrucible-agent (worker): commit
442026-05-04T20:09:58.652ZINFOcrucible-agent (worker): ok!
452026-05-04T20:09:58.656ZINFOcrucible-agent (worker): SMF ok!
462026-05-04T20:09:58.656ZINFOcrucible-agent (datafile): region ffc41183-dce3-4762-b258-e7051b1ba514 running snapshot 4f77290d-2a39-45e8-bd81-6ae98ed0601a state: Requested -> Created
472026-05-04T20:09:58.913ZINFOcrucible-agent (datafile): path is "/data/regions/ffc41183-dce3-4762-b258-e7051b1ba514"
482026-05-04T20:09:58.919ZINFOcrucible-agent (datafile): dataset is oxp_ac7d0fc5-5531-404b-a9d2-73a3626fdb19/crucible/regions/ffc41183-dce3-4762-b258-e7051b1ba514
492026-05-04T20:09:58.926ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_ac7d0fc5-5531-404b-a9d2-73a3626fdb19/crucible/regions/ffc41183-dce3-4762-b258-e7051b1ba514@4f77290d-2a39-45e8-bd81-6ae98ed0601a
502026-05-04T20:09:58.926ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_ac7d0fc5-5531-404b-a9d2-73a3626fdb19/crucible/regions/ffc41183-dce3-4762-b258-e7051b1ba514", "4f77290d-2a39-45e8-bd81-6ae98ed0601a"]
512026-05-04T20:09:58.932ZINFOcrucible-agent (dropshot): request completed latency_us = 19656 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:36029 req_id = dcf12d46-9487-4f33-8bbe-0a4e09b647b1 response_code = 200 uri = /crucible/0/regions/ffc41183-dce3-4762-b258-e7051b1ba514/snapshots/4f77290d-2a39-45e8-bd81-6ae98ed0601a/run