Max level shown:
12026-06-17T22:34:11.726ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::15]:32345 remote_addr = [fd00:1122:3344:101::c]:48945
22026-06-17T22:34:11.726ZINFOcrucible-agent (datafile): region 741060c4-8d5e-4508-8d84-6961e2f42b20 state: Requested
32026-06-17T22:34:11.727ZINFOcrucible-agent (dropshot): request completed latency_us = 625 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:48945 req_id = 81fc5107-dee0-44f2-b13d-d750be472868 response_code = 200 uri = /crucible/0/regions
42026-06-17T22:34:11.727ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
52026-06-17T22:34:11.735ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_69c80b99-5a7e-4e6c-969c-6e17dc398c5e/crucible/regions/741060c4-8d5e-4508-8d84-6961e2f42b20
62026-06-17T22:34:11.735ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_69c80b99-5a7e-4e6c-969c-6e17dc398c5e/crucible/regions/741060c4-8d5e-4508-8d84-6961e2f42b20
72026-06-17T22:34:11.787ZINFOcrucible-agent (worker): creating region Region { id: RegionId("741060c4-8d5e-4508-8d84-6961e2f42b20"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/741060c4-8d5e-4508-8d84-6961e2f42b20" region = 741060c4-8d5e-4508-8d84-6961e2f42b20
82026-06-17T22:34:11.787ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "741060c4-8d5e-4508-8d84-6961e2f42b20" "--data" "/data/regions/741060c4-8d5e-4508-8d84-6961e2f42b20" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 741060c4-8d5e-4508-8d84-6961e2f42b20
92026-06-17T22:34:11.867ZINFOcrucible-agent (worker): region files created ok region = 741060c4-8d5e-4508-8d84-6961e2f42b20
102026-06-17T22:34:11.867ZINFOcrucible-agent (datafile): region 741060c4-8d5e-4508-8d84-6961e2f42b20 state: Requested -> Created
112026-06-17T22:34:11.867ZINFOcrucible-agent (worker): applying SMF actions post create...
122026-06-17T22:34:11.878ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-741060c4-8d5e-4508-8d84-6961e2f42b20
132026-06-17T22:34:11.889ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-741060c4-8d5e-4508-8d84-6961e2f42b20
142026-06-17T22:34:11.898ZINFOcrucible-agent (worker): creating config property group
152026-06-17T22:34:11.901ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-741060c4-8d5e-4508-8d84-6961e2f42b20
162026-06-17T22:34:11.901ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/741060c4-8d5e-4508-8d84-6961e2f42b20
172026-06-17T22:34:11.901ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
182026-06-17T22:34:11.901ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::15
192026-06-17T22:34:11.901ZINFOcrucible-agent (worker): commit
202026-06-17T22:34:11.905ZINFOcrucible-agent (worker): ok!
212026-06-17T22:34:11.910ZINFOcrucible-agent (worker): SMF ok!
222026-06-17T22:34:11.982ZINFOcrucible-agent (dropshot): request completed latency_us = 58 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:48945 req_id = b01dd665-cf2b-4d2a-8bfc-90660e6e5ea5 response_code = 200 uri = /crucible/0/regions
232026-06-17T22:34:12.906ZINFOcrucible-agent (dropshot): request completed latency_us = 57 local_addr = [fd00:1122:3344:101::15]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:48945 req_id = 80abb0b6-ca51-4267-a704-160794c2bd92 response_code = 200 uri = /crucible/0/regions/66ae2e72-c562-40d0-a44a-465dc78493ab
242026-06-17T22:34:12.910ZINFOcrucible-agent (datafile): path is "/data/regions/66ae2e72-c562-40d0-a44a-465dc78493ab"
252026-06-17T22:34:12.917ZINFOcrucible-agent (datafile): dataset is oxp_69c80b99-5a7e-4e6c-969c-6e17dc398c5e/crucible/regions/66ae2e72-c562-40d0-a44a-465dc78493ab
262026-06-17T22:34:12.923ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_69c80b99-5a7e-4e6c-969c-6e17dc398c5e/crucible/regions/66ae2e72-c562-40d0-a44a-465dc78493ab@b4aeb31c-912d-4231-b3bd-cd1e447b605e
272026-06-17T22:34:12.923ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_69c80b99-5a7e-4e6c-969c-6e17dc398c5e/crucible/regions/66ae2e72-c562-40d0-a44a-465dc78493ab", "b4aeb31c-912d-4231-b3bd-cd1e447b605e"]
282026-06-17T22:34:12.932ZINFOcrucible-agent (dropshot): request completed latency_us = 22100 local_addr = [fd00:1122:3344:101::15]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:48945 req_id = c860987d-4ebe-467f-95f9-78737e2cc375 response_code = 200 uri = /crucible/0/regions/66ae2e72-c562-40d0-a44a-465dc78493ab/snapshots/b4aeb31c-912d-4231-b3bd-cd1e447b605e
292026-06-17T22:34:12.938ZINFOcrucible-agent (datafile): path is "/data/regions/66ae2e72-c562-40d0-a44a-465dc78493ab"
302026-06-17T22:34:12.943ZINFOcrucible-agent (datafile): dataset is oxp_69c80b99-5a7e-4e6c-969c-6e17dc398c5e/crucible/regions/66ae2e72-c562-40d0-a44a-465dc78493ab
312026-06-17T22:34:12.951ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_69c80b99-5a7e-4e6c-969c-6e17dc398c5e/crucible/regions/66ae2e72-c562-40d0-a44a-465dc78493ab@b4aeb31c-912d-4231-b3bd-cd1e447b605e
322026-06-17T22:34:12.951ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_69c80b99-5a7e-4e6c-969c-6e17dc398c5e/crucible/regions/66ae2e72-c562-40d0-a44a-465dc78493ab", "b4aeb31c-912d-4231-b3bd-cd1e447b605e"]
332026-06-17T22:34:12.960ZINFOcrucible-agent (datafile): requesting running snapshot 66ae2e72-c562-40d0-a44a-465dc78493ab-b4aeb31c-912d-4231-b3bd-cd1e447b605e state: Requested
342026-06-17T22:34:12.960ZINFOcrucible-agent (worker): applying SMF actions for region 66ae2e72-c562-40d0-a44a-465dc78493ab running snapshot b4aeb31c-912d-4231-b3bd-cd1e447b605e (state Requested)...
352026-06-17T22:34:12.960ZINFOcrucible-agent (dropshot): request completed latency_us = 22311 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:48945 req_id = e8cebe08-2eb0-46b4-883f-06ce21b90fa0 response_code = 200 uri = /crucible/0/regions/66ae2e72-c562-40d0-a44a-465dc78493ab/snapshots/b4aeb31c-912d-4231-b3bd-cd1e447b605e/run
362026-06-17T22:34:12.965ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-66ae2e72-c562-40d0-a44a-465dc78493ab-b4aeb31c-912d-4231-b3bd-cd1e447b605e
372026-06-17T22:34:12.969ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-66ae2e72-c562-40d0-a44a-465dc78493ab-b4aeb31c-912d-4231-b3bd-cd1e447b605e
382026-06-17T22:34:12.980ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-66ae2e72-c562-40d0-a44a-465dc78493ab-b4aeb31c-912d-4231-b3bd-cd1e447b605e
392026-06-17T22:34:12.980ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/66ae2e72-c562-40d0-a44a-465dc78493ab/.zfs/snapshot/b4aeb31c-912d-4231-b3bd-cd1e447b605e
402026-06-17T22:34:12.980ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
412026-06-17T22:34:12.980ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
422026-06-17T22:34:12.980ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::15
432026-06-17T22:34:12.980ZINFOcrucible-agent (worker): commit
442026-06-17T22:34:12.984ZINFOcrucible-agent (worker): ok!
452026-06-17T22:34:12.989ZINFOcrucible-agent (worker): SMF ok!
462026-06-17T22:34:12.989ZINFOcrucible-agent (datafile): region 66ae2e72-c562-40d0-a44a-465dc78493ab running snapshot b4aeb31c-912d-4231-b3bd-cd1e447b605e state: Requested -> Created
472026-06-17T22:34:13.253ZINFOcrucible-agent (datafile): path is "/data/regions/66ae2e72-c562-40d0-a44a-465dc78493ab"
482026-06-17T22:34:13.261ZINFOcrucible-agent (datafile): dataset is oxp_69c80b99-5a7e-4e6c-969c-6e17dc398c5e/crucible/regions/66ae2e72-c562-40d0-a44a-465dc78493ab
492026-06-17T22:34:13.267ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_69c80b99-5a7e-4e6c-969c-6e17dc398c5e/crucible/regions/66ae2e72-c562-40d0-a44a-465dc78493ab@b4aeb31c-912d-4231-b3bd-cd1e447b605e
502026-06-17T22:34:13.267ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_69c80b99-5a7e-4e6c-969c-6e17dc398c5e/crucible/regions/66ae2e72-c562-40d0-a44a-465dc78493ab", "b4aeb31c-912d-4231-b3bd-cd1e447b605e"]
512026-06-17T22:34:13.274ZINFOcrucible-agent (dropshot): request completed latency_us = 21079 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:48945 req_id = 8f788e6a-3707-4133-ac7f-fdbe9f9ee001 response_code = 200 uri = /crucible/0/regions/66ae2e72-c562-40d0-a44a-465dc78493ab/snapshots/b4aeb31c-912d-4231-b3bd-cd1e447b605e/run