Max level shown:
12026-05-11T19:17:37.688ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::16]:32345 remote_addr = [fd00:1122:3344:101::c]:41146
22026-05-11T19:17:37.688ZINFOcrucible-agent (datafile): region 8e961e43-7c8d-4cb6-890a-55f7b3306675 state: Requested
32026-05-11T19:17:37.689ZINFOcrucible-agent (dropshot): request completed latency_us = 633 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:41146 req_id = 6a2d7eef-cdee-452a-93ce-77bb77437f07 response_code = 200 uri = /crucible/0/regions
42026-05-11T19:17:37.689ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
52026-05-11T19:17:37.700ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_efd3b592-add2-49b5-a433-9a1586983e3f/crucible/regions/8e961e43-7c8d-4cb6-890a-55f7b3306675
62026-05-11T19:17:37.700ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_efd3b592-add2-49b5-a433-9a1586983e3f/crucible/regions/8e961e43-7c8d-4cb6-890a-55f7b3306675
72026-05-11T19:17:37.753ZINFOcrucible-agent (worker): creating region Region { id: RegionId("8e961e43-7c8d-4cb6-890a-55f7b3306675"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/8e961e43-7c8d-4cb6-890a-55f7b3306675" region = 8e961e43-7c8d-4cb6-890a-55f7b3306675
82026-05-11T19:17:37.753ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "8e961e43-7c8d-4cb6-890a-55f7b3306675" "--data" "/data/regions/8e961e43-7c8d-4cb6-890a-55f7b3306675" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 8e961e43-7c8d-4cb6-890a-55f7b3306675
92026-05-11T19:17:37.839ZINFOcrucible-agent (worker): region files created ok region = 8e961e43-7c8d-4cb6-890a-55f7b3306675
102026-05-11T19:17:37.839ZINFOcrucible-agent (datafile): region 8e961e43-7c8d-4cb6-890a-55f7b3306675 state: Requested -> Created
112026-05-11T19:17:37.839ZINFOcrucible-agent (worker): applying SMF actions post create...
122026-05-11T19:17:37.849ZINFOcrucible-agent (dropshot): request completed latency_us = 56 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:41146 req_id = ce4ea727-2f4b-4d1c-9d9a-0c46f0b1d3d5 response_code = 200 uri = /crucible/0/regions
132026-05-11T19:17:37.859ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-8e961e43-7c8d-4cb6-890a-55f7b3306675
142026-05-11T19:17:37.865ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-8e961e43-7c8d-4cb6-890a-55f7b3306675
152026-05-11T19:17:37.874ZINFOcrucible-agent (worker): creating config property group
162026-05-11T19:17:37.877ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-8e961e43-7c8d-4cb6-890a-55f7b3306675
172026-05-11T19:17:37.877ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/8e961e43-7c8d-4cb6-890a-55f7b3306675
182026-05-11T19:17:37.877ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
192026-05-11T19:17:37.877ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::16
202026-05-11T19:17:37.877ZINFOcrucible-agent (worker): commit
212026-05-11T19:17:37.880ZINFOcrucible-agent (worker): ok!
222026-05-11T19:17:37.884ZINFOcrucible-agent (worker): SMF ok!
232026-05-11T19:17:38.727ZINFOcrucible-agent (dropshot): request completed latency_us = 72 local_addr = [fd00:1122:3344:101::16]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:41146 req_id = 9c08d5f7-6c6e-4742-a776-f55fd564e9b0 response_code = 200 uri = /crucible/0/regions/44993ee2-f02f-414a-816c-919e84bf6112
242026-05-11T19:17:38.737ZINFOcrucible-agent (datafile): path is "/data/regions/44993ee2-f02f-414a-816c-919e84bf6112"
252026-05-11T19:17:38.744ZINFOcrucible-agent (datafile): dataset is oxp_efd3b592-add2-49b5-a433-9a1586983e3f/crucible/regions/44993ee2-f02f-414a-816c-919e84bf6112
262026-05-11T19:17:38.750ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_efd3b592-add2-49b5-a433-9a1586983e3f/crucible/regions/44993ee2-f02f-414a-816c-919e84bf6112@679059f3-1d4d-48a8-b916-ebad99a4977a
272026-05-11T19:17:38.750ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_efd3b592-add2-49b5-a433-9a1586983e3f/crucible/regions/44993ee2-f02f-414a-816c-919e84bf6112", "679059f3-1d4d-48a8-b916-ebad99a4977a"]
282026-05-11T19:17:38.759ZINFOcrucible-agent (dropshot): request completed latency_us = 21928 local_addr = [fd00:1122:3344:101::16]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:41146 req_id = 8d64dee2-5c5d-4a26-bc23-abb4049eedb5 response_code = 200 uri = /crucible/0/regions/44993ee2-f02f-414a-816c-919e84bf6112/snapshots/679059f3-1d4d-48a8-b916-ebad99a4977a
292026-05-11T19:17:38.767ZINFOcrucible-agent (datafile): path is "/data/regions/44993ee2-f02f-414a-816c-919e84bf6112"
302026-05-11T19:17:38.774ZINFOcrucible-agent (datafile): dataset is oxp_efd3b592-add2-49b5-a433-9a1586983e3f/crucible/regions/44993ee2-f02f-414a-816c-919e84bf6112
312026-05-11T19:17:38.780ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_efd3b592-add2-49b5-a433-9a1586983e3f/crucible/regions/44993ee2-f02f-414a-816c-919e84bf6112@679059f3-1d4d-48a8-b916-ebad99a4977a
322026-05-11T19:17:38.780ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_efd3b592-add2-49b5-a433-9a1586983e3f/crucible/regions/44993ee2-f02f-414a-816c-919e84bf6112", "679059f3-1d4d-48a8-b916-ebad99a4977a"]
332026-05-11T19:17:38.787ZINFOcrucible-agent (datafile): requesting running snapshot 44993ee2-f02f-414a-816c-919e84bf6112-679059f3-1d4d-48a8-b916-ebad99a4977a state: Requested
342026-05-11T19:17:38.787ZINFOcrucible-agent (dropshot): request completed latency_us = 19528 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:41146 req_id = 3cc3d415-7a23-40a0-82d8-8b67f20e5d88 response_code = 200 uri = /crucible/0/regions/44993ee2-f02f-414a-816c-919e84bf6112/snapshots/679059f3-1d4d-48a8-b916-ebad99a4977a/run
352026-05-11T19:17:38.787ZINFOcrucible-agent (worker): applying SMF actions for region 44993ee2-f02f-414a-816c-919e84bf6112 running snapshot 679059f3-1d4d-48a8-b916-ebad99a4977a (state Requested)...
362026-05-11T19:17:38.791ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-44993ee2-f02f-414a-816c-919e84bf6112-679059f3-1d4d-48a8-b916-ebad99a4977a
372026-05-11T19:17:38.797ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-44993ee2-f02f-414a-816c-919e84bf6112-679059f3-1d4d-48a8-b916-ebad99a4977a
382026-05-11T19:17:38.808ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-44993ee2-f02f-414a-816c-919e84bf6112-679059f3-1d4d-48a8-b916-ebad99a4977a
392026-05-11T19:17:38.808ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/44993ee2-f02f-414a-816c-919e84bf6112/.zfs/snapshot/679059f3-1d4d-48a8-b916-ebad99a4977a
402026-05-11T19:17:38.808ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
412026-05-11T19:17:38.808ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
422026-05-11T19:17:38.808ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::16
432026-05-11T19:17:38.808ZINFOcrucible-agent (worker): commit
442026-05-11T19:17:38.811ZINFOcrucible-agent (worker): ok!
452026-05-11T19:17:38.816ZINFOcrucible-agent (worker): SMF ok!
462026-05-11T19:17:38.816ZINFOcrucible-agent (datafile): region 44993ee2-f02f-414a-816c-919e84bf6112 running snapshot 679059f3-1d4d-48a8-b916-ebad99a4977a state: Requested -> Created
472026-05-11T19:17:39.140ZINFOcrucible-agent (datafile): path is "/data/regions/44993ee2-f02f-414a-816c-919e84bf6112"
482026-05-11T19:17:39.146ZINFOcrucible-agent (datafile): dataset is oxp_efd3b592-add2-49b5-a433-9a1586983e3f/crucible/regions/44993ee2-f02f-414a-816c-919e84bf6112
492026-05-11T19:17:39.152ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_efd3b592-add2-49b5-a433-9a1586983e3f/crucible/regions/44993ee2-f02f-414a-816c-919e84bf6112@679059f3-1d4d-48a8-b916-ebad99a4977a
502026-05-11T19:17:39.152ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_efd3b592-add2-49b5-a433-9a1586983e3f/crucible/regions/44993ee2-f02f-414a-816c-919e84bf6112", "679059f3-1d4d-48a8-b916-ebad99a4977a"]
512026-05-11T19:17:39.158ZINFOcrucible-agent (dropshot): request completed latency_us = 18691 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:41146 req_id = 1947eaae-1061-4735-9b8d-bf8dedb5e472 response_code = 200 uri = /crucible/0/regions/44993ee2-f02f-414a-816c-919e84bf6112/snapshots/679059f3-1d4d-48a8-b916-ebad99a4977a/run