Max level shown:
12026-09-05T00:00:38.750ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::13]:32345 remote_addr = [fd00:1122:3344:101::b]:52202
22026-09-05T00:00:38.750ZINFOcrucible-agent (datafile): region d32407d0-4519-4cbc-abbf-4740e304572f state: Requested
32026-09-05T00:00:38.751ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42026-09-05T00:00:38.751ZINFOcrucible-agent (dropshot): request completed latency_us = 883 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:52202 req_id = a1d2c1cc-9393-4c12-92aa-d181609b2301 response_code = 200 uri = /crucible/0/regions
52026-09-05T00:00:38.759ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_81f30dd1-2130-418b-ae9c-e1c21e36e94f/crucible/regions/d32407d0-4519-4cbc-abbf-4740e304572f
62026-09-05T00:00:38.759ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_81f30dd1-2130-418b-ae9c-e1c21e36e94f/crucible/regions/d32407d0-4519-4cbc-abbf-4740e304572f
72026-09-05T00:00:38.810ZINFOcrucible-agent (worker): creating region Region { id: RegionId("d32407d0-4519-4cbc-abbf-4740e304572f"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/d32407d0-4519-4cbc-abbf-4740e304572f" region = d32407d0-4519-4cbc-abbf-4740e304572f
82026-09-05T00:00:38.810ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "d32407d0-4519-4cbc-abbf-4740e304572f" "--data" "/data/regions/d32407d0-4519-4cbc-abbf-4740e304572f" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = d32407d0-4519-4cbc-abbf-4740e304572f
92026-09-05T00:00:38.857ZINFOcrucible-agent (worker): region files created ok region = d32407d0-4519-4cbc-abbf-4740e304572f
102026-09-05T00:00:38.857ZINFOcrucible-agent (datafile): region d32407d0-4519-4cbc-abbf-4740e304572f state: Requested -> Created
112026-09-05T00:00:38.857ZINFOcrucible-agent (worker): applying SMF actions post create...
122026-09-05T00:00:38.864ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-d32407d0-4519-4cbc-abbf-4740e304572f
132026-09-05T00:00:38.865ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-d32407d0-4519-4cbc-abbf-4740e304572f
142026-09-05T00:00:38.871ZINFOcrucible-agent (worker): creating config property group
152026-09-05T00:00:38.872ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-d32407d0-4519-4cbc-abbf-4740e304572f
162026-09-05T00:00:38.872ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/d32407d0-4519-4cbc-abbf-4740e304572f
172026-09-05T00:00:38.872ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
182026-09-05T00:00:38.872ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::13
192026-09-05T00:00:38.872ZINFOcrucible-agent (worker): commit
202026-09-05T00:00:38.874ZINFOcrucible-agent (worker): ok!
212026-09-05T00:00:38.877ZINFOcrucible-agent (worker): SMF ok!
222026-09-05T00:00:38.900ZINFOcrucible-agent (dropshot): request completed latency_us = 54 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:52202 req_id = c083f568-81d8-4377-9a2c-041c43100a3e response_code = 200 uri = /crucible/0/regions
232026-09-05T00:00:40.273ZINFOcrucible-agent (dropshot): request completed latency_us = 67 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:52202 req_id = fd10f4b2-166e-4cda-a8b1-9ddd2bdb3c92 response_code = 200 uri = /crucible/0/regions/01058ed5-3800-4e30-84c6-fef3bda1f709
242026-09-05T00:00:40.277ZINFOcrucible-agent (datafile): path is "/data/regions/01058ed5-3800-4e30-84c6-fef3bda1f709"
252026-09-05T00:00:40.283ZINFOcrucible-agent (datafile): dataset is oxp_81f30dd1-2130-418b-ae9c-e1c21e36e94f/crucible/regions/01058ed5-3800-4e30-84c6-fef3bda1f709
262026-09-05T00:00:40.289ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_81f30dd1-2130-418b-ae9c-e1c21e36e94f/crucible/regions/01058ed5-3800-4e30-84c6-fef3bda1f709@7e99f99d-ccb2-48af-9d2e-b1b489c1945c
272026-09-05T00:00:40.289ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_81f30dd1-2130-418b-ae9c-e1c21e36e94f/crucible/regions/01058ed5-3800-4e30-84c6-fef3bda1f709", "7e99f99d-ccb2-48af-9d2e-b1b489c1945c"]
282026-09-05T00:00:40.300ZINFOcrucible-agent (dropshot): request completed latency_us = 22832 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:52202 req_id = 04c3d6da-1dfb-405f-b853-c3d215dc7970 response_code = 200 uri = /crucible/0/regions/01058ed5-3800-4e30-84c6-fef3bda1f709/snapshots/7e99f99d-ccb2-48af-9d2e-b1b489c1945c
292026-09-05T00:00:40.304ZINFOcrucible-agent (datafile): path is "/data/regions/01058ed5-3800-4e30-84c6-fef3bda1f709"
302026-09-05T00:00:40.309ZINFOcrucible-agent (datafile): dataset is oxp_81f30dd1-2130-418b-ae9c-e1c21e36e94f/crucible/regions/01058ed5-3800-4e30-84c6-fef3bda1f709
312026-09-05T00:00:40.314ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_81f30dd1-2130-418b-ae9c-e1c21e36e94f/crucible/regions/01058ed5-3800-4e30-84c6-fef3bda1f709@7e99f99d-ccb2-48af-9d2e-b1b489c1945c
322026-09-05T00:00:40.314ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_81f30dd1-2130-418b-ae9c-e1c21e36e94f/crucible/regions/01058ed5-3800-4e30-84c6-fef3bda1f709", "7e99f99d-ccb2-48af-9d2e-b1b489c1945c"]
332026-09-05T00:00:40.321ZINFOcrucible-agent (datafile): requesting running snapshot 01058ed5-3800-4e30-84c6-fef3bda1f709-7e99f99d-ccb2-48af-9d2e-b1b489c1945c state: Requested
342026-09-05T00:00:40.327ZINFOcrucible-agent (dropshot): request completed latency_us = 22987 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:52202 req_id = ca8a497d-9091-4b5f-9553-b0ba5b27eed1 response_code = 200 uri = /crucible/0/regions/01058ed5-3800-4e30-84c6-fef3bda1f709/snapshots/7e99f99d-ccb2-48af-9d2e-b1b489c1945c/run
352026-09-05T00:00:40.327ZINFOcrucible-agent (worker): applying SMF actions for region 01058ed5-3800-4e30-84c6-fef3bda1f709 running snapshot 7e99f99d-ccb2-48af-9d2e-b1b489c1945c (state Requested)...
362026-09-05T00:00:40.329ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-01058ed5-3800-4e30-84c6-fef3bda1f709-7e99f99d-ccb2-48af-9d2e-b1b489c1945c
372026-09-05T00:00:40.335ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-01058ed5-3800-4e30-84c6-fef3bda1f709-7e99f99d-ccb2-48af-9d2e-b1b489c1945c
382026-09-05T00:00:40.340ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-01058ed5-3800-4e30-84c6-fef3bda1f709-7e99f99d-ccb2-48af-9d2e-b1b489c1945c
392026-09-05T00:00:40.340ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/01058ed5-3800-4e30-84c6-fef3bda1f709/.zfs/snapshot/7e99f99d-ccb2-48af-9d2e-b1b489c1945c
402026-09-05T00:00:40.340ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
412026-09-05T00:00:40.340ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
422026-09-05T00:00:40.340ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::13
432026-09-05T00:00:40.340ZINFOcrucible-agent (worker): commit
442026-09-05T00:00:40.342ZINFOcrucible-agent (worker): ok!
452026-09-05T00:00:40.345ZINFOcrucible-agent (worker): SMF ok!
462026-09-05T00:00:40.345ZINFOcrucible-agent (datafile): region 01058ed5-3800-4e30-84c6-fef3bda1f709 running snapshot 7e99f99d-ccb2-48af-9d2e-b1b489c1945c state: Requested -> Created
472026-09-05T00:00:40.476ZINFOcrucible-agent (datafile): path is "/data/regions/01058ed5-3800-4e30-84c6-fef3bda1f709"
482026-09-05T00:00:40.483ZINFOcrucible-agent (datafile): dataset is oxp_81f30dd1-2130-418b-ae9c-e1c21e36e94f/crucible/regions/01058ed5-3800-4e30-84c6-fef3bda1f709
492026-09-05T00:00:40.490ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_81f30dd1-2130-418b-ae9c-e1c21e36e94f/crucible/regions/01058ed5-3800-4e30-84c6-fef3bda1f709@7e99f99d-ccb2-48af-9d2e-b1b489c1945c
502026-09-05T00:00:40.490ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_81f30dd1-2130-418b-ae9c-e1c21e36e94f/crucible/regions/01058ed5-3800-4e30-84c6-fef3bda1f709", "7e99f99d-ccb2-48af-9d2e-b1b489c1945c"]
512026-09-05T00:00:40.496ZINFOcrucible-agent (dropshot): request completed latency_us = 19689 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:52202 req_id = 1400ec11-4ba6-4194-9d86-4262d7641624 response_code = 200 uri = /crucible/0/regions/01058ed5-3800-4e30-84c6-fef3bda1f709/snapshots/7e99f99d-ccb2-48af-9d2e-b1b489c1945c/run