Max level shown:
12026-08-10T20:20:27.476ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::13]:32345 remote_addr = [fd00:1122:3344:101::b]:61685
22026-08-10T20:20:27.476ZINFOcrucible-agent (datafile): region 95d89ce3-1055-43ac-98ec-d4c91905ca81 state: Requested
32026-08-10T20:20:27.477ZINFOcrucible-agent (dropshot): request completed latency_us = 646 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:61685 req_id = 3f755359-6251-48e9-a70b-1d81aabc6ddd response_code = 200 uri = /crucible/0/regions
42026-08-10T20:20:27.477ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
52026-08-10T20:20:27.485ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_b5d4c7a4-e750-4983-8655-197f35f547d6/crucible/regions/95d89ce3-1055-43ac-98ec-d4c91905ca81
62026-08-10T20:20:27.485ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_b5d4c7a4-e750-4983-8655-197f35f547d6/crucible/regions/95d89ce3-1055-43ac-98ec-d4c91905ca81
72026-08-10T20:20:27.542ZINFOcrucible-agent (worker): creating region Region { id: RegionId("95d89ce3-1055-43ac-98ec-d4c91905ca81"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/95d89ce3-1055-43ac-98ec-d4c91905ca81" region = 95d89ce3-1055-43ac-98ec-d4c91905ca81
82026-08-10T20:20:27.542ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "95d89ce3-1055-43ac-98ec-d4c91905ca81" "--data" "/data/regions/95d89ce3-1055-43ac-98ec-d4c91905ca81" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 95d89ce3-1055-43ac-98ec-d4c91905ca81
92026-08-10T20:20:27.616ZINFOcrucible-agent (worker): region files created ok region = 95d89ce3-1055-43ac-98ec-d4c91905ca81
102026-08-10T20:20:27.616ZINFOcrucible-agent (datafile): region 95d89ce3-1055-43ac-98ec-d4c91905ca81 state: Requested -> Created
112026-08-10T20:20:27.617ZINFOcrucible-agent (worker): applying SMF actions post create...
122026-08-10T20:20:27.617ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-95d89ce3-1055-43ac-98ec-d4c91905ca81
132026-08-10T20:20:27.633ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-95d89ce3-1055-43ac-98ec-d4c91905ca81
142026-08-10T20:20:27.634ZINFOcrucible-agent (dropshot): request completed latency_us = 62 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:61685 req_id = 72105c53-ebd7-49a7-9767-7483e92492f2 response_code = 200 uri = /crucible/0/regions
152026-08-10T20:20:27.644ZINFOcrucible-agent (worker): creating config property group
162026-08-10T20:20:27.647ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-95d89ce3-1055-43ac-98ec-d4c91905ca81
172026-08-10T20:20:27.647ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/95d89ce3-1055-43ac-98ec-d4c91905ca81
182026-08-10T20:20:27.647ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
192026-08-10T20:20:27.647ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::13
202026-08-10T20:20:27.647ZINFOcrucible-agent (worker): commit
212026-08-10T20:20:27.651ZINFOcrucible-agent (worker): ok!
222026-08-10T20:20:27.657ZINFOcrucible-agent (worker): SMF ok!
232026-08-10T20:20:28.860ZINFOcrucible-agent (dropshot): request completed latency_us = 71 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:61685 req_id = 154cfe5f-8fec-4a6d-938d-483326a9837b response_code = 200 uri = /crucible/0/regions/b2dd03f8-fa27-4c8d-a472-fee009a8257b
242026-08-10T20:20:28.863ZINFOcrucible-agent (datafile): path is "/data/regions/b2dd03f8-fa27-4c8d-a472-fee009a8257b"
252026-08-10T20:20:28.870ZINFOcrucible-agent (datafile): dataset is oxp_b5d4c7a4-e750-4983-8655-197f35f547d6/crucible/regions/b2dd03f8-fa27-4c8d-a472-fee009a8257b
262026-08-10T20:20:28.876ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_b5d4c7a4-e750-4983-8655-197f35f547d6/crucible/regions/b2dd03f8-fa27-4c8d-a472-fee009a8257b@96d08d43-a96d-45df-93d1-2d4abf2940e8
272026-08-10T20:20:28.876ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_b5d4c7a4-e750-4983-8655-197f35f547d6/crucible/regions/b2dd03f8-fa27-4c8d-a472-fee009a8257b", "96d08d43-a96d-45df-93d1-2d4abf2940e8"]
282026-08-10T20:20:28.886ZINFOcrucible-agent (dropshot): request completed latency_us = 22805 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:61685 req_id = ce11334a-df94-4cd5-92b8-44dd533a30ff response_code = 200 uri = /crucible/0/regions/b2dd03f8-fa27-4c8d-a472-fee009a8257b/snapshots/96d08d43-a96d-45df-93d1-2d4abf2940e8
292026-08-10T20:20:28.890ZINFOcrucible-agent (datafile): path is "/data/regions/b2dd03f8-fa27-4c8d-a472-fee009a8257b"
302026-08-10T20:20:28.896ZINFOcrucible-agent (datafile): dataset is oxp_b5d4c7a4-e750-4983-8655-197f35f547d6/crucible/regions/b2dd03f8-fa27-4c8d-a472-fee009a8257b
312026-08-10T20:20:28.903ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_b5d4c7a4-e750-4983-8655-197f35f547d6/crucible/regions/b2dd03f8-fa27-4c8d-a472-fee009a8257b@96d08d43-a96d-45df-93d1-2d4abf2940e8
322026-08-10T20:20:28.903ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_b5d4c7a4-e750-4983-8655-197f35f547d6/crucible/regions/b2dd03f8-fa27-4c8d-a472-fee009a8257b", "96d08d43-a96d-45df-93d1-2d4abf2940e8"]
332026-08-10T20:20:28.909ZINFOcrucible-agent (datafile): requesting running snapshot b2dd03f8-fa27-4c8d-a472-fee009a8257b-96d08d43-a96d-45df-93d1-2d4abf2940e8 state: Requested
342026-08-10T20:20:28.914ZINFOcrucible-agent (worker): applying SMF actions for region b2dd03f8-fa27-4c8d-a472-fee009a8257b running snapshot 96d08d43-a96d-45df-93d1-2d4abf2940e8 (state Requested)...
352026-08-10T20:20:28.914ZINFOcrucible-agent (dropshot): request completed latency_us = 23690 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:61685 req_id = 710fb2d1-045b-4547-a81d-2f9e5252e73f response_code = 200 uri = /crucible/0/regions/b2dd03f8-fa27-4c8d-a472-fee009a8257b/snapshots/96d08d43-a96d-45df-93d1-2d4abf2940e8/run
362026-08-10T20:20:28.917ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-b2dd03f8-fa27-4c8d-a472-fee009a8257b-96d08d43-a96d-45df-93d1-2d4abf2940e8
372026-08-10T20:20:28.920ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-b2dd03f8-fa27-4c8d-a472-fee009a8257b-96d08d43-a96d-45df-93d1-2d4abf2940e8
382026-08-10T20:20:28.930ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-b2dd03f8-fa27-4c8d-a472-fee009a8257b-96d08d43-a96d-45df-93d1-2d4abf2940e8
392026-08-10T20:20:28.930ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/b2dd03f8-fa27-4c8d-a472-fee009a8257b/.zfs/snapshot/96d08d43-a96d-45df-93d1-2d4abf2940e8
402026-08-10T20:20:28.930ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
412026-08-10T20:20:28.930ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
422026-08-10T20:20:28.930ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::13
432026-08-10T20:20:28.930ZINFOcrucible-agent (worker): commit
442026-08-10T20:20:28.934ZINFOcrucible-agent (worker): ok!
452026-08-10T20:20:28.938ZINFOcrucible-agent (worker): SMF ok!
462026-08-10T20:20:28.938ZINFOcrucible-agent (datafile): region b2dd03f8-fa27-4c8d-a472-fee009a8257b running snapshot 96d08d43-a96d-45df-93d1-2d4abf2940e8 state: Requested -> Created
472026-08-10T20:20:29.055ZINFOcrucible-agent (datafile): path is "/data/regions/b2dd03f8-fa27-4c8d-a472-fee009a8257b"
482026-08-10T20:20:29.062ZINFOcrucible-agent (datafile): dataset is oxp_b5d4c7a4-e750-4983-8655-197f35f547d6/crucible/regions/b2dd03f8-fa27-4c8d-a472-fee009a8257b
492026-08-10T20:20:29.067ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_b5d4c7a4-e750-4983-8655-197f35f547d6/crucible/regions/b2dd03f8-fa27-4c8d-a472-fee009a8257b@96d08d43-a96d-45df-93d1-2d4abf2940e8
502026-08-10T20:20:29.067ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_b5d4c7a4-e750-4983-8655-197f35f547d6/crucible/regions/b2dd03f8-fa27-4c8d-a472-fee009a8257b", "96d08d43-a96d-45df-93d1-2d4abf2940e8"]
512026-08-10T20:20:29.073ZINFOcrucible-agent (dropshot): request completed latency_us = 18394 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:61685 req_id = 59cc2657-8d4e-4ace-9326-2a4151c19ca2 response_code = 200 uri = /crucible/0/regions/b2dd03f8-fa27-4c8d-a472-fee009a8257b/snapshots/96d08d43-a96d-45df-93d1-2d4abf2940e8/run