Max level shown:
12026-08-29T03:00:22.034ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::19]:32345 remote_addr = [fd00:1122:3344:101::c]:47133
22026-08-29T03:00:22.074ZINFOcrucible-agent (datafile): region 674d9e07-956d-4cc2-929d-42f2923e8a71 state: Requested
32026-08-29T03:00:22.080ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42026-08-29T03:00:22.085ZINFOcrucible-agent (dropshot): request completed latency_us = 21759 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:47133 req_id = 50139fb6-8de2-4e39-87e3-15c91f5998a2 response_code = 200 uri = /crucible/0/regions
52026-08-29T03:00:22.089ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_2ed47044-f559-484e-88e9-4cfde0983351/crucible/regions/674d9e07-956d-4cc2-929d-42f2923e8a71
62026-08-29T03:00:22.089ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_2ed47044-f559-484e-88e9-4cfde0983351/crucible/regions/674d9e07-956d-4cc2-929d-42f2923e8a71
72026-08-29T03:00:22.153ZINFOcrucible-agent (worker): creating region Region { id: RegionId("674d9e07-956d-4cc2-929d-42f2923e8a71"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/674d9e07-956d-4cc2-929d-42f2923e8a71" region = 674d9e07-956d-4cc2-929d-42f2923e8a71
82026-08-29T03:00:22.155ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "674d9e07-956d-4cc2-929d-42f2923e8a71" "--data" "/data/regions/674d9e07-956d-4cc2-929d-42f2923e8a71" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 674d9e07-956d-4cc2-929d-42f2923e8a71
92026-08-29T03:00:22.242ZINFOcrucible-agent (dropshot): request completed latency_us = 76 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:47133 req_id = 3afa5874-00b2-4cb0-a219-9468e62df4a8 response_code = 200 uri = /crucible/0/regions
102026-08-29T03:00:22.415ZINFOcrucible-agent (worker): region files created ok region = 674d9e07-956d-4cc2-929d-42f2923e8a71
112026-08-29T03:00:22.420ZINFOcrucible-agent (datafile): region 674d9e07-956d-4cc2-929d-42f2923e8a71 state: Requested -> Created
122026-08-29T03:00:22.420ZINFOcrucible-agent (worker): applying SMF actions post create...
132026-08-29T03:00:22.423ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-674d9e07-956d-4cc2-929d-42f2923e8a71
142026-08-29T03:00:22.429ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-674d9e07-956d-4cc2-929d-42f2923e8a71
152026-08-29T03:00:22.440ZINFOcrucible-agent (worker): creating config property group
162026-08-29T03:00:22.441ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-674d9e07-956d-4cc2-929d-42f2923e8a71
172026-08-29T03:00:22.442ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/674d9e07-956d-4cc2-929d-42f2923e8a71
182026-08-29T03:00:22.442ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
192026-08-29T03:00:22.442ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::19
202026-08-29T03:00:22.442ZINFOcrucible-agent (worker): commit
212026-08-29T03:00:22.444ZINFOcrucible-agent (worker): ok!
222026-08-29T03:00:22.447ZINFOcrucible-agent (worker): SMF ok!
232026-08-29T03:00:22.891ZINFOcrucible-agent (dropshot): request completed latency_us = 82 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:47133 req_id = 801082b6-7afb-4972-b83c-1b68064a8e71 response_code = 200 uri = /crucible/0/regions
242026-08-29T03:11:26.246ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::19]:32345 remote_addr = [fd00:1122:3344:101::c]:58476
252026-08-29T03:11:26.246ZINFOcrucible-agent (dropshot): request completed latency_us = 54 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:58476 req_id = 64d672ad-d940-4129-8c75-5ccceb027dbc response_code = 200 uri = /crucible/0/regions/674d9e07-956d-4cc2-929d-42f2923e8a71
262026-08-29T03:11:26.249ZINFOcrucible-agent (datafile): path is "/data/regions/674d9e07-956d-4cc2-929d-42f2923e8a71"
272026-08-29T03:11:26.256ZINFOcrucible-agent (datafile): dataset is oxp_2ed47044-f559-484e-88e9-4cfde0983351/crucible/regions/674d9e07-956d-4cc2-929d-42f2923e8a71
282026-08-29T03:11:26.262ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_2ed47044-f559-484e-88e9-4cfde0983351/crucible/regions/674d9e07-956d-4cc2-929d-42f2923e8a71@5dafbd5f-4792-4af7-a407-2bf3937fbf1e
292026-08-29T03:11:26.262ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_2ed47044-f559-484e-88e9-4cfde0983351/crucible/regions/674d9e07-956d-4cc2-929d-42f2923e8a71", "5dafbd5f-4792-4af7-a407-2bf3937fbf1e"]
302026-08-29T03:11:26.274ZINFOcrucible-agent (dropshot): request completed latency_us = 25006 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:58476 req_id = 5945ee34-0e0e-49b9-a26d-b9edb24a68d8 response_code = 200 uri = /crucible/0/regions/674d9e07-956d-4cc2-929d-42f2923e8a71/snapshots/5dafbd5f-4792-4af7-a407-2bf3937fbf1e
312026-08-29T03:11:26.277ZINFOcrucible-agent (datafile): path is "/data/regions/674d9e07-956d-4cc2-929d-42f2923e8a71"
322026-08-29T03:11:26.283ZINFOcrucible-agent (datafile): dataset is oxp_2ed47044-f559-484e-88e9-4cfde0983351/crucible/regions/674d9e07-956d-4cc2-929d-42f2923e8a71
332026-08-29T03:11:26.290ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_2ed47044-f559-484e-88e9-4cfde0983351/crucible/regions/674d9e07-956d-4cc2-929d-42f2923e8a71@5dafbd5f-4792-4af7-a407-2bf3937fbf1e
342026-08-29T03:11:26.290ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_2ed47044-f559-484e-88e9-4cfde0983351/crucible/regions/674d9e07-956d-4cc2-929d-42f2923e8a71", "5dafbd5f-4792-4af7-a407-2bf3937fbf1e"]
352026-08-29T03:11:26.297ZINFOcrucible-agent (datafile): requesting running snapshot 674d9e07-956d-4cc2-929d-42f2923e8a71-5dafbd5f-4792-4af7-a407-2bf3937fbf1e state: Requested
362026-08-29T03:11:26.302ZINFOcrucible-agent (worker): applying SMF actions for region 674d9e07-956d-4cc2-929d-42f2923e8a71 running snapshot 5dafbd5f-4792-4af7-a407-2bf3937fbf1e (state Requested)...
372026-08-29T03:11:26.302ZINFOcrucible-agent (dropshot): request completed latency_us = 24574 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:58476 req_id = a291300d-91da-408a-9fc4-c797e024a324 response_code = 200 uri = /crucible/0/regions/674d9e07-956d-4cc2-929d-42f2923e8a71/snapshots/5dafbd5f-4792-4af7-a407-2bf3937fbf1e/run
382026-08-29T03:11:26.309ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-674d9e07-956d-4cc2-929d-42f2923e8a71-5dafbd5f-4792-4af7-a407-2bf3937fbf1e
392026-08-29T03:11:26.314ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-674d9e07-956d-4cc2-929d-42f2923e8a71-5dafbd5f-4792-4af7-a407-2bf3937fbf1e
402026-08-29T03:11:26.321ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-674d9e07-956d-4cc2-929d-42f2923e8a71-5dafbd5f-4792-4af7-a407-2bf3937fbf1e
412026-08-29T03:11:26.321ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/674d9e07-956d-4cc2-929d-42f2923e8a71/.zfs/snapshot/5dafbd5f-4792-4af7-a407-2bf3937fbf1e
422026-08-29T03:11:26.321ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
432026-08-29T03:11:26.321ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
442026-08-29T03:11:26.321ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::19
452026-08-29T03:11:26.321ZINFOcrucible-agent (worker): commit
462026-08-29T03:11:26.324ZINFOcrucible-agent (worker): ok!
472026-08-29T03:11:26.327ZINFOcrucible-agent (worker): SMF ok!
482026-08-29T03:11:26.327ZINFOcrucible-agent (datafile): region 674d9e07-956d-4cc2-929d-42f2923e8a71 running snapshot 5dafbd5f-4792-4af7-a407-2bf3937fbf1e state: Requested -> Created
492026-08-29T03:11:26.474ZINFOcrucible-agent (datafile): path is "/data/regions/674d9e07-956d-4cc2-929d-42f2923e8a71"
502026-08-29T03:11:26.480ZINFOcrucible-agent (datafile): dataset is oxp_2ed47044-f559-484e-88e9-4cfde0983351/crucible/regions/674d9e07-956d-4cc2-929d-42f2923e8a71
512026-08-29T03:11:26.488ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_2ed47044-f559-484e-88e9-4cfde0983351/crucible/regions/674d9e07-956d-4cc2-929d-42f2923e8a71@5dafbd5f-4792-4af7-a407-2bf3937fbf1e
522026-08-29T03:11:26.488ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_2ed47044-f559-484e-88e9-4cfde0983351/crucible/regions/674d9e07-956d-4cc2-929d-42f2923e8a71", "5dafbd5f-4792-4af7-a407-2bf3937fbf1e"]
532026-08-29T03:11:26.492ZINFOcrucible-agent (dropshot): request completed latency_us = 18476 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:58476 req_id = 9ae63b5e-6f52-4fb5-9301-b52ec99cf34a response_code = 200 uri = /crucible/0/regions/674d9e07-956d-4cc2-929d-42f2923e8a71/snapshots/5dafbd5f-4792-4af7-a407-2bf3937fbf1e/run