Max level shown:
12026-08-22T04:10:49.151ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::15]:32345 remote_addr = [fd00:1122:3344:101::c]:43118
22026-08-22T04:10:49.151ZINFOcrucible-agent (datafile): region 4a17abd0-ab2b-46d6-962a-5e226da95f46 state: Requested
32026-08-22T04:10:49.152ZINFOcrucible-agent (dropshot): request completed latency_us = 725 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:43118 req_id = 420493ea-e181-421f-906f-8c47de42d5f0 response_code = 200 uri = /crucible/0/regions
42026-08-22T04:10:49.152ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
52026-08-22T04:10:49.160ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_79b45c3e-1ccb-4563-b916-a28428ffdc2d/crucible/regions/4a17abd0-ab2b-46d6-962a-5e226da95f46
62026-08-22T04:10:49.160ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_79b45c3e-1ccb-4563-b916-a28428ffdc2d/crucible/regions/4a17abd0-ab2b-46d6-962a-5e226da95f46
72026-08-22T04:10:49.221ZINFOcrucible-agent (worker): creating region Region { id: RegionId("4a17abd0-ab2b-46d6-962a-5e226da95f46"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/4a17abd0-ab2b-46d6-962a-5e226da95f46" region = 4a17abd0-ab2b-46d6-962a-5e226da95f46
82026-08-22T04:10:49.221ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "4a17abd0-ab2b-46d6-962a-5e226da95f46" "--data" "/data/regions/4a17abd0-ab2b-46d6-962a-5e226da95f46" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 4a17abd0-ab2b-46d6-962a-5e226da95f46
92026-08-22T04:10:49.305ZINFOcrucible-agent (worker): region files created ok region = 4a17abd0-ab2b-46d6-962a-5e226da95f46
102026-08-22T04:10:49.305ZINFOcrucible-agent (datafile): region 4a17abd0-ab2b-46d6-962a-5e226da95f46 state: Requested -> Created
112026-08-22T04:10:49.305ZINFOcrucible-agent (worker): applying SMF actions post create...
122026-08-22T04:10:49.306ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-4a17abd0-ab2b-46d6-962a-5e226da95f46
132026-08-22T04:10:49.312ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-4a17abd0-ab2b-46d6-962a-5e226da95f46
142026-08-22T04:10:49.328ZINFOcrucible-agent (worker): creating config property group
152026-08-22T04:10:49.332ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-4a17abd0-ab2b-46d6-962a-5e226da95f46
162026-08-22T04:10:49.332ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/4a17abd0-ab2b-46d6-962a-5e226da95f46
172026-08-22T04:10:49.332ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
182026-08-22T04:10:49.332ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::15
192026-08-22T04:10:49.332ZINFOcrucible-agent (worker): commit
202026-08-22T04:10:49.336ZINFOcrucible-agent (worker): ok!
212026-08-22T04:10:49.342ZINFOcrucible-agent (worker): SMF ok!
222026-08-22T04:10:49.369ZINFOcrucible-agent (dropshot): request completed latency_us = 52 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:43118 req_id = 9c298075-725d-4bae-afdd-e59ae12ae722 response_code = 200 uri = /crucible/0/regions
232026-08-22T04:10:51.329ZINFOcrucible-agent (dropshot): request completed latency_us = 69 local_addr = [fd00:1122:3344:101::15]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:43118 req_id = 251434c6-4e55-4b89-8e9d-89bb735c1f5b response_code = 200 uri = /crucible/0/regions/7805c759-e7c6-4616-b499-4cea8b9adb2a
242026-08-22T04:10:51.332ZINFOcrucible-agent (datafile): path is "/data/regions/7805c759-e7c6-4616-b499-4cea8b9adb2a"
252026-08-22T04:10:51.338ZINFOcrucible-agent (datafile): dataset is oxp_79b45c3e-1ccb-4563-b916-a28428ffdc2d/crucible/regions/7805c759-e7c6-4616-b499-4cea8b9adb2a
262026-08-22T04:10:51.343ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_79b45c3e-1ccb-4563-b916-a28428ffdc2d/crucible/regions/7805c759-e7c6-4616-b499-4cea8b9adb2a@a9cfb181-e7f5-4437-866e-36d1550cdf72
272026-08-22T04:10:51.343ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_79b45c3e-1ccb-4563-b916-a28428ffdc2d/crucible/regions/7805c759-e7c6-4616-b499-4cea8b9adb2a", "a9cfb181-e7f5-4437-866e-36d1550cdf72"]
282026-08-22T04:10:51.354ZINFOcrucible-agent (dropshot): request completed latency_us = 21475 local_addr = [fd00:1122:3344:101::15]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:43118 req_id = 3becfec7-deb8-4ff7-b0b8-18a75e00822e response_code = 200 uri = /crucible/0/regions/7805c759-e7c6-4616-b499-4cea8b9adb2a/snapshots/a9cfb181-e7f5-4437-866e-36d1550cdf72
292026-08-22T04:10:51.358ZINFOcrucible-agent (datafile): path is "/data/regions/7805c759-e7c6-4616-b499-4cea8b9adb2a"
302026-08-22T04:10:51.364ZINFOcrucible-agent (datafile): dataset is oxp_79b45c3e-1ccb-4563-b916-a28428ffdc2d/crucible/regions/7805c759-e7c6-4616-b499-4cea8b9adb2a
312026-08-22T04:10:51.370ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_79b45c3e-1ccb-4563-b916-a28428ffdc2d/crucible/regions/7805c759-e7c6-4616-b499-4cea8b9adb2a@a9cfb181-e7f5-4437-866e-36d1550cdf72
322026-08-22T04:10:51.370ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_79b45c3e-1ccb-4563-b916-a28428ffdc2d/crucible/regions/7805c759-e7c6-4616-b499-4cea8b9adb2a", "a9cfb181-e7f5-4437-866e-36d1550cdf72"]
332026-08-22T04:10:51.377ZINFOcrucible-agent (datafile): requesting running snapshot 7805c759-e7c6-4616-b499-4cea8b9adb2a-a9cfb181-e7f5-4437-866e-36d1550cdf72 state: Requested
342026-08-22T04:10:51.382ZINFOcrucible-agent (worker): applying SMF actions for region 7805c759-e7c6-4616-b499-4cea8b9adb2a running snapshot a9cfb181-e7f5-4437-866e-36d1550cdf72 (state Requested)...
352026-08-22T04:10:51.382ZINFOcrucible-agent (dropshot): request completed latency_us = 24667 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:43118 req_id = 445a2d92-fab1-49f3-8303-3806e234f368 response_code = 200 uri = /crucible/0/regions/7805c759-e7c6-4616-b499-4cea8b9adb2a/snapshots/a9cfb181-e7f5-4437-866e-36d1550cdf72/run
362026-08-22T04:10:51.384ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-7805c759-e7c6-4616-b499-4cea8b9adb2a-a9cfb181-e7f5-4437-866e-36d1550cdf72
372026-08-22T04:10:51.394ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-7805c759-e7c6-4616-b499-4cea8b9adb2a-a9cfb181-e7f5-4437-866e-36d1550cdf72
382026-08-22T04:10:51.405ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-7805c759-e7c6-4616-b499-4cea8b9adb2a-a9cfb181-e7f5-4437-866e-36d1550cdf72
392026-08-22T04:10:51.405ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/7805c759-e7c6-4616-b499-4cea8b9adb2a/.zfs/snapshot/a9cfb181-e7f5-4437-866e-36d1550cdf72
402026-08-22T04:10:51.405ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
412026-08-22T04:10:51.406ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
422026-08-22T04:10:51.406ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::15
432026-08-22T04:10:51.406ZINFOcrucible-agent (worker): commit
442026-08-22T04:10:51.409ZINFOcrucible-agent (worker): ok!
452026-08-22T04:10:51.414ZINFOcrucible-agent (worker): SMF ok!
462026-08-22T04:10:51.414ZINFOcrucible-agent (datafile): region 7805c759-e7c6-4616-b499-4cea8b9adb2a running snapshot a9cfb181-e7f5-4437-866e-36d1550cdf72 state: Requested -> Created
472026-08-22T04:10:51.621ZINFOcrucible-agent (datafile): path is "/data/regions/7805c759-e7c6-4616-b499-4cea8b9adb2a"
482026-08-22T04:10:51.628ZINFOcrucible-agent (datafile): dataset is oxp_79b45c3e-1ccb-4563-b916-a28428ffdc2d/crucible/regions/7805c759-e7c6-4616-b499-4cea8b9adb2a
492026-08-22T04:10:51.636ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_79b45c3e-1ccb-4563-b916-a28428ffdc2d/crucible/regions/7805c759-e7c6-4616-b499-4cea8b9adb2a@a9cfb181-e7f5-4437-866e-36d1550cdf72
502026-08-22T04:10:51.636ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_79b45c3e-1ccb-4563-b916-a28428ffdc2d/crucible/regions/7805c759-e7c6-4616-b499-4cea8b9adb2a", "a9cfb181-e7f5-4437-866e-36d1550cdf72"]
512026-08-22T04:10:51.641ZINFOcrucible-agent (dropshot): request completed latency_us = 19605 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:43118 req_id = cd6d8315-9892-4cc0-9156-43a2d64e03b8 response_code = 200 uri = /crucible/0/regions/7805c759-e7c6-4616-b499-4cea8b9adb2a/snapshots/a9cfb181-e7f5-4437-866e-36d1550cdf72/run