Max level shown:
12026-08-18T00:39:49.476ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::14]:32345 remote_addr = [fd00:1122:3344:101::c]:37232
22026-08-18T00:39:49.476ZINFOcrucible-agent (datafile): region 7ddfa6d9-e0af-4258-82b6-0c374b649bb8 state: Requested
32026-08-18T00:39:49.477ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42026-08-18T00:39:49.477ZINFOcrucible-agent (dropshot): request completed latency_us = 609 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:37232 req_id = fb191f58-7306-4bc4-b6a7-2671885ca1a1 response_code = 200 uri = /crucible/0/regions
52026-08-18T00:39:49.486ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_adb30117-5a4f-4853-a683-18b8e8b04756/crucible/regions/7ddfa6d9-e0af-4258-82b6-0c374b649bb8
62026-08-18T00:39:49.486ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_adb30117-5a4f-4853-a683-18b8e8b04756/crucible/regions/7ddfa6d9-e0af-4258-82b6-0c374b649bb8
72026-08-18T00:39:49.549ZINFOcrucible-agent (worker): creating region Region { id: RegionId("7ddfa6d9-e0af-4258-82b6-0c374b649bb8"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/7ddfa6d9-e0af-4258-82b6-0c374b649bb8" region = 7ddfa6d9-e0af-4258-82b6-0c374b649bb8
82026-08-18T00:39:49.549ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "7ddfa6d9-e0af-4258-82b6-0c374b649bb8" "--data" "/data/regions/7ddfa6d9-e0af-4258-82b6-0c374b649bb8" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 7ddfa6d9-e0af-4258-82b6-0c374b649bb8
92026-08-18T00:39:49.601ZINFOcrucible-agent (worker): region files created ok region = 7ddfa6d9-e0af-4258-82b6-0c374b649bb8
102026-08-18T00:39:49.601ZINFOcrucible-agent (datafile): region 7ddfa6d9-e0af-4258-82b6-0c374b649bb8 state: Requested -> Created
112026-08-18T00:39:49.601ZINFOcrucible-agent (worker): applying SMF actions post create...
122026-08-18T00:39:49.601ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-7ddfa6d9-e0af-4258-82b6-0c374b649bb8
132026-08-18T00:39:49.609ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-7ddfa6d9-e0af-4258-82b6-0c374b649bb8
142026-08-18T00:39:49.622ZINFOcrucible-agent (worker): creating config property group
152026-08-18T00:39:49.623ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-7ddfa6d9-e0af-4258-82b6-0c374b649bb8
162026-08-18T00:39:49.624ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/7ddfa6d9-e0af-4258-82b6-0c374b649bb8
172026-08-18T00:39:49.624ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
182026-08-18T00:39:49.624ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::14
192026-08-18T00:39:49.624ZINFOcrucible-agent (worker): commit
202026-08-18T00:39:49.626ZINFOcrucible-agent (worker): ok!
212026-08-18T00:39:49.630ZINFOcrucible-agent (worker): SMF ok!
222026-08-18T00:39:49.695ZINFOcrucible-agent (dropshot): request completed latency_us = 65 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:37232 req_id = a637ffbb-6e09-41c4-9452-05b4115a7531 response_code = 200 uri = /crucible/0/regions
232026-08-18T00:39:50.700ZINFOcrucible-agent (dropshot): request completed latency_us = 75 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:37232 req_id = 8d6dfb55-9d84-48b0-996b-ce429f403477 response_code = 200 uri = /crucible/0/regions/9cea1760-17b6-43b0-911a-84083af20b86
242026-08-18T00:39:50.706ZINFOcrucible-agent (datafile): path is "/data/regions/9cea1760-17b6-43b0-911a-84083af20b86"
252026-08-18T00:39:50.712ZINFOcrucible-agent (datafile): dataset is oxp_adb30117-5a4f-4853-a683-18b8e8b04756/crucible/regions/9cea1760-17b6-43b0-911a-84083af20b86
262026-08-18T00:39:50.718ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_adb30117-5a4f-4853-a683-18b8e8b04756/crucible/regions/9cea1760-17b6-43b0-911a-84083af20b86@0de4517e-cfcd-4d7d-8cba-f08d637c47e1
272026-08-18T00:39:50.718ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_adb30117-5a4f-4853-a683-18b8e8b04756/crucible/regions/9cea1760-17b6-43b0-911a-84083af20b86", "0de4517e-cfcd-4d7d-8cba-f08d637c47e1"]
282026-08-18T00:39:50.728ZINFOcrucible-agent (dropshot): request completed latency_us = 22093 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:37232 req_id = 44155925-8f26-45a9-a6b0-4fc9d9ce2300 response_code = 200 uri = /crucible/0/regions/9cea1760-17b6-43b0-911a-84083af20b86/snapshots/0de4517e-cfcd-4d7d-8cba-f08d637c47e1
292026-08-18T00:39:50.741ZINFOcrucible-agent (datafile): path is "/data/regions/9cea1760-17b6-43b0-911a-84083af20b86"
302026-08-18T00:39:50.748ZINFOcrucible-agent (datafile): dataset is oxp_adb30117-5a4f-4853-a683-18b8e8b04756/crucible/regions/9cea1760-17b6-43b0-911a-84083af20b86
312026-08-18T00:39:50.754ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_adb30117-5a4f-4853-a683-18b8e8b04756/crucible/regions/9cea1760-17b6-43b0-911a-84083af20b86@0de4517e-cfcd-4d7d-8cba-f08d637c47e1
322026-08-18T00:39:50.754ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_adb30117-5a4f-4853-a683-18b8e8b04756/crucible/regions/9cea1760-17b6-43b0-911a-84083af20b86", "0de4517e-cfcd-4d7d-8cba-f08d637c47e1"]
332026-08-18T00:39:50.762ZINFOcrucible-agent (datafile): requesting running snapshot 9cea1760-17b6-43b0-911a-84083af20b86-0de4517e-cfcd-4d7d-8cba-f08d637c47e1 state: Requested
342026-08-18T00:39:50.767ZINFOcrucible-agent (worker): applying SMF actions for region 9cea1760-17b6-43b0-911a-84083af20b86 running snapshot 0de4517e-cfcd-4d7d-8cba-f08d637c47e1 (state Requested)...
352026-08-18T00:39:50.767ZINFOcrucible-agent (dropshot): request completed latency_us = 26428 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:37232 req_id = ec18c369-7cba-4bbe-9242-fe0f5c96aa00 response_code = 200 uri = /crucible/0/regions/9cea1760-17b6-43b0-911a-84083af20b86/snapshots/0de4517e-cfcd-4d7d-8cba-f08d637c47e1/run
362026-08-18T00:39:50.769ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-9cea1760-17b6-43b0-911a-84083af20b86-0de4517e-cfcd-4d7d-8cba-f08d637c47e1
372026-08-18T00:39:50.779ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-9cea1760-17b6-43b0-911a-84083af20b86-0de4517e-cfcd-4d7d-8cba-f08d637c47e1
382026-08-18T00:39:50.784ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-9cea1760-17b6-43b0-911a-84083af20b86-0de4517e-cfcd-4d7d-8cba-f08d637c47e1
392026-08-18T00:39:50.784ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/9cea1760-17b6-43b0-911a-84083af20b86/.zfs/snapshot/0de4517e-cfcd-4d7d-8cba-f08d637c47e1
402026-08-18T00:39:50.784ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
412026-08-18T00:39:50.784ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
422026-08-18T00:39:50.784ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::14
432026-08-18T00:39:50.784ZINFOcrucible-agent (worker): commit
442026-08-18T00:39:50.786ZINFOcrucible-agent (worker): ok!
452026-08-18T00:39:50.789ZINFOcrucible-agent (worker): SMF ok!
462026-08-18T00:39:50.789ZINFOcrucible-agent (datafile): region 9cea1760-17b6-43b0-911a-84083af20b86 running snapshot 0de4517e-cfcd-4d7d-8cba-f08d637c47e1 state: Requested -> Created
472026-08-18T00:39:50.977ZINFOcrucible-agent (datafile): path is "/data/regions/9cea1760-17b6-43b0-911a-84083af20b86"
482026-08-18T00:39:50.984ZINFOcrucible-agent (datafile): dataset is oxp_adb30117-5a4f-4853-a683-18b8e8b04756/crucible/regions/9cea1760-17b6-43b0-911a-84083af20b86
492026-08-18T00:39:50.991ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_adb30117-5a4f-4853-a683-18b8e8b04756/crucible/regions/9cea1760-17b6-43b0-911a-84083af20b86@0de4517e-cfcd-4d7d-8cba-f08d637c47e1
502026-08-18T00:39:50.991ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_adb30117-5a4f-4853-a683-18b8e8b04756/crucible/regions/9cea1760-17b6-43b0-911a-84083af20b86", "0de4517e-cfcd-4d7d-8cba-f08d637c47e1"]
512026-08-18T00:39:50.997ZINFOcrucible-agent (dropshot): request completed latency_us = 20318 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:37232 req_id = 24772307-00c2-4db9-bf87-56919ac66b39 response_code = 200 uri = /crucible/0/regions/9cea1760-17b6-43b0-911a-84083af20b86/snapshots/0de4517e-cfcd-4d7d-8cba-f08d637c47e1/run