Max level shown:
12026-09-04T16:05:34.516ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::17]:32345 remote_addr = [fd00:1122:3344:101::a]:53627
22026-09-04T16:05:34.516ZINFOcrucible-agent (datafile): region 50622f68-66eb-44a2-b661-972d6cf8420f state: Requested
32026-09-04T16:05:34.517ZINFOcrucible-agent (dropshot): request completed latency_us = 695 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:53627 req_id = 191f50af-d808-479d-861b-3e936c25352b response_code = 200 uri = /crucible/0/regions
42026-09-04T16:05:34.517ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
52026-09-04T16:05:34.525ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_deb1cc78-b7a1-4c52-93bf-c285c1e29931/crucible/regions/50622f68-66eb-44a2-b661-972d6cf8420f
62026-09-04T16:05:34.525ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_deb1cc78-b7a1-4c52-93bf-c285c1e29931/crucible/regions/50622f68-66eb-44a2-b661-972d6cf8420f
72026-09-04T16:05:34.581ZINFOcrucible-agent (worker): creating region Region { id: RegionId("50622f68-66eb-44a2-b661-972d6cf8420f"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/50622f68-66eb-44a2-b661-972d6cf8420f" region = 50622f68-66eb-44a2-b661-972d6cf8420f
82026-09-04T16:05:34.581ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "50622f68-66eb-44a2-b661-972d6cf8420f" "--data" "/data/regions/50622f68-66eb-44a2-b661-972d6cf8420f" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 50622f68-66eb-44a2-b661-972d6cf8420f
92026-09-04T16:05:34.682ZINFOcrucible-agent (dropshot): request completed latency_us = 57 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:53627 req_id = 497c3cf4-2eb6-47a7-9567-1783f2ed64c2 response_code = 200 uri = /crucible/0/regions
102026-09-04T16:05:34.694ZINFOcrucible-agent (worker): region files created ok region = 50622f68-66eb-44a2-b661-972d6cf8420f
112026-09-04T16:05:34.694ZINFOcrucible-agent (datafile): region 50622f68-66eb-44a2-b661-972d6cf8420f state: Requested -> Created
122026-09-04T16:05:34.694ZINFOcrucible-agent (worker): applying SMF actions post create...
132026-09-04T16:05:34.703ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-50622f68-66eb-44a2-b661-972d6cf8420f
142026-09-04T16:05:34.709ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-50622f68-66eb-44a2-b661-972d6cf8420f
152026-09-04T16:05:34.725ZINFOcrucible-agent (worker): creating config property group
162026-09-04T16:05:34.734ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-50622f68-66eb-44a2-b661-972d6cf8420f
172026-09-04T16:05:34.735ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/50622f68-66eb-44a2-b661-972d6cf8420f
182026-09-04T16:05:34.735ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
192026-09-04T16:05:34.735ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::17
202026-09-04T16:05:34.735ZINFOcrucible-agent (worker): commit
212026-09-04T16:05:34.741ZINFOcrucible-agent (worker): ok!
222026-09-04T16:05:34.750ZINFOcrucible-agent (worker): SMF ok!
232026-09-04T16:05:35.247ZINFOcrucible-agent (dropshot): request completed latency_us = 57 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:53627 req_id = d2d97bea-8097-4f96-8edd-a1c45a24cab0 response_code = 200 uri = /crucible/0/regions
242026-09-04T16:05:36.260ZINFOcrucible-agent (dropshot): request completed latency_us = 69 local_addr = [fd00:1122:3344:101::17]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:53627 req_id = 84e36e62-b46d-4d44-9317-a0484e861cab response_code = 200 uri = /crucible/0/regions/14051634-957a-47f7-a176-9b77a291405e
252026-09-04T16:05:36.264ZINFOcrucible-agent (datafile): path is "/data/regions/14051634-957a-47f7-a176-9b77a291405e"
262026-09-04T16:05:36.270ZINFOcrucible-agent (datafile): dataset is oxp_deb1cc78-b7a1-4c52-93bf-c285c1e29931/crucible/regions/14051634-957a-47f7-a176-9b77a291405e
272026-09-04T16:05:36.276ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_deb1cc78-b7a1-4c52-93bf-c285c1e29931/crucible/regions/14051634-957a-47f7-a176-9b77a291405e@1d550e20-d99d-4434-bc59-da3caaad2b0c
282026-09-04T16:05:36.276ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_deb1cc78-b7a1-4c52-93bf-c285c1e29931/crucible/regions/14051634-957a-47f7-a176-9b77a291405e", "1d550e20-d99d-4434-bc59-da3caaad2b0c"]
292026-09-04T16:05:36.286ZINFOcrucible-agent (dropshot): request completed latency_us = 21824 local_addr = [fd00:1122:3344:101::17]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:53627 req_id = a88b4e68-5f0a-4a38-a1ae-75891ed88d60 response_code = 200 uri = /crucible/0/regions/14051634-957a-47f7-a176-9b77a291405e/snapshots/1d550e20-d99d-4434-bc59-da3caaad2b0c
302026-09-04T16:05:36.289ZINFOcrucible-agent (datafile): path is "/data/regions/14051634-957a-47f7-a176-9b77a291405e"
312026-09-04T16:05:36.296ZINFOcrucible-agent (datafile): dataset is oxp_deb1cc78-b7a1-4c52-93bf-c285c1e29931/crucible/regions/14051634-957a-47f7-a176-9b77a291405e
322026-09-04T16:05:36.301ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_deb1cc78-b7a1-4c52-93bf-c285c1e29931/crucible/regions/14051634-957a-47f7-a176-9b77a291405e@1d550e20-d99d-4434-bc59-da3caaad2b0c
332026-09-04T16:05:36.301ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_deb1cc78-b7a1-4c52-93bf-c285c1e29931/crucible/regions/14051634-957a-47f7-a176-9b77a291405e", "1d550e20-d99d-4434-bc59-da3caaad2b0c"]
342026-09-04T16:05:36.307ZINFOcrucible-agent (datafile): requesting running snapshot 14051634-957a-47f7-a176-9b77a291405e-1d550e20-d99d-4434-bc59-da3caaad2b0c state: Requested
352026-09-04T16:05:36.312ZINFOcrucible-agent (dropshot): request completed latency_us = 22856 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:53627 req_id = 436fc58f-253a-4a02-972b-1aec0ef7537e response_code = 200 uri = /crucible/0/regions/14051634-957a-47f7-a176-9b77a291405e/snapshots/1d550e20-d99d-4434-bc59-da3caaad2b0c/run
362026-09-04T16:05:36.312ZINFOcrucible-agent (worker): applying SMF actions for region 14051634-957a-47f7-a176-9b77a291405e running snapshot 1d550e20-d99d-4434-bc59-da3caaad2b0c (state Requested)...
372026-09-04T16:05:36.314ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-14051634-957a-47f7-a176-9b77a291405e-1d550e20-d99d-4434-bc59-da3caaad2b0c
382026-09-04T16:05:36.325ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-14051634-957a-47f7-a176-9b77a291405e-1d550e20-d99d-4434-bc59-da3caaad2b0c
392026-09-04T16:05:36.335ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-14051634-957a-47f7-a176-9b77a291405e-1d550e20-d99d-4434-bc59-da3caaad2b0c
402026-09-04T16:05:36.335ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/14051634-957a-47f7-a176-9b77a291405e/.zfs/snapshot/1d550e20-d99d-4434-bc59-da3caaad2b0c
412026-09-04T16:05:36.335ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
422026-09-04T16:05:36.335ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
432026-09-04T16:05:36.335ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::17
442026-09-04T16:05:36.335ZINFOcrucible-agent (worker): commit
452026-09-04T16:05:36.338ZINFOcrucible-agent (worker): ok!
462026-09-04T16:05:36.343ZINFOcrucible-agent (worker): SMF ok!
472026-09-04T16:05:36.343ZINFOcrucible-agent (datafile): region 14051634-957a-47f7-a176-9b77a291405e running snapshot 1d550e20-d99d-4434-bc59-da3caaad2b0c state: Requested -> Created
482026-09-04T16:05:36.627ZINFOcrucible-agent (datafile): path is "/data/regions/14051634-957a-47f7-a176-9b77a291405e"
492026-09-04T16:05:36.633ZINFOcrucible-agent (datafile): dataset is oxp_deb1cc78-b7a1-4c52-93bf-c285c1e29931/crucible/regions/14051634-957a-47f7-a176-9b77a291405e
502026-09-04T16:05:36.638ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_deb1cc78-b7a1-4c52-93bf-c285c1e29931/crucible/regions/14051634-957a-47f7-a176-9b77a291405e@1d550e20-d99d-4434-bc59-da3caaad2b0c
512026-09-04T16:05:36.638ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_deb1cc78-b7a1-4c52-93bf-c285c1e29931/crucible/regions/14051634-957a-47f7-a176-9b77a291405e", "1d550e20-d99d-4434-bc59-da3caaad2b0c"]
522026-09-04T16:05:36.644ZINFOcrucible-agent (dropshot): request completed latency_us = 17147 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:53627 req_id = d7841bde-8316-4224-98fa-03536981b6d7 response_code = 200 uri = /crucible/0/regions/14051634-957a-47f7-a176-9b77a291405e/snapshots/1d550e20-d99d-4434-bc59-da3caaad2b0c/run