Max level shown:
12026-02-12T00:06:45.977ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::12]:32345 remote_addr = [fd00:1122:3344:101::a]:47829
22026-02-12T00:06:45.977ZINFOcrucible-agent (datafile): region 8f16df11-299a-459d-9f14-a67c66a502d0 state: Requested
32026-02-12T00:06:45.977ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42026-02-12T00:06:45.977ZINFOcrucible-agent (dropshot): request completed latency_us = 651 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:47829 req_id = 2ef2c823-0e4a-4634-ba49-acf946436408 response_code = 200 uri = /crucible/0/regions
52026-02-12T00:06:45.988ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_6094fcd4-6457-4d38-a31c-273eded758ee/crucible/regions/8f16df11-299a-459d-9f14-a67c66a502d0
62026-02-12T00:06:45.988ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_6094fcd4-6457-4d38-a31c-273eded758ee/crucible/regions/8f16df11-299a-459d-9f14-a67c66a502d0
72026-02-12T00:06:46.048ZINFOcrucible-agent (worker): creating region Region { id: RegionId("8f16df11-299a-459d-9f14-a67c66a502d0"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/8f16df11-299a-459d-9f14-a67c66a502d0" region = 8f16df11-299a-459d-9f14-a67c66a502d0
82026-02-12T00:06:46.048ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "8f16df11-299a-459d-9f14-a67c66a502d0" "--data" "/data/regions/8f16df11-299a-459d-9f14-a67c66a502d0" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 8f16df11-299a-459d-9f14-a67c66a502d0
92026-02-12T00:06:46.169ZINFOcrucible-agent (worker): region files created ok region = 8f16df11-299a-459d-9f14-a67c66a502d0
102026-02-12T00:06:46.169ZINFOcrucible-agent (datafile): region 8f16df11-299a-459d-9f14-a67c66a502d0 state: Requested -> Created
112026-02-12T00:06:46.169ZINFOcrucible-agent (worker): applying SMF actions post create...
122026-02-12T00:06:46.169ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-8f16df11-299a-459d-9f14-a67c66a502d0
132026-02-12T00:06:46.178ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-8f16df11-299a-459d-9f14-a67c66a502d0
142026-02-12T00:06:46.201ZINFOcrucible-agent (worker): creating config property group
152026-02-12T00:06:46.204ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-8f16df11-299a-459d-9f14-a67c66a502d0
162026-02-12T00:06:46.204ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/8f16df11-299a-459d-9f14-a67c66a502d0
172026-02-12T00:06:46.204ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
182026-02-12T00:06:46.204ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::12
192026-02-12T00:06:46.205ZINFOcrucible-agent (worker): commit
202026-02-12T00:06:46.208ZINFOcrucible-agent (worker): ok!
212026-02-12T00:06:46.222ZINFOcrucible-agent (worker): SMF ok!
222026-02-12T00:06:46.255ZINFOcrucible-agent (dropshot): request completed latency_us = 59 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:47829 req_id = e0d9e7e4-a859-4972-adfa-c98ccb7732c3 response_code = 200 uri = /crucible/0/regions
232026-02-12T00:06:47.924ZINFOcrucible-agent (dropshot): request completed latency_us = 69 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:47829 req_id = ef6dbaf3-7173-4f1c-87fd-6d9a63d0caa2 response_code = 200 uri = /crucible/0/regions/e86afada-273a-43f2-8b00-88c1e9cc5f32
242026-02-12T00:06:47.928ZINFOcrucible-agent (datafile): path is "/data/regions/e86afada-273a-43f2-8b00-88c1e9cc5f32"
252026-02-12T00:06:47.934ZINFOcrucible-agent (datafile): dataset is oxp_6094fcd4-6457-4d38-a31c-273eded758ee/crucible/regions/e86afada-273a-43f2-8b00-88c1e9cc5f32
262026-02-12T00:06:47.941ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_6094fcd4-6457-4d38-a31c-273eded758ee/crucible/regions/e86afada-273a-43f2-8b00-88c1e9cc5f32@82324d23-c515-483f-8186-04d7c6d1e880
272026-02-12T00:06:47.941ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_6094fcd4-6457-4d38-a31c-273eded758ee/crucible/regions/e86afada-273a-43f2-8b00-88c1e9cc5f32", "82324d23-c515-483f-8186-04d7c6d1e880"]
282026-02-12T00:06:47.949ZINFOcrucible-agent (dropshot): request completed latency_us = 21881 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:47829 req_id = 7070b00c-23e2-4b3f-afb1-7bd8c839388a response_code = 200 uri = /crucible/0/regions/e86afada-273a-43f2-8b00-88c1e9cc5f32/snapshots/82324d23-c515-483f-8186-04d7c6d1e880
292026-02-12T00:06:47.952ZINFOcrucible-agent (datafile): path is "/data/regions/e86afada-273a-43f2-8b00-88c1e9cc5f32"
302026-02-12T00:06:47.958ZINFOcrucible-agent (datafile): dataset is oxp_6094fcd4-6457-4d38-a31c-273eded758ee/crucible/regions/e86afada-273a-43f2-8b00-88c1e9cc5f32
312026-02-12T00:06:47.964ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_6094fcd4-6457-4d38-a31c-273eded758ee/crucible/regions/e86afada-273a-43f2-8b00-88c1e9cc5f32@82324d23-c515-483f-8186-04d7c6d1e880
322026-02-12T00:06:47.964ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_6094fcd4-6457-4d38-a31c-273eded758ee/crucible/regions/e86afada-273a-43f2-8b00-88c1e9cc5f32", "82324d23-c515-483f-8186-04d7c6d1e880"]
332026-02-12T00:06:47.971ZINFOcrucible-agent (datafile): requesting running snapshot e86afada-273a-43f2-8b00-88c1e9cc5f32-82324d23-c515-483f-8186-04d7c6d1e880 state: Requested
342026-02-12T00:06:47.972ZINFOcrucible-agent (dropshot): request completed latency_us = 19268 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:47829 req_id = 2a285526-c00b-44c3-910b-840781105ce5 response_code = 200 uri = /crucible/0/regions/e86afada-273a-43f2-8b00-88c1e9cc5f32/snapshots/82324d23-c515-483f-8186-04d7c6d1e880/run
352026-02-12T00:06:47.972ZINFOcrucible-agent (worker): applying SMF actions for region e86afada-273a-43f2-8b00-88c1e9cc5f32 running snapshot 82324d23-c515-483f-8186-04d7c6d1e880 (state Requested)...
362026-02-12T00:06:47.976ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-e86afada-273a-43f2-8b00-88c1e9cc5f32-82324d23-c515-483f-8186-04d7c6d1e880
372026-02-12T00:06:47.990ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-e86afada-273a-43f2-8b00-88c1e9cc5f32-82324d23-c515-483f-8186-04d7c6d1e880
382026-02-12T00:06:47.999ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-e86afada-273a-43f2-8b00-88c1e9cc5f32-82324d23-c515-483f-8186-04d7c6d1e880
392026-02-12T00:06:47.999ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/e86afada-273a-43f2-8b00-88c1e9cc5f32/.zfs/snapshot/82324d23-c515-483f-8186-04d7c6d1e880
402026-02-12T00:06:47.999ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
412026-02-12T00:06:48.000ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
422026-02-12T00:06:48.000ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::12
432026-02-12T00:06:48.000ZINFOcrucible-agent (worker): commit
442026-02-12T00:06:48.003ZINFOcrucible-agent (worker): ok!
452026-02-12T00:06:48.007ZINFOcrucible-agent (worker): SMF ok!
462026-02-12T00:06:48.007ZINFOcrucible-agent (datafile): region e86afada-273a-43f2-8b00-88c1e9cc5f32 running snapshot 82324d23-c515-483f-8186-04d7c6d1e880 state: Requested -> Created
472026-02-12T00:06:48.165ZINFOcrucible-agent (datafile): path is "/data/regions/e86afada-273a-43f2-8b00-88c1e9cc5f32"
482026-02-12T00:06:48.171ZINFOcrucible-agent (datafile): dataset is oxp_6094fcd4-6457-4d38-a31c-273eded758ee/crucible/regions/e86afada-273a-43f2-8b00-88c1e9cc5f32
492026-02-12T00:06:48.177ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_6094fcd4-6457-4d38-a31c-273eded758ee/crucible/regions/e86afada-273a-43f2-8b00-88c1e9cc5f32@82324d23-c515-483f-8186-04d7c6d1e880
502026-02-12T00:06:48.177ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_6094fcd4-6457-4d38-a31c-273eded758ee/crucible/regions/e86afada-273a-43f2-8b00-88c1e9cc5f32", "82324d23-c515-483f-8186-04d7c6d1e880"]
512026-02-12T00:06:48.183ZINFOcrucible-agent (dropshot): request completed latency_us = 18291 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:47829 req_id = 82b87c0f-1a07-4b00-a7d7-eea31433e768 response_code = 200 uri = /crucible/0/regions/e86afada-273a-43f2-8b00-88c1e9cc5f32/snapshots/82324d23-c515-483f-8186-04d7c6d1e880/run