Max level shown:
12026-05-07T18:22:18.677ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::17]:32345 remote_addr = [fd00:1122:3344:101::a]:40457
22026-05-07T18:22:18.677ZINFOcrucible-agent (datafile): region 3584fd55-6f8c-4338-8878-e3a0bdeb7bfe state: Requested
32026-05-07T18:22:18.678ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42026-05-07T18:22:18.678ZINFOcrucible-agent (dropshot): request completed latency_us = 1040 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:40457 req_id = 4a76c9bc-d432-4607-9624-422d58e90bc5 response_code = 200 uri = /crucible/0/regions
52026-05-07T18:22:18.691ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_abfcc492-9474-4ae2-867a-c39882accc7b/crucible/regions/3584fd55-6f8c-4338-8878-e3a0bdeb7bfe
62026-05-07T18:22:18.691ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_abfcc492-9474-4ae2-867a-c39882accc7b/crucible/regions/3584fd55-6f8c-4338-8878-e3a0bdeb7bfe
72026-05-07T18:22:18.761ZINFOcrucible-agent (worker): creating region Region { id: RegionId("3584fd55-6f8c-4338-8878-e3a0bdeb7bfe"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/3584fd55-6f8c-4338-8878-e3a0bdeb7bfe" region = 3584fd55-6f8c-4338-8878-e3a0bdeb7bfe
82026-05-07T18:22:18.761ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "3584fd55-6f8c-4338-8878-e3a0bdeb7bfe" "--data" "/data/regions/3584fd55-6f8c-4338-8878-e3a0bdeb7bfe" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 3584fd55-6f8c-4338-8878-e3a0bdeb7bfe
92026-05-07T18:22:18.904ZINFOcrucible-agent (worker): region files created ok region = 3584fd55-6f8c-4338-8878-e3a0bdeb7bfe
102026-05-07T18:22:18.904ZINFOcrucible-agent (datafile): region 3584fd55-6f8c-4338-8878-e3a0bdeb7bfe state: Requested -> Created
112026-05-07T18:22:18.905ZINFOcrucible-agent (worker): applying SMF actions post create...
122026-05-07T18:22:18.905ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-3584fd55-6f8c-4338-8878-e3a0bdeb7bfe
132026-05-07T18:22:18.921ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-3584fd55-6f8c-4338-8878-e3a0bdeb7bfe
142026-05-07T18:22:18.952ZINFOcrucible-agent (worker): creating config property group
152026-05-07T18:22:18.958ZINFOcrucible-agent (dropshot): request completed latency_us = 57 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:40457 req_id = eb42adbf-487f-4e5f-8daa-35a46ddc31ee response_code = 200 uri = /crucible/0/regions
162026-05-07T18:22:18.959ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-3584fd55-6f8c-4338-8878-e3a0bdeb7bfe
172026-05-07T18:22:18.959ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/3584fd55-6f8c-4338-8878-e3a0bdeb7bfe
182026-05-07T18:22:18.959ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
192026-05-07T18:22:18.959ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::17
202026-05-07T18:22:18.959ZINFOcrucible-agent (worker): commit
212026-05-07T18:22:18.967ZINFOcrucible-agent (worker): ok!
222026-05-07T18:22:18.991ZINFOcrucible-agent (worker): SMF ok!
232026-05-07T18:22:20.725ZINFOcrucible-agent (dropshot): request completed latency_us = 81 local_addr = [fd00:1122:3344:101::17]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:40457 req_id = 5c5479e4-c5f4-4268-b5df-a5aff1c02357 response_code = 200 uri = /crucible/0/regions/a88a8e03-f451-49f6-a6ff-de67264c937f
242026-05-07T18:22:20.728ZINFOcrucible-agent (datafile): path is "/data/regions/a88a8e03-f451-49f6-a6ff-de67264c937f"
252026-05-07T18:22:20.735ZINFOcrucible-agent (datafile): dataset is oxp_abfcc492-9474-4ae2-867a-c39882accc7b/crucible/regions/a88a8e03-f451-49f6-a6ff-de67264c937f
262026-05-07T18:22:20.741ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_abfcc492-9474-4ae2-867a-c39882accc7b/crucible/regions/a88a8e03-f451-49f6-a6ff-de67264c937f@b9c82390-f651-4d90-98a8-66c56454333a
272026-05-07T18:22:20.741ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_abfcc492-9474-4ae2-867a-c39882accc7b/crucible/regions/a88a8e03-f451-49f6-a6ff-de67264c937f", "b9c82390-f651-4d90-98a8-66c56454333a"]
282026-05-07T18:22:20.750ZINFOcrucible-agent (dropshot): request completed latency_us = 21352 local_addr = [fd00:1122:3344:101::17]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:40457 req_id = 40784821-9ecd-40c6-863e-21dbd6eb37ab response_code = 200 uri = /crucible/0/regions/a88a8e03-f451-49f6-a6ff-de67264c937f/snapshots/b9c82390-f651-4d90-98a8-66c56454333a
292026-05-07T18:22:20.754ZINFOcrucible-agent (datafile): path is "/data/regions/a88a8e03-f451-49f6-a6ff-de67264c937f"
302026-05-07T18:22:20.761ZINFOcrucible-agent (datafile): dataset is oxp_abfcc492-9474-4ae2-867a-c39882accc7b/crucible/regions/a88a8e03-f451-49f6-a6ff-de67264c937f
312026-05-07T18:22:20.767ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_abfcc492-9474-4ae2-867a-c39882accc7b/crucible/regions/a88a8e03-f451-49f6-a6ff-de67264c937f@b9c82390-f651-4d90-98a8-66c56454333a
322026-05-07T18:22:20.767ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_abfcc492-9474-4ae2-867a-c39882accc7b/crucible/regions/a88a8e03-f451-49f6-a6ff-de67264c937f", "b9c82390-f651-4d90-98a8-66c56454333a"]
332026-05-07T18:22:20.775ZINFOcrucible-agent (datafile): requesting running snapshot a88a8e03-f451-49f6-a6ff-de67264c937f-b9c82390-f651-4d90-98a8-66c56454333a state: Requested
342026-05-07T18:22:20.775ZINFOcrucible-agent (worker): applying SMF actions for region a88a8e03-f451-49f6-a6ff-de67264c937f running snapshot b9c82390-f651-4d90-98a8-66c56454333a (state Requested)...
352026-05-07T18:22:20.775ZINFOcrucible-agent (dropshot): request completed latency_us = 21092 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:40457 req_id = 8ab5f461-5011-4e11-ac74-4bab6cf6fa04 response_code = 200 uri = /crucible/0/regions/a88a8e03-f451-49f6-a6ff-de67264c937f/snapshots/b9c82390-f651-4d90-98a8-66c56454333a/run
362026-05-07T18:22:20.779ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-a88a8e03-f451-49f6-a6ff-de67264c937f-b9c82390-f651-4d90-98a8-66c56454333a
372026-05-07T18:22:20.785ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-a88a8e03-f451-49f6-a6ff-de67264c937f-b9c82390-f651-4d90-98a8-66c56454333a
382026-05-07T18:22:20.795ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-a88a8e03-f451-49f6-a6ff-de67264c937f-b9c82390-f651-4d90-98a8-66c56454333a
392026-05-07T18:22:20.795ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/a88a8e03-f451-49f6-a6ff-de67264c937f/.zfs/snapshot/b9c82390-f651-4d90-98a8-66c56454333a
402026-05-07T18:22:20.795ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
412026-05-07T18:22:20.795ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
422026-05-07T18:22:20.795ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::17
432026-05-07T18:22:20.795ZINFOcrucible-agent (worker): commit
442026-05-07T18:22:20.799ZINFOcrucible-agent (worker): ok!
452026-05-07T18:22:20.803ZINFOcrucible-agent (worker): SMF ok!
462026-05-07T18:22:20.803ZINFOcrucible-agent (datafile): region a88a8e03-f451-49f6-a6ff-de67264c937f running snapshot b9c82390-f651-4d90-98a8-66c56454333a state: Requested -> Created
472026-05-07T18:22:20.954ZINFOcrucible-agent (datafile): path is "/data/regions/a88a8e03-f451-49f6-a6ff-de67264c937f"
482026-05-07T18:22:20.960ZINFOcrucible-agent (datafile): dataset is oxp_abfcc492-9474-4ae2-867a-c39882accc7b/crucible/regions/a88a8e03-f451-49f6-a6ff-de67264c937f
492026-05-07T18:22:20.966ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_abfcc492-9474-4ae2-867a-c39882accc7b/crucible/regions/a88a8e03-f451-49f6-a6ff-de67264c937f@b9c82390-f651-4d90-98a8-66c56454333a
502026-05-07T18:22:20.966ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_abfcc492-9474-4ae2-867a-c39882accc7b/crucible/regions/a88a8e03-f451-49f6-a6ff-de67264c937f", "b9c82390-f651-4d90-98a8-66c56454333a"]
512026-05-07T18:22:20.972ZINFOcrucible-agent (dropshot): request completed latency_us = 17620 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:40457 req_id = e8e3eac4-5b4a-4207-9b0d-40a43b4b42b7 response_code = 200 uri = /crucible/0/regions/a88a8e03-f451-49f6-a6ff-de67264c937f/snapshots/b9c82390-f651-4d90-98a8-66c56454333a/run