Max level shown:
12026-04-29T22:30:25.828ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::12]:32345 remote_addr = [fd00:1122:3344:101::b]:48233
22026-04-29T22:30:25.828ZINFOcrucible-agent (datafile): region 28745bb0-6c1c-4924-8ec7-a97c87eefbf0 state: Requested
32026-04-29T22:30:25.829ZINFOcrucible-agent (dropshot): request completed latency_us = 736 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:48233 req_id = cf231bfc-251e-4f3b-81bb-e0755177bdc4 response_code = 200 uri = /crucible/0/regions
42026-04-29T22:30:25.829ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
52026-04-29T22:30:25.838ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_de4b783c-1d39-4a03-a050-1f76af72f1d2/crucible/regions/28745bb0-6c1c-4924-8ec7-a97c87eefbf0
62026-04-29T22:30:25.838ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_de4b783c-1d39-4a03-a050-1f76af72f1d2/crucible/regions/28745bb0-6c1c-4924-8ec7-a97c87eefbf0
72026-04-29T22:30:25.889ZINFOcrucible-agent (worker): creating region Region { id: RegionId("28745bb0-6c1c-4924-8ec7-a97c87eefbf0"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/28745bb0-6c1c-4924-8ec7-a97c87eefbf0" region = 28745bb0-6c1c-4924-8ec7-a97c87eefbf0
82026-04-29T22:30:25.889ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "28745bb0-6c1c-4924-8ec7-a97c87eefbf0" "--data" "/data/regions/28745bb0-6c1c-4924-8ec7-a97c87eefbf0" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 28745bb0-6c1c-4924-8ec7-a97c87eefbf0
92026-04-29T22:30:25.963ZINFOcrucible-agent (worker): region files created ok region = 28745bb0-6c1c-4924-8ec7-a97c87eefbf0
102026-04-29T22:30:25.963ZINFOcrucible-agent (datafile): region 28745bb0-6c1c-4924-8ec7-a97c87eefbf0 state: Requested -> Created
112026-04-29T22:30:25.963ZINFOcrucible-agent (worker): applying SMF actions post create...
122026-04-29T22:30:25.964ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-28745bb0-6c1c-4924-8ec7-a97c87eefbf0
132026-04-29T22:30:25.972ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-28745bb0-6c1c-4924-8ec7-a97c87eefbf0
142026-04-29T22:30:25.983ZINFOcrucible-agent (dropshot): request completed latency_us = 57 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:48233 req_id = 941428ce-8474-48e3-a881-f754a06c7abc response_code = 200 uri = /crucible/0/regions
152026-04-29T22:30:25.993ZINFOcrucible-agent (worker): creating config property group
162026-04-29T22:30:25.996ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-28745bb0-6c1c-4924-8ec7-a97c87eefbf0
172026-04-29T22:30:25.996ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/28745bb0-6c1c-4924-8ec7-a97c87eefbf0
182026-04-29T22:30:25.997ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
192026-04-29T22:30:25.997ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::12
202026-04-29T22:30:25.997ZINFOcrucible-agent (worker): commit
212026-04-29T22:30:26.000ZINFOcrucible-agent (worker): ok!
222026-04-29T22:30:26.017ZINFOcrucible-agent (worker): SMF ok!
232026-04-29T22:30:27.384ZINFOcrucible-agent (dropshot): request completed latency_us = 67 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:48233 req_id = f88eceab-3c22-486a-ac89-f26dcda5c25b response_code = 200 uri = /crucible/0/regions/60630fc8-6cc2-4972-a3a9-3107ba6eb861
242026-04-29T22:30:27.387ZINFOcrucible-agent (datafile): path is "/data/regions/60630fc8-6cc2-4972-a3a9-3107ba6eb861"
252026-04-29T22:30:27.394ZINFOcrucible-agent (datafile): dataset is oxp_de4b783c-1d39-4a03-a050-1f76af72f1d2/crucible/regions/60630fc8-6cc2-4972-a3a9-3107ba6eb861
262026-04-29T22:30:27.400ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_de4b783c-1d39-4a03-a050-1f76af72f1d2/crucible/regions/60630fc8-6cc2-4972-a3a9-3107ba6eb861@c9ed9b9f-1a12-400c-b29c-fc97ac6e53bf
272026-04-29T22:30:27.400ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_de4b783c-1d39-4a03-a050-1f76af72f1d2/crucible/regions/60630fc8-6cc2-4972-a3a9-3107ba6eb861", "c9ed9b9f-1a12-400c-b29c-fc97ac6e53bf"]
282026-04-29T22:30:27.409ZINFOcrucible-agent (dropshot): request completed latency_us = 21969 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:48233 req_id = 63c0f3dd-4943-47c4-bdc4-8109a1dd73cd response_code = 200 uri = /crucible/0/regions/60630fc8-6cc2-4972-a3a9-3107ba6eb861/snapshots/c9ed9b9f-1a12-400c-b29c-fc97ac6e53bf
292026-04-29T22:30:27.413ZINFOcrucible-agent (datafile): path is "/data/regions/60630fc8-6cc2-4972-a3a9-3107ba6eb861"
302026-04-29T22:30:27.418ZINFOcrucible-agent (datafile): dataset is oxp_de4b783c-1d39-4a03-a050-1f76af72f1d2/crucible/regions/60630fc8-6cc2-4972-a3a9-3107ba6eb861
312026-04-29T22:30:27.425ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_de4b783c-1d39-4a03-a050-1f76af72f1d2/crucible/regions/60630fc8-6cc2-4972-a3a9-3107ba6eb861@c9ed9b9f-1a12-400c-b29c-fc97ac6e53bf
322026-04-29T22:30:27.425ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_de4b783c-1d39-4a03-a050-1f76af72f1d2/crucible/regions/60630fc8-6cc2-4972-a3a9-3107ba6eb861", "c9ed9b9f-1a12-400c-b29c-fc97ac6e53bf"]
332026-04-29T22:30:27.432ZINFOcrucible-agent (datafile): requesting running snapshot 60630fc8-6cc2-4972-a3a9-3107ba6eb861-c9ed9b9f-1a12-400c-b29c-fc97ac6e53bf state: Requested
342026-04-29T22:30:27.432ZINFOcrucible-agent (dropshot): request completed latency_us = 19116 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:48233 req_id = a8145364-063f-4278-968e-662e23dd73f9 response_code = 200 uri = /crucible/0/regions/60630fc8-6cc2-4972-a3a9-3107ba6eb861/snapshots/c9ed9b9f-1a12-400c-b29c-fc97ac6e53bf/run
352026-04-29T22:30:27.432ZINFOcrucible-agent (worker): applying SMF actions for region 60630fc8-6cc2-4972-a3a9-3107ba6eb861 running snapshot c9ed9b9f-1a12-400c-b29c-fc97ac6e53bf (state Requested)...
362026-04-29T22:30:27.436ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-60630fc8-6cc2-4972-a3a9-3107ba6eb861-c9ed9b9f-1a12-400c-b29c-fc97ac6e53bf
372026-04-29T22:30:27.444ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-60630fc8-6cc2-4972-a3a9-3107ba6eb861-c9ed9b9f-1a12-400c-b29c-fc97ac6e53bf
382026-04-29T22:30:27.453ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-60630fc8-6cc2-4972-a3a9-3107ba6eb861-c9ed9b9f-1a12-400c-b29c-fc97ac6e53bf
392026-04-29T22:30:27.454ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/60630fc8-6cc2-4972-a3a9-3107ba6eb861/.zfs/snapshot/c9ed9b9f-1a12-400c-b29c-fc97ac6e53bf
402026-04-29T22:30:27.454ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
412026-04-29T22:30:27.454ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
422026-04-29T22:30:27.454ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::12
432026-04-29T22:30:27.454ZINFOcrucible-agent (worker): commit
442026-04-29T22:30:27.457ZINFOcrucible-agent (worker): ok!
452026-04-29T22:30:27.461ZINFOcrucible-agent (worker): SMF ok!
462026-04-29T22:30:27.461ZINFOcrucible-agent (datafile): region 60630fc8-6cc2-4972-a3a9-3107ba6eb861 running snapshot c9ed9b9f-1a12-400c-b29c-fc97ac6e53bf state: Requested -> Created
472026-04-29T22:30:27.729ZINFOcrucible-agent (datafile): path is "/data/regions/60630fc8-6cc2-4972-a3a9-3107ba6eb861"
482026-04-29T22:30:27.735ZINFOcrucible-agent (datafile): dataset is oxp_de4b783c-1d39-4a03-a050-1f76af72f1d2/crucible/regions/60630fc8-6cc2-4972-a3a9-3107ba6eb861
492026-04-29T22:30:27.741ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_de4b783c-1d39-4a03-a050-1f76af72f1d2/crucible/regions/60630fc8-6cc2-4972-a3a9-3107ba6eb861@c9ed9b9f-1a12-400c-b29c-fc97ac6e53bf
502026-04-29T22:30:27.741ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_de4b783c-1d39-4a03-a050-1f76af72f1d2/crucible/regions/60630fc8-6cc2-4972-a3a9-3107ba6eb861", "c9ed9b9f-1a12-400c-b29c-fc97ac6e53bf"]
512026-04-29T22:30:27.748ZINFOcrucible-agent (dropshot): request completed latency_us = 19353 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:48233 req_id = 3e67f515-9f5b-40a1-96e2-e9a6e0faacf8 response_code = 200 uri = /crucible/0/regions/60630fc8-6cc2-4972-a3a9-3107ba6eb861/snapshots/c9ed9b9f-1a12-400c-b29c-fc97ac6e53bf/run