Max level shown:
12026-03-19T18:24:33.536ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::18]:32345 remote_addr = [fd00:1122:3344:101::c]:61453
22026-03-19T18:24:33.537ZINFOcrucible-agent (datafile): region eac29d0a-94c4-41be-b878-71c97abc4ac5 state: Requested
32026-03-19T18:24:33.537ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42026-03-19T18:24:33.537ZINFOcrucible-agent (dropshot): request completed latency_us = 729 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:61453 req_id = e77cba4b-8be7-41f7-9fce-3a6ab5e02b91 response_code = 200 uri = /crucible/0/regions
52026-03-19T18:24:33.548ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_7dfbabce-628f-453c-a9b9-b032b685c93e/crucible/regions/eac29d0a-94c4-41be-b878-71c97abc4ac5
62026-03-19T18:24:33.548ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_7dfbabce-628f-453c-a9b9-b032b685c93e/crucible/regions/eac29d0a-94c4-41be-b878-71c97abc4ac5
72026-03-19T18:24:33.621ZINFOcrucible-agent (worker): creating region Region { id: RegionId("eac29d0a-94c4-41be-b878-71c97abc4ac5"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/eac29d0a-94c4-41be-b878-71c97abc4ac5" region = eac29d0a-94c4-41be-b878-71c97abc4ac5
82026-03-19T18:24:33.621ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "eac29d0a-94c4-41be-b878-71c97abc4ac5" "--data" "/data/regions/eac29d0a-94c4-41be-b878-71c97abc4ac5" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = eac29d0a-94c4-41be-b878-71c97abc4ac5
92026-03-19T18:24:33.763ZINFOcrucible-agent (worker): region files created ok region = eac29d0a-94c4-41be-b878-71c97abc4ac5
102026-03-19T18:24:33.763ZINFOcrucible-agent (datafile): region eac29d0a-94c4-41be-b878-71c97abc4ac5 state: Requested -> Created
112026-03-19T18:24:33.763ZINFOcrucible-agent (worker): applying SMF actions post create...
122026-03-19T18:24:33.784ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-eac29d0a-94c4-41be-b878-71c97abc4ac5
132026-03-19T18:24:33.800ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-eac29d0a-94c4-41be-b878-71c97abc4ac5
142026-03-19T18:24:33.818ZINFOcrucible-agent (worker): creating config property group
152026-03-19T18:24:33.824ZINFOcrucible-agent (dropshot): request completed latency_us = 48 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:61453 req_id = 7dd345cd-6b5a-463b-ade4-dfb8bf283a67 response_code = 200 uri = /crucible/0/regions
162026-03-19T18:24:33.826ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-eac29d0a-94c4-41be-b878-71c97abc4ac5
172026-03-19T18:24:33.826ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/eac29d0a-94c4-41be-b878-71c97abc4ac5
182026-03-19T18:24:33.826ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
192026-03-19T18:24:33.826ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::18
202026-03-19T18:24:33.826ZINFOcrucible-agent (worker): commit
212026-03-19T18:24:33.842ZINFOcrucible-agent (worker): ok!
222026-03-19T18:24:33.855ZINFOcrucible-agent (worker): SMF ok!
232026-03-19T18:24:35.443ZINFOcrucible-agent (dropshot): request completed latency_us = 49 local_addr = [fd00:1122:3344:101::18]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:61453 req_id = 7ae82a9d-f085-442b-acc5-1f3a2ce4d6b0 response_code = 200 uri = /crucible/0/regions/17d035d3-9c36-4cd7-9b0c-a631f1339b39
242026-03-19T18:24:35.447ZINFOcrucible-agent (datafile): path is "/data/regions/17d035d3-9c36-4cd7-9b0c-a631f1339b39"
252026-03-19T18:24:35.453ZINFOcrucible-agent (datafile): dataset is oxp_7dfbabce-628f-453c-a9b9-b032b685c93e/crucible/regions/17d035d3-9c36-4cd7-9b0c-a631f1339b39
262026-03-19T18:24:35.459ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_7dfbabce-628f-453c-a9b9-b032b685c93e/crucible/regions/17d035d3-9c36-4cd7-9b0c-a631f1339b39@68056e59-bdc6-41d8-8a03-29e25892afdb
272026-03-19T18:24:35.459ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_7dfbabce-628f-453c-a9b9-b032b685c93e/crucible/regions/17d035d3-9c36-4cd7-9b0c-a631f1339b39", "68056e59-bdc6-41d8-8a03-29e25892afdb"]
282026-03-19T18:24:35.468ZINFOcrucible-agent (dropshot): request completed latency_us = 21318 local_addr = [fd00:1122:3344:101::18]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:61453 req_id = 38c9b564-176c-4e3d-8d1b-523dbb50b907 response_code = 200 uri = /crucible/0/regions/17d035d3-9c36-4cd7-9b0c-a631f1339b39/snapshots/68056e59-bdc6-41d8-8a03-29e25892afdb
292026-03-19T18:24:35.472ZINFOcrucible-agent (datafile): path is "/data/regions/17d035d3-9c36-4cd7-9b0c-a631f1339b39"
302026-03-19T18:24:35.478ZINFOcrucible-agent (datafile): dataset is oxp_7dfbabce-628f-453c-a9b9-b032b685c93e/crucible/regions/17d035d3-9c36-4cd7-9b0c-a631f1339b39
312026-03-19T18:24:35.483ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_7dfbabce-628f-453c-a9b9-b032b685c93e/crucible/regions/17d035d3-9c36-4cd7-9b0c-a631f1339b39@68056e59-bdc6-41d8-8a03-29e25892afdb
322026-03-19T18:24:35.483ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_7dfbabce-628f-453c-a9b9-b032b685c93e/crucible/regions/17d035d3-9c36-4cd7-9b0c-a631f1339b39", "68056e59-bdc6-41d8-8a03-29e25892afdb"]
332026-03-19T18:24:35.490ZINFOcrucible-agent (datafile): requesting running snapshot 17d035d3-9c36-4cd7-9b0c-a631f1339b39-68056e59-bdc6-41d8-8a03-29e25892afdb state: Requested
342026-03-19T18:24:35.490ZINFOcrucible-agent (worker): applying SMF actions for region 17d035d3-9c36-4cd7-9b0c-a631f1339b39 running snapshot 68056e59-bdc6-41d8-8a03-29e25892afdb (state Requested)...
352026-03-19T18:24:35.490ZINFOcrucible-agent (dropshot): request completed latency_us = 18174 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:61453 req_id = 245a74fa-4929-465a-a7dd-7efde10e0ecb response_code = 200 uri = /crucible/0/regions/17d035d3-9c36-4cd7-9b0c-a631f1339b39/snapshots/68056e59-bdc6-41d8-8a03-29e25892afdb/run
362026-03-19T18:24:35.495ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-17d035d3-9c36-4cd7-9b0c-a631f1339b39-68056e59-bdc6-41d8-8a03-29e25892afdb
372026-03-19T18:24:35.502ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-17d035d3-9c36-4cd7-9b0c-a631f1339b39-68056e59-bdc6-41d8-8a03-29e25892afdb
382026-03-19T18:24:35.512ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-17d035d3-9c36-4cd7-9b0c-a631f1339b39-68056e59-bdc6-41d8-8a03-29e25892afdb
392026-03-19T18:24:35.513ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/17d035d3-9c36-4cd7-9b0c-a631f1339b39/.zfs/snapshot/68056e59-bdc6-41d8-8a03-29e25892afdb
402026-03-19T18:24:35.513ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
412026-03-19T18:24:35.513ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
422026-03-19T18:24:35.513ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::18
432026-03-19T18:24:35.513ZINFOcrucible-agent (worker): commit
442026-03-19T18:24:35.517ZINFOcrucible-agent (worker): ok!
452026-03-19T18:24:35.522ZINFOcrucible-agent (worker): SMF ok!
462026-03-19T18:24:35.522ZINFOcrucible-agent (datafile): region 17d035d3-9c36-4cd7-9b0c-a631f1339b39 running snapshot 68056e59-bdc6-41d8-8a03-29e25892afdb state: Requested -> Created
472026-03-19T18:24:35.726ZINFOcrucible-agent (datafile): path is "/data/regions/17d035d3-9c36-4cd7-9b0c-a631f1339b39"
482026-03-19T18:24:35.732ZINFOcrucible-agent (datafile): dataset is oxp_7dfbabce-628f-453c-a9b9-b032b685c93e/crucible/regions/17d035d3-9c36-4cd7-9b0c-a631f1339b39
492026-03-19T18:24:35.738ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_7dfbabce-628f-453c-a9b9-b032b685c93e/crucible/regions/17d035d3-9c36-4cd7-9b0c-a631f1339b39@68056e59-bdc6-41d8-8a03-29e25892afdb
502026-03-19T18:24:35.738ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_7dfbabce-628f-453c-a9b9-b032b685c93e/crucible/regions/17d035d3-9c36-4cd7-9b0c-a631f1339b39", "68056e59-bdc6-41d8-8a03-29e25892afdb"]
512026-03-19T18:24:35.744ZINFOcrucible-agent (dropshot): request completed latency_us = 17821 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:61453 req_id = 776da9f5-6c6e-4ec3-832a-18be41eb96e2 response_code = 200 uri = /crucible/0/regions/17d035d3-9c36-4cd7-9b0c-a631f1339b39/snapshots/68056e59-bdc6-41d8-8a03-29e25892afdb/run