Max level shown:
12026-05-16T01:38:41.557ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::14]:32345 remote_addr = [fd00:1122:3344:101::c]:59962
22026-05-16T01:38:41.557ZINFOcrucible-agent (datafile): region 556d7577-f2ac-4c14-990f-9d6be9b3dfa7 state: Requested
32026-05-16T01:38:41.558ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42026-05-16T01:38:41.558ZINFOcrucible-agent (dropshot): request completed latency_us = 1141 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:59962 req_id = ebfe4ebe-f259-45d4-8c33-88efc2cf521b response_code = 200 uri = /crucible/0/regions
52026-05-16T01:38:41.568ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_66636f15-c570-4880-9a35-e4f49c18ca10/crucible/regions/556d7577-f2ac-4c14-990f-9d6be9b3dfa7
62026-05-16T01:38:41.568ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_66636f15-c570-4880-9a35-e4f49c18ca10/crucible/regions/556d7577-f2ac-4c14-990f-9d6be9b3dfa7
72026-05-16T01:38:41.609ZINFOcrucible-agent (worker): creating region Region { id: RegionId("556d7577-f2ac-4c14-990f-9d6be9b3dfa7"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/556d7577-f2ac-4c14-990f-9d6be9b3dfa7" region = 556d7577-f2ac-4c14-990f-9d6be9b3dfa7
82026-05-16T01:38:41.609ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "556d7577-f2ac-4c14-990f-9d6be9b3dfa7" "--data" "/data/regions/556d7577-f2ac-4c14-990f-9d6be9b3dfa7" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 556d7577-f2ac-4c14-990f-9d6be9b3dfa7
92026-05-16T01:38:41.662ZINFOcrucible-agent (worker): region files created ok region = 556d7577-f2ac-4c14-990f-9d6be9b3dfa7
102026-05-16T01:38:41.662ZINFOcrucible-agent (datafile): region 556d7577-f2ac-4c14-990f-9d6be9b3dfa7 state: Requested -> Created
112026-05-16T01:38:41.662ZINFOcrucible-agent (worker): applying SMF actions post create...
122026-05-16T01:38:41.671ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-556d7577-f2ac-4c14-990f-9d6be9b3dfa7
132026-05-16T01:38:41.675ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-556d7577-f2ac-4c14-990f-9d6be9b3dfa7
142026-05-16T01:38:41.681ZINFOcrucible-agent (worker): creating config property group
152026-05-16T01:38:41.683ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-556d7577-f2ac-4c14-990f-9d6be9b3dfa7
162026-05-16T01:38:41.683ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/556d7577-f2ac-4c14-990f-9d6be9b3dfa7
172026-05-16T01:38:41.683ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
182026-05-16T01:38:41.683ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::14
192026-05-16T01:38:41.683ZINFOcrucible-agent (worker): commit
202026-05-16T01:38:41.685ZINFOcrucible-agent (worker): ok!
212026-05-16T01:38:41.687ZINFOcrucible-agent (worker): SMF ok!
222026-05-16T01:38:41.889ZINFOcrucible-agent (dropshot): request completed latency_us = 72 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:59962 req_id = eaf6272f-b850-4165-887f-b1c648c99494 response_code = 200 uri = /crucible/0/regions
232026-05-16T01:38:43.681ZINFOcrucible-agent (dropshot): request completed latency_us = 56 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:59962 req_id = d500b157-8f11-4012-a5da-b55201b3cf7b response_code = 200 uri = /crucible/0/regions/3c2d61c9-0a74-4eb8-9fe1-78d41b2cd2c4
242026-05-16T01:38:43.685ZINFOcrucible-agent (datafile): path is "/data/regions/3c2d61c9-0a74-4eb8-9fe1-78d41b2cd2c4"
252026-05-16T01:38:43.692ZINFOcrucible-agent (datafile): dataset is oxp_66636f15-c570-4880-9a35-e4f49c18ca10/crucible/regions/3c2d61c9-0a74-4eb8-9fe1-78d41b2cd2c4
262026-05-16T01:38:43.698ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_66636f15-c570-4880-9a35-e4f49c18ca10/crucible/regions/3c2d61c9-0a74-4eb8-9fe1-78d41b2cd2c4@7a6636ef-f65f-41f9-ae61-1c8319dfc700
272026-05-16T01:38:43.698ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_66636f15-c570-4880-9a35-e4f49c18ca10/crucible/regions/3c2d61c9-0a74-4eb8-9fe1-78d41b2cd2c4", "7a6636ef-f65f-41f9-ae61-1c8319dfc700"]
282026-05-16T01:38:43.706ZINFOcrucible-agent (dropshot): request completed latency_us = 20533 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:59962 req_id = e577b161-55b1-413e-a3b8-6ff680d2bbaf response_code = 200 uri = /crucible/0/regions/3c2d61c9-0a74-4eb8-9fe1-78d41b2cd2c4/snapshots/7a6636ef-f65f-41f9-ae61-1c8319dfc700
292026-05-16T01:38:43.710ZINFOcrucible-agent (datafile): path is "/data/regions/3c2d61c9-0a74-4eb8-9fe1-78d41b2cd2c4"
302026-05-16T01:38:43.715ZINFOcrucible-agent (datafile): dataset is oxp_66636f15-c570-4880-9a35-e4f49c18ca10/crucible/regions/3c2d61c9-0a74-4eb8-9fe1-78d41b2cd2c4
312026-05-16T01:38:43.720ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_66636f15-c570-4880-9a35-e4f49c18ca10/crucible/regions/3c2d61c9-0a74-4eb8-9fe1-78d41b2cd2c4@7a6636ef-f65f-41f9-ae61-1c8319dfc700
322026-05-16T01:38:43.720ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_66636f15-c570-4880-9a35-e4f49c18ca10/crucible/regions/3c2d61c9-0a74-4eb8-9fe1-78d41b2cd2c4", "7a6636ef-f65f-41f9-ae61-1c8319dfc700"]
332026-05-16T01:38:43.727ZINFOcrucible-agent (datafile): requesting running snapshot 3c2d61c9-0a74-4eb8-9fe1-78d41b2cd2c4-7a6636ef-f65f-41f9-ae61-1c8319dfc700 state: Requested
342026-05-16T01:38:43.727ZINFOcrucible-agent (dropshot): request completed latency_us = 17861 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:59962 req_id = 120da185-0291-4544-bc7e-c46f81bb5026 response_code = 200 uri = /crucible/0/regions/3c2d61c9-0a74-4eb8-9fe1-78d41b2cd2c4/snapshots/7a6636ef-f65f-41f9-ae61-1c8319dfc700/run
352026-05-16T01:38:43.727ZINFOcrucible-agent (worker): applying SMF actions for region 3c2d61c9-0a74-4eb8-9fe1-78d41b2cd2c4 running snapshot 7a6636ef-f65f-41f9-ae61-1c8319dfc700 (state Requested)...
362026-05-16T01:38:43.732ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-3c2d61c9-0a74-4eb8-9fe1-78d41b2cd2c4-7a6636ef-f65f-41f9-ae61-1c8319dfc700
372026-05-16T01:38:43.733ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-3c2d61c9-0a74-4eb8-9fe1-78d41b2cd2c4-7a6636ef-f65f-41f9-ae61-1c8319dfc700
382026-05-16T01:38:43.738ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-3c2d61c9-0a74-4eb8-9fe1-78d41b2cd2c4-7a6636ef-f65f-41f9-ae61-1c8319dfc700
392026-05-16T01:38:43.738ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/3c2d61c9-0a74-4eb8-9fe1-78d41b2cd2c4/.zfs/snapshot/7a6636ef-f65f-41f9-ae61-1c8319dfc700
402026-05-16T01:38:43.738ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
412026-05-16T01:38:43.738ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
422026-05-16T01:38:43.738ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::14
432026-05-16T01:38:43.738ZINFOcrucible-agent (worker): commit
442026-05-16T01:38:43.740ZINFOcrucible-agent (worker): ok!
452026-05-16T01:38:43.743ZINFOcrucible-agent (worker): SMF ok!
462026-05-16T01:38:43.743ZINFOcrucible-agent (datafile): region 3c2d61c9-0a74-4eb8-9fe1-78d41b2cd2c4 running snapshot 7a6636ef-f65f-41f9-ae61-1c8319dfc700 state: Requested -> Created
472026-05-16T01:38:43.999ZINFOcrucible-agent (datafile): path is "/data/regions/3c2d61c9-0a74-4eb8-9fe1-78d41b2cd2c4"
482026-05-16T01:38:44.005ZINFOcrucible-agent (datafile): dataset is oxp_66636f15-c570-4880-9a35-e4f49c18ca10/crucible/regions/3c2d61c9-0a74-4eb8-9fe1-78d41b2cd2c4
492026-05-16T01:38:44.011ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_66636f15-c570-4880-9a35-e4f49c18ca10/crucible/regions/3c2d61c9-0a74-4eb8-9fe1-78d41b2cd2c4@7a6636ef-f65f-41f9-ae61-1c8319dfc700
502026-05-16T01:38:44.011ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_66636f15-c570-4880-9a35-e4f49c18ca10/crucible/regions/3c2d61c9-0a74-4eb8-9fe1-78d41b2cd2c4", "7a6636ef-f65f-41f9-ae61-1c8319dfc700"]
512026-05-16T01:38:44.017ZINFOcrucible-agent (dropshot): request completed latency_us = 18342 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:59962 req_id = 640e2acd-89c4-4ca2-ac8b-3238a8fbd41c response_code = 200 uri = /crucible/0/regions/3c2d61c9-0a74-4eb8-9fe1-78d41b2cd2c4/snapshots/7a6636ef-f65f-41f9-ae61-1c8319dfc700/run