Max level shown:
12026-09-18T17:22:16.900ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::12]:32345 remote_addr = [fd00:1122:3344:101::a]:47873
22026-09-18T17:22:16.900ZINFOcrucible-agent (datafile): region fdd5ece0-ba8d-4db6-8f11-701ca0086561 state: Requested
32026-09-18T17:22:16.901ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42026-09-18T17:22:16.901ZINFOcrucible-agent (dropshot): request completed latency_us = 1040 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:47873 req_id = afee635b-723b-4122-8c94-ab3cb22ce2f6 response_code = 200 uri = /crucible/0/regions
52026-09-18T17:22:16.911ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_016e1f26-ae7b-45a4-bd52-c979775e3ee3/crucible/regions/fdd5ece0-ba8d-4db6-8f11-701ca0086561
62026-09-18T17:22:16.911ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_016e1f26-ae7b-45a4-bd52-c979775e3ee3/crucible/regions/fdd5ece0-ba8d-4db6-8f11-701ca0086561
72026-09-18T17:22:16.986ZINFOcrucible-agent (worker): creating region Region { id: RegionId("fdd5ece0-ba8d-4db6-8f11-701ca0086561"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/fdd5ece0-ba8d-4db6-8f11-701ca0086561" region = fdd5ece0-ba8d-4db6-8f11-701ca0086561
82026-09-18T17:22:16.986ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "fdd5ece0-ba8d-4db6-8f11-701ca0086561" "--data" "/data/regions/fdd5ece0-ba8d-4db6-8f11-701ca0086561" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = fdd5ece0-ba8d-4db6-8f11-701ca0086561
92026-09-18T17:22:17.074ZINFOcrucible-agent (worker): region files created ok region = fdd5ece0-ba8d-4db6-8f11-701ca0086561
102026-09-18T17:22:17.074ZINFOcrucible-agent (datafile): region fdd5ece0-ba8d-4db6-8f11-701ca0086561 state: Requested -> Created
112026-09-18T17:22:17.074ZINFOcrucible-agent (worker): applying SMF actions post create...
122026-09-18T17:22:17.096ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-fdd5ece0-ba8d-4db6-8f11-701ca0086561
132026-09-18T17:22:17.111ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-fdd5ece0-ba8d-4db6-8f11-701ca0086561
142026-09-18T17:22:17.119ZINFOcrucible-agent (worker): creating config property group
152026-09-18T17:22:17.122ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-fdd5ece0-ba8d-4db6-8f11-701ca0086561
162026-09-18T17:22:17.123ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/fdd5ece0-ba8d-4db6-8f11-701ca0086561
172026-09-18T17:22:17.123ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
182026-09-18T17:22:17.123ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::12
192026-09-18T17:22:17.123ZINFOcrucible-agent (worker): commit
202026-09-18T17:22:17.127ZINFOcrucible-agent (worker): ok!
212026-09-18T17:22:17.132ZINFOcrucible-agent (worker): SMF ok!
222026-09-18T17:22:17.139ZINFOcrucible-agent (dropshot): request completed latency_us = 72 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:47873 req_id = 4d912a14-bba1-4c04-8da0-7fd02db51a68 response_code = 200 uri = /crucible/0/regions
232026-09-18T17:22:18.764ZINFOcrucible-agent (dropshot): request completed latency_us = 54 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:47873 req_id = 286416f9-4dd1-45e0-80d1-f965ac2a1713 response_code = 200 uri = /crucible/0/regions/576ba15a-c0ee-4ed6-bce1-e9b697dcdf2f
242026-09-18T17:22:18.767ZINFOcrucible-agent (datafile): path is "/data/regions/576ba15a-c0ee-4ed6-bce1-e9b697dcdf2f"
252026-09-18T17:22:18.773ZINFOcrucible-agent (datafile): dataset is oxp_016e1f26-ae7b-45a4-bd52-c979775e3ee3/crucible/regions/576ba15a-c0ee-4ed6-bce1-e9b697dcdf2f
262026-09-18T17:22:18.778ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_016e1f26-ae7b-45a4-bd52-c979775e3ee3/crucible/regions/576ba15a-c0ee-4ed6-bce1-e9b697dcdf2f@f55c528f-3cfc-45db-b3d6-63befd67d18c
272026-09-18T17:22:18.778ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_016e1f26-ae7b-45a4-bd52-c979775e3ee3/crucible/regions/576ba15a-c0ee-4ed6-bce1-e9b697dcdf2f", "f55c528f-3cfc-45db-b3d6-63befd67d18c"]
282026-09-18T17:22:18.788ZINFOcrucible-agent (dropshot): request completed latency_us = 20918 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:47873 req_id = 8e95a4c6-0a7d-4364-a7e1-19a8f73dd216 response_code = 200 uri = /crucible/0/regions/576ba15a-c0ee-4ed6-bce1-e9b697dcdf2f/snapshots/f55c528f-3cfc-45db-b3d6-63befd67d18c
292026-09-18T17:22:18.792ZINFOcrucible-agent (datafile): path is "/data/regions/576ba15a-c0ee-4ed6-bce1-e9b697dcdf2f"
302026-09-18T17:22:18.798ZINFOcrucible-agent (datafile): dataset is oxp_016e1f26-ae7b-45a4-bd52-c979775e3ee3/crucible/regions/576ba15a-c0ee-4ed6-bce1-e9b697dcdf2f
312026-09-18T17:22:18.802ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_016e1f26-ae7b-45a4-bd52-c979775e3ee3/crucible/regions/576ba15a-c0ee-4ed6-bce1-e9b697dcdf2f@f55c528f-3cfc-45db-b3d6-63befd67d18c
322026-09-18T17:22:18.802ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_016e1f26-ae7b-45a4-bd52-c979775e3ee3/crucible/regions/576ba15a-c0ee-4ed6-bce1-e9b697dcdf2f", "f55c528f-3cfc-45db-b3d6-63befd67d18c"]
332026-09-18T17:22:18.808ZINFOcrucible-agent (datafile): requesting running snapshot 576ba15a-c0ee-4ed6-bce1-e9b697dcdf2f-f55c528f-3cfc-45db-b3d6-63befd67d18c state: Requested
342026-09-18T17:22:18.814ZINFOcrucible-agent (worker): applying SMF actions for region 576ba15a-c0ee-4ed6-bce1-e9b697dcdf2f running snapshot f55c528f-3cfc-45db-b3d6-63befd67d18c (state Requested)...
352026-09-18T17:22:18.814ZINFOcrucible-agent (dropshot): request completed latency_us = 21448 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:47873 req_id = b7cdd4b1-db6a-4c87-b640-64a68f591feb response_code = 200 uri = /crucible/0/regions/576ba15a-c0ee-4ed6-bce1-e9b697dcdf2f/snapshots/f55c528f-3cfc-45db-b3d6-63befd67d18c/run
362026-09-18T17:22:18.816ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-576ba15a-c0ee-4ed6-bce1-e9b697dcdf2f-f55c528f-3cfc-45db-b3d6-63befd67d18c
372026-09-18T17:22:18.825ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-576ba15a-c0ee-4ed6-bce1-e9b697dcdf2f-f55c528f-3cfc-45db-b3d6-63befd67d18c
382026-09-18T17:22:18.834ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-576ba15a-c0ee-4ed6-bce1-e9b697dcdf2f-f55c528f-3cfc-45db-b3d6-63befd67d18c
392026-09-18T17:22:18.835ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/576ba15a-c0ee-4ed6-bce1-e9b697dcdf2f/.zfs/snapshot/f55c528f-3cfc-45db-b3d6-63befd67d18c
402026-09-18T17:22:18.835ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
412026-09-18T17:22:18.835ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
422026-09-18T17:22:18.835ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::12
432026-09-18T17:22:18.835ZINFOcrucible-agent (worker): commit
442026-09-18T17:22:18.838ZINFOcrucible-agent (worker): ok!
452026-09-18T17:22:18.842ZINFOcrucible-agent (worker): SMF ok!
462026-09-18T17:22:18.842ZINFOcrucible-agent (datafile): region 576ba15a-c0ee-4ed6-bce1-e9b697dcdf2f running snapshot f55c528f-3cfc-45db-b3d6-63befd67d18c state: Requested -> Created
472026-09-18T17:22:19.036ZINFOcrucible-agent (datafile): path is "/data/regions/576ba15a-c0ee-4ed6-bce1-e9b697dcdf2f"
482026-09-18T17:22:19.042ZINFOcrucible-agent (datafile): dataset is oxp_016e1f26-ae7b-45a4-bd52-c979775e3ee3/crucible/regions/576ba15a-c0ee-4ed6-bce1-e9b697dcdf2f
492026-09-18T17:22:19.046ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_016e1f26-ae7b-45a4-bd52-c979775e3ee3/crucible/regions/576ba15a-c0ee-4ed6-bce1-e9b697dcdf2f@f55c528f-3cfc-45db-b3d6-63befd67d18c
502026-09-18T17:22:19.046ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_016e1f26-ae7b-45a4-bd52-c979775e3ee3/crucible/regions/576ba15a-c0ee-4ed6-bce1-e9b697dcdf2f", "f55c528f-3cfc-45db-b3d6-63befd67d18c"]
512026-09-18T17:22:19.050ZINFOcrucible-agent (dropshot): request completed latency_us = 14538 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:47873 req_id = 30762013-b9ba-4fba-a0d8-5f2cf72d4fef response_code = 200 uri = /crucible/0/regions/576ba15a-c0ee-4ed6-bce1-e9b697dcdf2f/snapshots/f55c528f-3cfc-45db-b3d6-63befd67d18c/run