Max level shown:
12026-01-10T06:52:42.453ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::17]:32345 remote_addr = [fd00:1122:3344:101::c]:38162
22026-01-10T06:52:42.453ZINFOcrucible-agent (datafile): region 26f0b2fd-d881-4b4c-bcd8-b11276929574 state: Requested
32026-01-10T06:52:42.454ZINFOcrucible-agent (dropshot): request completed latency_us = 909 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:38162 req_id = c27b9591-90d1-4ef8-8a88-d39dfe41f4da response_code = 200 uri = /crucible/0/regions
42026-01-10T06:52:42.454ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
52026-01-10T06:52:42.463ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_7d0a82a2-041b-46f9-8005-f10a0e0df483/crucible/regions/26f0b2fd-d881-4b4c-bcd8-b11276929574
62026-01-10T06:52:42.463ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_7d0a82a2-041b-46f9-8005-f10a0e0df483/crucible/regions/26f0b2fd-d881-4b4c-bcd8-b11276929574
72026-01-10T06:52:42.513ZINFOcrucible-agent (worker): creating region Region { id: RegionId("26f0b2fd-d881-4b4c-bcd8-b11276929574"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/26f0b2fd-d881-4b4c-bcd8-b11276929574" region = 26f0b2fd-d881-4b4c-bcd8-b11276929574
82026-01-10T06:52:42.513ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "26f0b2fd-d881-4b4c-bcd8-b11276929574" "--data" "/data/regions/26f0b2fd-d881-4b4c-bcd8-b11276929574" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 26f0b2fd-d881-4b4c-bcd8-b11276929574
92026-01-10T06:52:42.598ZINFOcrucible-agent (worker): region files created ok region = 26f0b2fd-d881-4b4c-bcd8-b11276929574
102026-01-10T06:52:42.598ZINFOcrucible-agent (datafile): region 26f0b2fd-d881-4b4c-bcd8-b11276929574 state: Requested -> Created
112026-01-10T06:52:42.598ZINFOcrucible-agent (worker): applying SMF actions post create...
122026-01-10T06:52:42.598ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-26f0b2fd-d881-4b4c-bcd8-b11276929574
132026-01-10T06:52:42.608ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-26f0b2fd-d881-4b4c-bcd8-b11276929574
142026-01-10T06:52:42.629ZINFOcrucible-agent (worker): creating config property group
152026-01-10T06:52:42.632ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-26f0b2fd-d881-4b4c-bcd8-b11276929574
162026-01-10T06:52:42.633ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/26f0b2fd-d881-4b4c-bcd8-b11276929574
172026-01-10T06:52:42.633ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
182026-01-10T06:52:42.633ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::17
192026-01-10T06:52:42.633ZINFOcrucible-agent (worker): commit
202026-01-10T06:52:42.637ZINFOcrucible-agent (worker): ok!
212026-01-10T06:52:42.656ZINFOcrucible-agent (worker): SMF ok!
222026-01-10T06:52:42.723ZINFOcrucible-agent (dropshot): request completed latency_us = 57 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:38162 req_id = 51ad7a42-eca2-452b-8928-5fcd60cbfa7d response_code = 200 uri = /crucible/0/regions
232026-01-10T06:52:44.076ZINFOcrucible-agent (dropshot): request completed latency_us = 68 local_addr = [fd00:1122:3344:101::17]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:38162 req_id = a8a44124-e528-41c8-a897-aee3ce692d95 response_code = 200 uri = /crucible/0/regions/a47e085a-dd9d-4cc3-a44b-98768b81d957
242026-01-10T06:52:44.079ZINFOcrucible-agent (datafile): path is "/data/regions/a47e085a-dd9d-4cc3-a44b-98768b81d957"
252026-01-10T06:52:44.085ZINFOcrucible-agent (datafile): dataset is oxp_7d0a82a2-041b-46f9-8005-f10a0e0df483/crucible/regions/a47e085a-dd9d-4cc3-a44b-98768b81d957
262026-01-10T06:52:44.091ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_7d0a82a2-041b-46f9-8005-f10a0e0df483/crucible/regions/a47e085a-dd9d-4cc3-a44b-98768b81d957@fac61818-b6d6-4504-ad70-27a16b2e69f4
272026-01-10T06:52:44.091ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_7d0a82a2-041b-46f9-8005-f10a0e0df483/crucible/regions/a47e085a-dd9d-4cc3-a44b-98768b81d957", "fac61818-b6d6-4504-ad70-27a16b2e69f4"]
282026-01-10T06:52:44.099ZINFOcrucible-agent (dropshot): request completed latency_us = 20639 local_addr = [fd00:1122:3344:101::17]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:38162 req_id = 08e02523-691b-4fed-a0a1-923d5067bd24 response_code = 200 uri = /crucible/0/regions/a47e085a-dd9d-4cc3-a44b-98768b81d957/snapshots/fac61818-b6d6-4504-ad70-27a16b2e69f4
292026-01-10T06:52:44.103ZINFOcrucible-agent (datafile): path is "/data/regions/a47e085a-dd9d-4cc3-a44b-98768b81d957"
302026-01-10T06:52:44.109ZINFOcrucible-agent (datafile): dataset is oxp_7d0a82a2-041b-46f9-8005-f10a0e0df483/crucible/regions/a47e085a-dd9d-4cc3-a44b-98768b81d957
312026-01-10T06:52:44.115ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_7d0a82a2-041b-46f9-8005-f10a0e0df483/crucible/regions/a47e085a-dd9d-4cc3-a44b-98768b81d957@fac61818-b6d6-4504-ad70-27a16b2e69f4
322026-01-10T06:52:44.115ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_7d0a82a2-041b-46f9-8005-f10a0e0df483/crucible/regions/a47e085a-dd9d-4cc3-a44b-98768b81d957", "fac61818-b6d6-4504-ad70-27a16b2e69f4"]
332026-01-10T06:52:44.122ZINFOcrucible-agent (datafile): requesting running snapshot a47e085a-dd9d-4cc3-a44b-98768b81d957-fac61818-b6d6-4504-ad70-27a16b2e69f4 state: Requested
342026-01-10T06:52:44.122ZINFOcrucible-agent (dropshot): request completed latency_us = 18851 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:38162 req_id = ecf2d4a7-dedc-4333-a769-9b252b38593a response_code = 200 uri = /crucible/0/regions/a47e085a-dd9d-4cc3-a44b-98768b81d957/snapshots/fac61818-b6d6-4504-ad70-27a16b2e69f4/run
352026-01-10T06:52:44.122ZINFOcrucible-agent (worker): applying SMF actions for region a47e085a-dd9d-4cc3-a44b-98768b81d957 running snapshot fac61818-b6d6-4504-ad70-27a16b2e69f4 (state Requested)...
362026-01-10T06:52:44.126ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-a47e085a-dd9d-4cc3-a44b-98768b81d957-fac61818-b6d6-4504-ad70-27a16b2e69f4
372026-01-10T06:52:44.136ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-a47e085a-dd9d-4cc3-a44b-98768b81d957-fac61818-b6d6-4504-ad70-27a16b2e69f4
382026-01-10T06:52:44.147ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-a47e085a-dd9d-4cc3-a44b-98768b81d957-fac61818-b6d6-4504-ad70-27a16b2e69f4
392026-01-10T06:52:44.147ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/a47e085a-dd9d-4cc3-a44b-98768b81d957/.zfs/snapshot/fac61818-b6d6-4504-ad70-27a16b2e69f4
402026-01-10T06:52:44.147ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
412026-01-10T06:52:44.147ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
422026-01-10T06:52:44.147ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::17
432026-01-10T06:52:44.147ZINFOcrucible-agent (worker): commit
442026-01-10T06:52:44.151ZINFOcrucible-agent (worker): ok!
452026-01-10T06:52:44.156ZINFOcrucible-agent (worker): SMF ok!
462026-01-10T06:52:44.156ZINFOcrucible-agent (datafile): region a47e085a-dd9d-4cc3-a44b-98768b81d957 running snapshot fac61818-b6d6-4504-ad70-27a16b2e69f4 state: Requested -> Created
472026-01-10T06:52:44.324ZINFOcrucible-agent (datafile): path is "/data/regions/a47e085a-dd9d-4cc3-a44b-98768b81d957"
482026-01-10T06:52:44.330ZINFOcrucible-agent (datafile): dataset is oxp_7d0a82a2-041b-46f9-8005-f10a0e0df483/crucible/regions/a47e085a-dd9d-4cc3-a44b-98768b81d957
492026-01-10T06:52:44.336ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_7d0a82a2-041b-46f9-8005-f10a0e0df483/crucible/regions/a47e085a-dd9d-4cc3-a44b-98768b81d957@fac61818-b6d6-4504-ad70-27a16b2e69f4
502026-01-10T06:52:44.336ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_7d0a82a2-041b-46f9-8005-f10a0e0df483/crucible/regions/a47e085a-dd9d-4cc3-a44b-98768b81d957", "fac61818-b6d6-4504-ad70-27a16b2e69f4"]
512026-01-10T06:52:44.342ZINFOcrucible-agent (dropshot): request completed latency_us = 17948 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:38162 req_id = 9604034e-b56f-4ff1-bc9b-6348def6c1b1 response_code = 200 uri = /crucible/0/regions/a47e085a-dd9d-4cc3-a44b-98768b81d957/snapshots/fac61818-b6d6-4504-ad70-27a16b2e69f4/run