Max level shown:
12026-09-02T04:45:44.649ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::18]:32345 remote_addr = [fd00:1122:3344:101::b]:63205
22026-09-02T04:45:44.649ZINFOcrucible-agent (datafile): region f1915127-99e9-48b3-b282-d78eeaa0309f state: Requested
32026-09-02T04:45:44.649ZINFOcrucible-agent (dropshot): request completed latency_us = 687 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:63205 req_id = b3848b59-e017-4bd7-94e7-c2ba7623d55d response_code = 200 uri = /crucible/0/regions
42026-09-02T04:45:44.649ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
52026-09-02T04:45:44.657ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_d2b5832f-dfa3-4f9b-b048-9fbc7a73eac5/crucible/regions/f1915127-99e9-48b3-b282-d78eeaa0309f
62026-09-02T04:45:44.657ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_d2b5832f-dfa3-4f9b-b048-9fbc7a73eac5/crucible/regions/f1915127-99e9-48b3-b282-d78eeaa0309f
72026-09-02T04:45:44.723ZINFOcrucible-agent (worker): creating region Region { id: RegionId("f1915127-99e9-48b3-b282-d78eeaa0309f"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/f1915127-99e9-48b3-b282-d78eeaa0309f" region = f1915127-99e9-48b3-b282-d78eeaa0309f
82026-09-02T04:45:44.724ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "f1915127-99e9-48b3-b282-d78eeaa0309f" "--data" "/data/regions/f1915127-99e9-48b3-b282-d78eeaa0309f" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = f1915127-99e9-48b3-b282-d78eeaa0309f
92026-09-02T04:45:44.831ZINFOcrucible-agent (worker): region files created ok region = f1915127-99e9-48b3-b282-d78eeaa0309f
102026-09-02T04:45:44.831ZINFOcrucible-agent (datafile): region f1915127-99e9-48b3-b282-d78eeaa0309f state: Requested -> Created
112026-09-02T04:45:44.831ZINFOcrucible-agent (worker): applying SMF actions post create...
122026-09-02T04:45:44.844ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-f1915127-99e9-48b3-b282-d78eeaa0309f
132026-09-02T04:45:44.852ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-f1915127-99e9-48b3-b282-d78eeaa0309f
142026-09-02T04:45:44.871ZINFOcrucible-agent (dropshot): request completed latency_us = 54 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:63205 req_id = a70cdc5e-7282-4728-833a-cfeb93485986 response_code = 200 uri = /crucible/0/regions
152026-09-02T04:45:44.873ZINFOcrucible-agent (worker): creating config property group
162026-09-02T04:45:44.879ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-f1915127-99e9-48b3-b282-d78eeaa0309f
172026-09-02T04:45:44.879ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/f1915127-99e9-48b3-b282-d78eeaa0309f
182026-09-02T04:45:44.879ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
192026-09-02T04:45:44.879ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::18
202026-09-02T04:45:44.879ZINFOcrucible-agent (worker): commit
212026-09-02T04:45:44.888ZINFOcrucible-agent (worker): ok!
222026-09-02T04:45:44.896ZINFOcrucible-agent (worker): SMF ok!
232026-09-02T04:45:46.029ZINFOcrucible-agent (dropshot): request completed latency_us = 77 local_addr = [fd00:1122:3344:101::18]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:63205 req_id = 29fc5406-6315-42b1-9200-a5834d5e5cd9 response_code = 200 uri = /crucible/0/regions/30697815-1667-4387-9a15-b84f66582707
242026-09-02T04:45:46.032ZINFOcrucible-agent (datafile): path is "/data/regions/30697815-1667-4387-9a15-b84f66582707"
252026-09-02T04:45:46.039ZINFOcrucible-agent (datafile): dataset is oxp_d2b5832f-dfa3-4f9b-b048-9fbc7a73eac5/crucible/regions/30697815-1667-4387-9a15-b84f66582707
262026-09-02T04:45:46.046ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_d2b5832f-dfa3-4f9b-b048-9fbc7a73eac5/crucible/regions/30697815-1667-4387-9a15-b84f66582707@48c9baba-2bc9-4726-bc88-d810ff929b53
272026-09-02T04:45:46.046ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_d2b5832f-dfa3-4f9b-b048-9fbc7a73eac5/crucible/regions/30697815-1667-4387-9a15-b84f66582707", "48c9baba-2bc9-4726-bc88-d810ff929b53"]
282026-09-02T04:45:46.058ZINFOcrucible-agent (dropshot): request completed latency_us = 26175 local_addr = [fd00:1122:3344:101::18]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:63205 req_id = a88e62a0-2d83-4b6c-8aa4-8381088661f0 response_code = 200 uri = /crucible/0/regions/30697815-1667-4387-9a15-b84f66582707/snapshots/48c9baba-2bc9-4726-bc88-d810ff929b53
292026-09-02T04:45:46.064ZINFOcrucible-agent (datafile): path is "/data/regions/30697815-1667-4387-9a15-b84f66582707"
302026-09-02T04:45:46.070ZINFOcrucible-agent (datafile): dataset is oxp_d2b5832f-dfa3-4f9b-b048-9fbc7a73eac5/crucible/regions/30697815-1667-4387-9a15-b84f66582707
312026-09-02T04:45:46.078ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_d2b5832f-dfa3-4f9b-b048-9fbc7a73eac5/crucible/regions/30697815-1667-4387-9a15-b84f66582707@48c9baba-2bc9-4726-bc88-d810ff929b53
322026-09-02T04:45:46.078ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_d2b5832f-dfa3-4f9b-b048-9fbc7a73eac5/crucible/regions/30697815-1667-4387-9a15-b84f66582707", "48c9baba-2bc9-4726-bc88-d810ff929b53"]
332026-09-02T04:45:46.087ZINFOcrucible-agent (datafile): requesting running snapshot 30697815-1667-4387-9a15-b84f66582707-48c9baba-2bc9-4726-bc88-d810ff929b53 state: Requested
342026-09-02T04:45:46.091ZINFOcrucible-agent (worker): applying SMF actions for region 30697815-1667-4387-9a15-b84f66582707 running snapshot 48c9baba-2bc9-4726-bc88-d810ff929b53 (state Requested)...
352026-09-02T04:45:46.091ZINFOcrucible-agent (dropshot): request completed latency_us = 27546 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:63205 req_id = b9af123b-f33f-4799-8e91-3acea55a0a1e response_code = 200 uri = /crucible/0/regions/30697815-1667-4387-9a15-b84f66582707/snapshots/48c9baba-2bc9-4726-bc88-d810ff929b53/run
362026-09-02T04:45:46.094ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-30697815-1667-4387-9a15-b84f66582707-48c9baba-2bc9-4726-bc88-d810ff929b53
372026-09-02T04:45:46.107ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-30697815-1667-4387-9a15-b84f66582707-48c9baba-2bc9-4726-bc88-d810ff929b53
382026-09-02T04:45:46.126ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-30697815-1667-4387-9a15-b84f66582707-48c9baba-2bc9-4726-bc88-d810ff929b53
392026-09-02T04:45:46.127ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/30697815-1667-4387-9a15-b84f66582707/.zfs/snapshot/48c9baba-2bc9-4726-bc88-d810ff929b53
402026-09-02T04:45:46.127ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
412026-09-02T04:45:46.127ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
422026-09-02T04:45:46.127ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::18
432026-09-02T04:45:46.127ZINFOcrucible-agent (worker): commit
442026-09-02T04:45:46.132ZINFOcrucible-agent (worker): ok!
452026-09-02T04:45:46.139ZINFOcrucible-agent (worker): SMF ok!
462026-09-02T04:45:46.139ZINFOcrucible-agent (datafile): region 30697815-1667-4387-9a15-b84f66582707 running snapshot 48c9baba-2bc9-4726-bc88-d810ff929b53 state: Requested -> Created
472026-09-02T04:45:46.426ZINFOcrucible-agent (datafile): path is "/data/regions/30697815-1667-4387-9a15-b84f66582707"
482026-09-02T04:45:46.434ZINFOcrucible-agent (datafile): dataset is oxp_d2b5832f-dfa3-4f9b-b048-9fbc7a73eac5/crucible/regions/30697815-1667-4387-9a15-b84f66582707
492026-09-02T04:45:46.440ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_d2b5832f-dfa3-4f9b-b048-9fbc7a73eac5/crucible/regions/30697815-1667-4387-9a15-b84f66582707@48c9baba-2bc9-4726-bc88-d810ff929b53
502026-09-02T04:45:46.440ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_d2b5832f-dfa3-4f9b-b048-9fbc7a73eac5/crucible/regions/30697815-1667-4387-9a15-b84f66582707", "48c9baba-2bc9-4726-bc88-d810ff929b53"]
512026-09-02T04:45:46.446ZINFOcrucible-agent (dropshot): request completed latency_us = 20156 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:63205 req_id = b2e5d1f3-a05d-4d35-8d38-c6d7abcf22d7 response_code = 200 uri = /crucible/0/regions/30697815-1667-4387-9a15-b84f66582707/snapshots/48c9baba-2bc9-4726-bc88-d810ff929b53/run