Max level shown:
12024-12-06T20:45:31.132ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::12]:32345 remote_addr = [fd00:1122:3344:101::a]:38149
22024-12-06T20:45:31.166ZINFOcrucible-agent (datafile): region 7722a681-479b-4c2d-92d4-80aba4660a2d state: Requested
32024-12-06T20:45:31.171ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42024-12-06T20:45:31.175ZINFOcrucible-agent (dropshot): request completed latency_us = 15350 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:38149 req_id = a4b04e7c-8713-4471-b5ec-4eabd7b02492 response_code = 200 uri = /crucible/0/regions
52024-12-06T20:45:31.182ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_50f60e54-9000-4b4d-8705-841b133128b0/crucible/regions/7722a681-479b-4c2d-92d4-80aba4660a2d
62024-12-06T20:45:31.182ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_50f60e54-9000-4b4d-8705-841b133128b0/crucible/regions/7722a681-479b-4c2d-92d4-80aba4660a2d
72024-12-06T20:45:31.251ZINFOcrucible-agent (worker): creating region Region { id: RegionId("7722a681-479b-4c2d-92d4-80aba4660a2d"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/7722a681-479b-4c2d-92d4-80aba4660a2d" region = 7722a681-479b-4c2d-92d4-80aba4660a2d
82024-12-06T20:45:31.253ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "7722a681-479b-4c2d-92d4-80aba4660a2d" "--data" "/data/regions/7722a681-479b-4c2d-92d4-80aba4660a2d" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 7722a681-479b-4c2d-92d4-80aba4660a2d
92024-12-06T20:45:31.343ZINFOcrucible-agent (dropshot): request completed latency_us = 77 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:38149 req_id = aba7f98b-f18c-4f57-a338-ad5d23c5f4dc response_code = 200 uri = /crucible/0/regions
102024-12-06T20:45:31.394ZINFOcrucible-agent (worker): region files created ok region = 7722a681-479b-4c2d-92d4-80aba4660a2d
112024-12-06T20:45:31.394ZINFOcrucible-agent (datafile): region 7722a681-479b-4c2d-92d4-80aba4660a2d state: Requested -> Created
122024-12-06T20:45:31.394ZINFOcrucible-agent (worker): applying SMF actions post create...
132024-12-06T20:45:31.394ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-7722a681-479b-4c2d-92d4-80aba4660a2d
142024-12-06T20:45:31.399ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-7722a681-479b-4c2d-92d4-80aba4660a2d
152024-12-06T20:45:31.411ZINFOcrucible-agent (worker): creating config property group
162024-12-06T20:45:31.415ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-7722a681-479b-4c2d-92d4-80aba4660a2d
172024-12-06T20:45:31.415ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/7722a681-479b-4c2d-92d4-80aba4660a2d
182024-12-06T20:45:31.416ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
192024-12-06T20:45:31.416ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::12
202024-12-06T20:45:31.416ZINFOcrucible-agent (worker): commit
212024-12-06T20:45:31.420ZINFOcrucible-agent (worker): ok!
222024-12-06T20:45:31.425ZINFOcrucible-agent (worker): SMF ok!
232024-12-06T20:45:31.847ZINFOcrucible-agent (dropshot): request completed latency_us = 64 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:38149 req_id = 98c4895b-b0e1-4553-8060-6451e0319b6c response_code = 200 uri = /crucible/0/regions
242024-12-06T20:56:36.366ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::12]:32345 remote_addr = [fd00:1122:3344:101::a]:42819
252024-12-06T20:56:36.369ZINFOcrucible-agent (dropshot): request completed latency_us = 2978 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:42819 req_id = 9b662d4c-66e9-4329-8e05-c7b1e8107a2c response_code = 200 uri = /crucible/0/regions/7722a681-479b-4c2d-92d4-80aba4660a2d
262024-12-06T20:56:36.373ZINFOcrucible-agent (datafile): path is "/data/regions/7722a681-479b-4c2d-92d4-80aba4660a2d"
272024-12-06T20:56:36.382ZINFOcrucible-agent (datafile): dataset is oxp_50f60e54-9000-4b4d-8705-841b133128b0/crucible/regions/7722a681-479b-4c2d-92d4-80aba4660a2d
282024-12-06T20:56:36.390ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_50f60e54-9000-4b4d-8705-841b133128b0/crucible/regions/7722a681-479b-4c2d-92d4-80aba4660a2d@725eb09e-c6bd-4c0c-8093-d8de58256bed
292024-12-06T20:56:36.390ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_50f60e54-9000-4b4d-8705-841b133128b0/crucible/regions/7722a681-479b-4c2d-92d4-80aba4660a2d", "725eb09e-c6bd-4c0c-8093-d8de58256bed"]
302024-12-06T20:56:36.404ZINFOcrucible-agent (dropshot): request completed latency_us = 31264 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:42819 req_id = d23a5ea5-ad2a-4043-9263-5806fc0c1e35 response_code = 200 uri = /crucible/0/regions/7722a681-479b-4c2d-92d4-80aba4660a2d/snapshots/725eb09e-c6bd-4c0c-8093-d8de58256bed
312024-12-06T20:56:36.407ZINFOcrucible-agent (datafile): path is "/data/regions/7722a681-479b-4c2d-92d4-80aba4660a2d"
322024-12-06T20:56:36.415ZINFOcrucible-agent (datafile): dataset is oxp_50f60e54-9000-4b4d-8705-841b133128b0/crucible/regions/7722a681-479b-4c2d-92d4-80aba4660a2d
332024-12-06T20:56:36.423ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_50f60e54-9000-4b4d-8705-841b133128b0/crucible/regions/7722a681-479b-4c2d-92d4-80aba4660a2d@725eb09e-c6bd-4c0c-8093-d8de58256bed
342024-12-06T20:56:36.423ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_50f60e54-9000-4b4d-8705-841b133128b0/crucible/regions/7722a681-479b-4c2d-92d4-80aba4660a2d", "725eb09e-c6bd-4c0c-8093-d8de58256bed"]
352024-12-06T20:56:36.432ZINFOcrucible-agent (datafile): requesting running snapshot 7722a681-479b-4c2d-92d4-80aba4660a2d-725eb09e-c6bd-4c0c-8093-d8de58256bed state: Requested
362024-12-06T20:56:36.433ZINFOcrucible-agent (worker): applying SMF actions for region 7722a681-479b-4c2d-92d4-80aba4660a2d running snapshot 725eb09e-c6bd-4c0c-8093-d8de58256bed (state Requested)...
372024-12-06T20:56:36.433ZINFOcrucible-agent (dropshot): request completed latency_us = 26249 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:42819 req_id = 167cf2f2-4762-4f61-ba99-d6a8f3bdd16a response_code = 200 uri = /crucible/0/regions/7722a681-479b-4c2d-92d4-80aba4660a2d/snapshots/725eb09e-c6bd-4c0c-8093-d8de58256bed/run
382024-12-06T20:56:36.443ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-7722a681-479b-4c2d-92d4-80aba4660a2d-725eb09e-c6bd-4c0c-8093-d8de58256bed
392024-12-06T20:56:36.448ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-7722a681-479b-4c2d-92d4-80aba4660a2d-725eb09e-c6bd-4c0c-8093-d8de58256bed
402024-12-06T20:56:36.461ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-7722a681-479b-4c2d-92d4-80aba4660a2d-725eb09e-c6bd-4c0c-8093-d8de58256bed
412024-12-06T20:56:36.461ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/7722a681-479b-4c2d-92d4-80aba4660a2d/.zfs/snapshot/725eb09e-c6bd-4c0c-8093-d8de58256bed
422024-12-06T20:56:36.461ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
432024-12-06T20:56:36.461ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
442024-12-06T20:56:36.461ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::12
452024-12-06T20:56:36.462ZINFOcrucible-agent (worker): commit
462024-12-06T20:56:36.466ZINFOcrucible-agent (worker): ok!
472024-12-06T20:56:36.471ZINFOcrucible-agent (worker): SMF ok!
482024-12-06T20:56:36.471ZINFOcrucible-agent (datafile): region 7722a681-479b-4c2d-92d4-80aba4660a2d running snapshot 725eb09e-c6bd-4c0c-8093-d8de58256bed state: Requested -> Created
492024-12-06T20:56:36.764ZINFOcrucible-agent (datafile): path is "/data/regions/7722a681-479b-4c2d-92d4-80aba4660a2d"
502024-12-06T20:56:36.774ZINFOcrucible-agent (datafile): dataset is oxp_50f60e54-9000-4b4d-8705-841b133128b0/crucible/regions/7722a681-479b-4c2d-92d4-80aba4660a2d
512024-12-06T20:56:36.782ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_50f60e54-9000-4b4d-8705-841b133128b0/crucible/regions/7722a681-479b-4c2d-92d4-80aba4660a2d@725eb09e-c6bd-4c0c-8093-d8de58256bed
522024-12-06T20:56:36.782ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_50f60e54-9000-4b4d-8705-841b133128b0/crucible/regions/7722a681-479b-4c2d-92d4-80aba4660a2d", "725eb09e-c6bd-4c0c-8093-d8de58256bed"]
532024-12-06T20:56:36.790ZINFOcrucible-agent (dropshot): request completed latency_us = 27165 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:42819 req_id = 0d0e1d09-cb41-4761-bf90-1d4c753a6a2d response_code = 200 uri = /crucible/0/regions/7722a681-479b-4c2d-92d4-80aba4660a2d/snapshots/725eb09e-c6bd-4c0c-8093-d8de58256bed/run