Max level shown:
12025-01-06T20:39:15.198ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::19]:32345 remote_addr = [fd00:1122:3344:101::a]:34261
22025-01-06T20:39:15.198ZINFOcrucible-agent (datafile): region c211a1b6-16bd-41f6-84e0-6be399db5d2f state: Requested
32025-01-06T20:39:15.199ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42025-01-06T20:39:15.199ZINFOcrucible-agent (dropshot): request completed latency_us = 1254 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:34261 req_id = bf8b8708-6bf1-4107-a830-4e40a6a67cc2 response_code = 200 uri = /crucible/0/regions
52025-01-06T20:39:15.210ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_0b642ddf-d07f-4672-a901-9a1bd35c0ac6/crucible/regions/c211a1b6-16bd-41f6-84e0-6be399db5d2f
62025-01-06T20:39:15.210ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_0b642ddf-d07f-4672-a901-9a1bd35c0ac6/crucible/regions/c211a1b6-16bd-41f6-84e0-6be399db5d2f
72025-01-06T20:39:15.278ZINFOcrucible-agent (worker): creating region Region { id: RegionId("c211a1b6-16bd-41f6-84e0-6be399db5d2f"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/c211a1b6-16bd-41f6-84e0-6be399db5d2f" region = c211a1b6-16bd-41f6-84e0-6be399db5d2f
82025-01-06T20:39:15.278ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "c211a1b6-16bd-41f6-84e0-6be399db5d2f" "--data" "/data/regions/c211a1b6-16bd-41f6-84e0-6be399db5d2f" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = c211a1b6-16bd-41f6-84e0-6be399db5d2f
92025-01-06T20:39:15.348ZINFOcrucible-agent (worker): region files created ok region = c211a1b6-16bd-41f6-84e0-6be399db5d2f
102025-01-06T20:39:15.348ZINFOcrucible-agent (datafile): region c211a1b6-16bd-41f6-84e0-6be399db5d2f state: Requested -> Created
112025-01-06T20:39:15.348ZINFOcrucible-agent (worker): applying SMF actions post create...
122025-01-06T20:39:15.349ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-c211a1b6-16bd-41f6-84e0-6be399db5d2f
132025-01-06T20:39:15.353ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-c211a1b6-16bd-41f6-84e0-6be399db5d2f
142025-01-06T20:39:15.366ZINFOcrucible-agent (worker): creating config property group
152025-01-06T20:39:15.369ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-c211a1b6-16bd-41f6-84e0-6be399db5d2f
162025-01-06T20:39:15.370ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/c211a1b6-16bd-41f6-84e0-6be399db5d2f
172025-01-06T20:39:15.370ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
182025-01-06T20:39:15.370ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::19
192025-01-06T20:39:15.370ZINFOcrucible-agent (worker): commit
202025-01-06T20:39:15.373ZINFOcrucible-agent (worker): ok!
212025-01-06T20:39:15.382ZINFOcrucible-agent (worker): SMF ok!
222025-01-06T20:39:15.553ZINFOcrucible-agent (dropshot): request completed latency_us = 861 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:34261 req_id = 585388a7-4bcc-4389-b7db-1b53b3a6b87d response_code = 200 uri = /crucible/0/regions
232025-01-06T20:39:17.043ZINFOcrucible-agent (dropshot): request completed latency_us = 2551 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:34261 req_id = 2a1fff1a-f34d-404c-8887-0db4488c288b response_code = 200 uri = /crucible/0/regions/fb7d8d53-c51c-4712-abd4-40b1ddf9d5e2
242025-01-06T20:39:17.045ZINFOcrucible-agent (datafile): path is "/data/regions/fb7d8d53-c51c-4712-abd4-40b1ddf9d5e2"
252025-01-06T20:39:17.055ZINFOcrucible-agent (datafile): dataset is oxp_0b642ddf-d07f-4672-a901-9a1bd35c0ac6/crucible/regions/fb7d8d53-c51c-4712-abd4-40b1ddf9d5e2
262025-01-06T20:39:17.063ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_0b642ddf-d07f-4672-a901-9a1bd35c0ac6/crucible/regions/fb7d8d53-c51c-4712-abd4-40b1ddf9d5e2@b5ba42bd-f4e6-48df-8209-509db2c0435d
272025-01-06T20:39:17.063ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_0b642ddf-d07f-4672-a901-9a1bd35c0ac6/crucible/regions/fb7d8d53-c51c-4712-abd4-40b1ddf9d5e2", "b5ba42bd-f4e6-48df-8209-509db2c0435d"]
282025-01-06T20:39:17.074ZINFOcrucible-agent (dropshot): request completed latency_us = 28240 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:34261 req_id = af23369d-53e4-4800-9d19-2e1a300b7eec response_code = 200 uri = /crucible/0/regions/fb7d8d53-c51c-4712-abd4-40b1ddf9d5e2/snapshots/b5ba42bd-f4e6-48df-8209-509db2c0435d
292025-01-06T20:39:17.077ZINFOcrucible-agent (datafile): path is "/data/regions/fb7d8d53-c51c-4712-abd4-40b1ddf9d5e2"
302025-01-06T20:39:17.085ZINFOcrucible-agent (datafile): dataset is oxp_0b642ddf-d07f-4672-a901-9a1bd35c0ac6/crucible/regions/fb7d8d53-c51c-4712-abd4-40b1ddf9d5e2
312025-01-06T20:39:17.093ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_0b642ddf-d07f-4672-a901-9a1bd35c0ac6/crucible/regions/fb7d8d53-c51c-4712-abd4-40b1ddf9d5e2@b5ba42bd-f4e6-48df-8209-509db2c0435d
322025-01-06T20:39:17.093ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_0b642ddf-d07f-4672-a901-9a1bd35c0ac6/crucible/regions/fb7d8d53-c51c-4712-abd4-40b1ddf9d5e2", "b5ba42bd-f4e6-48df-8209-509db2c0435d"]
332025-01-06T20:39:17.103ZINFOcrucible-agent (datafile): requesting running snapshot fb7d8d53-c51c-4712-abd4-40b1ddf9d5e2-b5ba42bd-f4e6-48df-8209-509db2c0435d state: Requested
342025-01-06T20:39:17.103ZINFOcrucible-agent (worker): applying SMF actions for region fb7d8d53-c51c-4712-abd4-40b1ddf9d5e2 running snapshot b5ba42bd-f4e6-48df-8209-509db2c0435d (state Requested)...
352025-01-06T20:39:17.103ZINFOcrucible-agent (dropshot): request completed latency_us = 26456 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:34261 req_id = 0eae73c4-485a-4897-aa1c-90ffda2d7ea0 response_code = 200 uri = /crucible/0/regions/fb7d8d53-c51c-4712-abd4-40b1ddf9d5e2/snapshots/b5ba42bd-f4e6-48df-8209-509db2c0435d/run
362025-01-06T20:39:17.106ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-fb7d8d53-c51c-4712-abd4-40b1ddf9d5e2-b5ba42bd-f4e6-48df-8209-509db2c0435d
372025-01-06T20:39:17.114ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-fb7d8d53-c51c-4712-abd4-40b1ddf9d5e2-b5ba42bd-f4e6-48df-8209-509db2c0435d
382025-01-06T20:39:17.124ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-fb7d8d53-c51c-4712-abd4-40b1ddf9d5e2-b5ba42bd-f4e6-48df-8209-509db2c0435d
392025-01-06T20:39:17.124ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/fb7d8d53-c51c-4712-abd4-40b1ddf9d5e2/.zfs/snapshot/b5ba42bd-f4e6-48df-8209-509db2c0435d
402025-01-06T20:39:17.124ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
412025-01-06T20:39:17.124ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
422025-01-06T20:39:17.124ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::19
432025-01-06T20:39:17.125ZINFOcrucible-agent (worker): commit
442025-01-06T20:39:17.128ZINFOcrucible-agent (worker): ok!
452025-01-06T20:39:17.132ZINFOcrucible-agent (worker): SMF ok!
462025-01-06T20:39:17.132ZINFOcrucible-agent (datafile): region fb7d8d53-c51c-4712-abd4-40b1ddf9d5e2 running snapshot b5ba42bd-f4e6-48df-8209-509db2c0435d state: Requested -> Created
472025-01-06T20:39:17.270ZINFOcrucible-agent (datafile): path is "/data/regions/fb7d8d53-c51c-4712-abd4-40b1ddf9d5e2"
482025-01-06T20:39:17.279ZINFOcrucible-agent (datafile): dataset is oxp_0b642ddf-d07f-4672-a901-9a1bd35c0ac6/crucible/regions/fb7d8d53-c51c-4712-abd4-40b1ddf9d5e2
492025-01-06T20:39:17.287ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_0b642ddf-d07f-4672-a901-9a1bd35c0ac6/crucible/regions/fb7d8d53-c51c-4712-abd4-40b1ddf9d5e2@b5ba42bd-f4e6-48df-8209-509db2c0435d
502025-01-06T20:39:17.287ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_0b642ddf-d07f-4672-a901-9a1bd35c0ac6/crucible/regions/fb7d8d53-c51c-4712-abd4-40b1ddf9d5e2", "b5ba42bd-f4e6-48df-8209-509db2c0435d"]
512025-01-06T20:39:17.295ZINFOcrucible-agent (dropshot): request completed latency_us = 24657 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:34261 req_id = 23a097bf-c03f-4b66-bb6d-0ce90ac0d29f response_code = 200 uri = /crucible/0/regions/fb7d8d53-c51c-4712-abd4-40b1ddf9d5e2/snapshots/b5ba42bd-f4e6-48df-8209-509db2c0435d/run