Max level shown:
12024-12-21T06:15:04.059ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::16]:32345 remote_addr = [fd00:1122:3344:101::a]:64639
22024-12-21T06:15:04.091ZINFOcrucible-agent (datafile): region d1348167-9924-43bc-9489-a5a77d2171d1 state: Requested
32024-12-21T06:15:04.095ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42024-12-21T06:15:04.100ZINFOcrucible-agent (dropshot): request completed latency_us = 14243 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:64639 req_id = c1cb2d6e-49e3-4d43-82b5-8dbf9cd79e5a response_code = 200 uri = /crucible/0/regions
52024-12-21T06:15:04.106ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_7249b8f2-2eaf-4ba7-b868-c638f0109e8c/crucible/regions/d1348167-9924-43bc-9489-a5a77d2171d1
62024-12-21T06:15:04.106ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_7249b8f2-2eaf-4ba7-b868-c638f0109e8c/crucible/regions/d1348167-9924-43bc-9489-a5a77d2171d1
72024-12-21T06:15:04.156ZINFOcrucible-agent (worker): creating region Region { id: RegionId("d1348167-9924-43bc-9489-a5a77d2171d1"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/d1348167-9924-43bc-9489-a5a77d2171d1" region = d1348167-9924-43bc-9489-a5a77d2171d1
82024-12-21T06:15:04.158ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "d1348167-9924-43bc-9489-a5a77d2171d1" "--data" "/data/regions/d1348167-9924-43bc-9489-a5a77d2171d1" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = d1348167-9924-43bc-9489-a5a77d2171d1
92024-12-21T06:15:04.327ZINFOcrucible-agent (worker): region files created ok region = d1348167-9924-43bc-9489-a5a77d2171d1
102024-12-21T06:15:04.327ZINFOcrucible-agent (datafile): region d1348167-9924-43bc-9489-a5a77d2171d1 state: Requested -> Created
112024-12-21T06:15:04.327ZINFOcrucible-agent (worker): applying SMF actions post create...
122024-12-21T06:15:04.327ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-d1348167-9924-43bc-9489-a5a77d2171d1
132024-12-21T06:15:04.345ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-d1348167-9924-43bc-9489-a5a77d2171d1
142024-12-21T06:15:04.359ZINFOcrucible-agent (worker): creating config property group
152024-12-21T06:15:04.362ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-d1348167-9924-43bc-9489-a5a77d2171d1
162024-12-21T06:15:04.363ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/d1348167-9924-43bc-9489-a5a77d2171d1
172024-12-21T06:15:04.363ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
182024-12-21T06:15:04.363ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::16
192024-12-21T06:15:04.363ZINFOcrucible-agent (worker): commit
202024-12-21T06:15:04.367ZINFOcrucible-agent (worker): ok!
212024-12-21T06:15:04.371ZINFOcrucible-agent (worker): SMF ok!
222024-12-21T06:15:04.437ZINFOcrucible-agent (dropshot): request completed latency_us = 66 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:64639 req_id = 49bb519a-e9ba-4429-b1fd-48292421d3d2 response_code = 200 uri = /crucible/0/regions
232024-12-21T06:25:12.084ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::16]:32345 remote_addr = [fd00:1122:3344:101::a]:34585
242024-12-21T06:25:12.088ZINFOcrucible-agent (dropshot): request completed latency_us = 3764 local_addr = [fd00:1122:3344:101::16]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:34585 req_id = 71401730-8990-4a16-9b5c-70c199d6d1ed response_code = 200 uri = /crucible/0/regions/d1348167-9924-43bc-9489-a5a77d2171d1
252024-12-21T06:25:12.091ZINFOcrucible-agent (datafile): path is "/data/regions/d1348167-9924-43bc-9489-a5a77d2171d1"
262024-12-21T06:25:12.101ZINFOcrucible-agent (datafile): dataset is oxp_7249b8f2-2eaf-4ba7-b868-c638f0109e8c/crucible/regions/d1348167-9924-43bc-9489-a5a77d2171d1
272024-12-21T06:25:12.109ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_7249b8f2-2eaf-4ba7-b868-c638f0109e8c/crucible/regions/d1348167-9924-43bc-9489-a5a77d2171d1@ab9dd159-4da4-4a6c-abef-b83a31235fd9
282024-12-21T06:25:12.109ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_7249b8f2-2eaf-4ba7-b868-c638f0109e8c/crucible/regions/d1348167-9924-43bc-9489-a5a77d2171d1", "ab9dd159-4da4-4a6c-abef-b83a31235fd9"]
292024-12-21T06:25:12.120ZINFOcrucible-agent (dropshot): request completed latency_us = 28792 local_addr = [fd00:1122:3344:101::16]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:34585 req_id = a794f5ab-9881-46b3-993f-7c1386cd79df response_code = 200 uri = /crucible/0/regions/d1348167-9924-43bc-9489-a5a77d2171d1/snapshots/ab9dd159-4da4-4a6c-abef-b83a31235fd9
302024-12-21T06:25:12.124ZINFOcrucible-agent (datafile): path is "/data/regions/d1348167-9924-43bc-9489-a5a77d2171d1"
312024-12-21T06:25:12.133ZINFOcrucible-agent (datafile): dataset is oxp_7249b8f2-2eaf-4ba7-b868-c638f0109e8c/crucible/regions/d1348167-9924-43bc-9489-a5a77d2171d1
322024-12-21T06:25:12.141ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_7249b8f2-2eaf-4ba7-b868-c638f0109e8c/crucible/regions/d1348167-9924-43bc-9489-a5a77d2171d1@ab9dd159-4da4-4a6c-abef-b83a31235fd9
332024-12-21T06:25:12.141ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_7249b8f2-2eaf-4ba7-b868-c638f0109e8c/crucible/regions/d1348167-9924-43bc-9489-a5a77d2171d1", "ab9dd159-4da4-4a6c-abef-b83a31235fd9"]
342024-12-21T06:25:12.150ZINFOcrucible-agent (datafile): requesting running snapshot d1348167-9924-43bc-9489-a5a77d2171d1-ab9dd159-4da4-4a6c-abef-b83a31235fd9 state: Requested
352024-12-21T06:25:12.151ZINFOcrucible-agent (worker): applying SMF actions for region d1348167-9924-43bc-9489-a5a77d2171d1 running snapshot ab9dd159-4da4-4a6c-abef-b83a31235fd9 (state Requested)...
362024-12-21T06:25:12.151ZINFOcrucible-agent (dropshot): request completed latency_us = 27283 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:34585 req_id = 63ca2171-6615-429d-be60-ead100c74276 response_code = 200 uri = /crucible/0/regions/d1348167-9924-43bc-9489-a5a77d2171d1/snapshots/ab9dd159-4da4-4a6c-abef-b83a31235fd9/run
372024-12-21T06:25:12.161ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-d1348167-9924-43bc-9489-a5a77d2171d1-ab9dd159-4da4-4a6c-abef-b83a31235fd9
382024-12-21T06:25:12.165ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-d1348167-9924-43bc-9489-a5a77d2171d1-ab9dd159-4da4-4a6c-abef-b83a31235fd9
392024-12-21T06:25:12.178ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-d1348167-9924-43bc-9489-a5a77d2171d1-ab9dd159-4da4-4a6c-abef-b83a31235fd9
402024-12-21T06:25:12.179ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/d1348167-9924-43bc-9489-a5a77d2171d1/.zfs/snapshot/ab9dd159-4da4-4a6c-abef-b83a31235fd9
412024-12-21T06:25:12.179ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
422024-12-21T06:25:12.179ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
432024-12-21T06:25:12.179ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::16
442024-12-21T06:25:12.179ZINFOcrucible-agent (worker): commit
452024-12-21T06:25:12.183ZINFOcrucible-agent (worker): ok!
462024-12-21T06:25:12.189ZINFOcrucible-agent (worker): SMF ok!
472024-12-21T06:25:12.189ZINFOcrucible-agent (datafile): region d1348167-9924-43bc-9489-a5a77d2171d1 running snapshot ab9dd159-4da4-4a6c-abef-b83a31235fd9 state: Requested -> Created
482024-12-21T06:25:12.458ZINFOcrucible-agent (datafile): path is "/data/regions/d1348167-9924-43bc-9489-a5a77d2171d1"
492024-12-21T06:25:12.468ZINFOcrucible-agent (datafile): dataset is oxp_7249b8f2-2eaf-4ba7-b868-c638f0109e8c/crucible/regions/d1348167-9924-43bc-9489-a5a77d2171d1
502024-12-21T06:25:12.478ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_7249b8f2-2eaf-4ba7-b868-c638f0109e8c/crucible/regions/d1348167-9924-43bc-9489-a5a77d2171d1@ab9dd159-4da4-4a6c-abef-b83a31235fd9
512024-12-21T06:25:12.478ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_7249b8f2-2eaf-4ba7-b868-c638f0109e8c/crucible/regions/d1348167-9924-43bc-9489-a5a77d2171d1", "ab9dd159-4da4-4a6c-abef-b83a31235fd9"]
522024-12-21T06:25:12.487ZINFOcrucible-agent (dropshot): request completed latency_us = 28591 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:34585 req_id = 273cd114-6829-4781-ad78-fc31f3399e02 response_code = 200 uri = /crucible/0/regions/d1348167-9924-43bc-9489-a5a77d2171d1/snapshots/ab9dd159-4da4-4a6c-abef-b83a31235fd9/run