Max level shown:
12026-08-17T20:51:28.642ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::18]:32345 remote_addr = [fd00:1122:3344:101::c]:62594
22026-08-17T20:51:28.642ZINFOcrucible-agent (datafile): region e5074d32-36d9-47a3-8417-8cd40d2c26e2 state: Requested
32026-08-17T20:51:28.643ZINFOcrucible-agent (dropshot): request completed latency_us = 1096 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:62594 req_id = 42d81323-8456-4215-82b3-d6e0c05df2d3 response_code = 200 uri = /crucible/0/regions
42026-08-17T20:51:28.643ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
52026-08-17T20:51:28.651ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_6c511a83-50ad-4482-aad3-95c3408ac723/crucible/regions/e5074d32-36d9-47a3-8417-8cd40d2c26e2
62026-08-17T20:51:28.651ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_6c511a83-50ad-4482-aad3-95c3408ac723/crucible/regions/e5074d32-36d9-47a3-8417-8cd40d2c26e2
72026-08-17T20:51:28.691ZINFOcrucible-agent (worker): creating region Region { id: RegionId("e5074d32-36d9-47a3-8417-8cd40d2c26e2"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/e5074d32-36d9-47a3-8417-8cd40d2c26e2" region = e5074d32-36d9-47a3-8417-8cd40d2c26e2
82026-08-17T20:51:28.691ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "e5074d32-36d9-47a3-8417-8cd40d2c26e2" "--data" "/data/regions/e5074d32-36d9-47a3-8417-8cd40d2c26e2" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = e5074d32-36d9-47a3-8417-8cd40d2c26e2
92026-08-17T20:51:28.741ZINFOcrucible-agent (worker): region files created ok region = e5074d32-36d9-47a3-8417-8cd40d2c26e2
102026-08-17T20:51:28.741ZINFOcrucible-agent (datafile): region e5074d32-36d9-47a3-8417-8cd40d2c26e2 state: Requested -> Created
112026-08-17T20:51:28.741ZINFOcrucible-agent (worker): applying SMF actions post create...
122026-08-17T20:51:28.748ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-e5074d32-36d9-47a3-8417-8cd40d2c26e2
132026-08-17T20:51:28.751ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-e5074d32-36d9-47a3-8417-8cd40d2c26e2
142026-08-17T20:51:28.758ZINFOcrucible-agent (worker): creating config property group
152026-08-17T20:51:28.760ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-e5074d32-36d9-47a3-8417-8cd40d2c26e2
162026-08-17T20:51:28.761ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/e5074d32-36d9-47a3-8417-8cd40d2c26e2
172026-08-17T20:51:28.761ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
182026-08-17T20:51:28.761ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::18
192026-08-17T20:51:28.761ZINFOcrucible-agent (worker): commit
202026-08-17T20:51:28.763ZINFOcrucible-agent (worker): ok!
212026-08-17T20:51:28.767ZINFOcrucible-agent (worker): SMF ok!
222026-08-17T20:51:28.832ZINFOcrucible-agent (dropshot): request completed latency_us = 79 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:62594 req_id = 5d385604-6ff6-43c1-a875-b002bf22ba57 response_code = 200 uri = /crucible/0/regions
232026-08-17T20:51:29.786ZINFOcrucible-agent (dropshot): request completed latency_us = 70 local_addr = [fd00:1122:3344:101::18]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:62594 req_id = e7c983bc-5c87-4bbb-b742-ef688cf69e46 response_code = 200 uri = /crucible/0/regions/8bf19f57-90bd-4a02-81d3-07224b64e470
242026-08-17T20:51:29.791ZINFOcrucible-agent (datafile): path is "/data/regions/8bf19f57-90bd-4a02-81d3-07224b64e470"
252026-08-17T20:51:29.797ZINFOcrucible-agent (datafile): dataset is oxp_6c511a83-50ad-4482-aad3-95c3408ac723/crucible/regions/8bf19f57-90bd-4a02-81d3-07224b64e470
262026-08-17T20:51:29.804ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_6c511a83-50ad-4482-aad3-95c3408ac723/crucible/regions/8bf19f57-90bd-4a02-81d3-07224b64e470@be14df08-f243-4141-a440-9084bc8e06c6
272026-08-17T20:51:29.804ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_6c511a83-50ad-4482-aad3-95c3408ac723/crucible/regions/8bf19f57-90bd-4a02-81d3-07224b64e470", "be14df08-f243-4141-a440-9084bc8e06c6"]
282026-08-17T20:51:29.816ZINFOcrucible-agent (dropshot): request completed latency_us = 24419 local_addr = [fd00:1122:3344:101::18]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:62594 req_id = a64f3a6c-653c-4543-a5a1-ca2ad3497002 response_code = 200 uri = /crucible/0/regions/8bf19f57-90bd-4a02-81d3-07224b64e470/snapshots/be14df08-f243-4141-a440-9084bc8e06c6
292026-08-17T20:51:29.824ZINFOcrucible-agent (datafile): path is "/data/regions/8bf19f57-90bd-4a02-81d3-07224b64e470"
302026-08-17T20:51:29.829ZINFOcrucible-agent (datafile): dataset is oxp_6c511a83-50ad-4482-aad3-95c3408ac723/crucible/regions/8bf19f57-90bd-4a02-81d3-07224b64e470
312026-08-17T20:51:29.836ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_6c511a83-50ad-4482-aad3-95c3408ac723/crucible/regions/8bf19f57-90bd-4a02-81d3-07224b64e470@be14df08-f243-4141-a440-9084bc8e06c6
322026-08-17T20:51:29.836ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_6c511a83-50ad-4482-aad3-95c3408ac723/crucible/regions/8bf19f57-90bd-4a02-81d3-07224b64e470", "be14df08-f243-4141-a440-9084bc8e06c6"]
332026-08-17T20:51:29.842ZINFOcrucible-agent (datafile): requesting running snapshot 8bf19f57-90bd-4a02-81d3-07224b64e470-be14df08-f243-4141-a440-9084bc8e06c6 state: Requested
342026-08-17T20:51:29.847ZINFOcrucible-agent (worker): applying SMF actions for region 8bf19f57-90bd-4a02-81d3-07224b64e470 running snapshot be14df08-f243-4141-a440-9084bc8e06c6 (state Requested)...
352026-08-17T20:51:29.847ZINFOcrucible-agent (dropshot): request completed latency_us = 23352 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:62594 req_id = eed60a89-c617-46c6-8148-f0c280c6a081 response_code = 200 uri = /crucible/0/regions/8bf19f57-90bd-4a02-81d3-07224b64e470/snapshots/be14df08-f243-4141-a440-9084bc8e06c6/run
362026-08-17T20:51:29.849ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-8bf19f57-90bd-4a02-81d3-07224b64e470-be14df08-f243-4141-a440-9084bc8e06c6
372026-08-17T20:51:29.858ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-8bf19f57-90bd-4a02-81d3-07224b64e470-be14df08-f243-4141-a440-9084bc8e06c6
382026-08-17T20:51:29.863ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-8bf19f57-90bd-4a02-81d3-07224b64e470-be14df08-f243-4141-a440-9084bc8e06c6
392026-08-17T20:51:29.864ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/8bf19f57-90bd-4a02-81d3-07224b64e470/.zfs/snapshot/be14df08-f243-4141-a440-9084bc8e06c6
402026-08-17T20:51:29.864ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
412026-08-17T20:51:29.864ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
422026-08-17T20:51:29.864ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::18
432026-08-17T20:51:29.864ZINFOcrucible-agent (worker): commit
442026-08-17T20:51:29.866ZINFOcrucible-agent (worker): ok!
452026-08-17T20:51:29.868ZINFOcrucible-agent (worker): SMF ok!
462026-08-17T20:51:29.868ZINFOcrucible-agent (datafile): region 8bf19f57-90bd-4a02-81d3-07224b64e470 running snapshot be14df08-f243-4141-a440-9084bc8e06c6 state: Requested -> Created
472026-08-17T20:51:30.056ZINFOcrucible-agent (datafile): path is "/data/regions/8bf19f57-90bd-4a02-81d3-07224b64e470"
482026-08-17T20:51:30.063ZINFOcrucible-agent (datafile): dataset is oxp_6c511a83-50ad-4482-aad3-95c3408ac723/crucible/regions/8bf19f57-90bd-4a02-81d3-07224b64e470
492026-08-17T20:51:30.067ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_6c511a83-50ad-4482-aad3-95c3408ac723/crucible/regions/8bf19f57-90bd-4a02-81d3-07224b64e470@be14df08-f243-4141-a440-9084bc8e06c6
502026-08-17T20:51:30.068ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_6c511a83-50ad-4482-aad3-95c3408ac723/crucible/regions/8bf19f57-90bd-4a02-81d3-07224b64e470", "be14df08-f243-4141-a440-9084bc8e06c6"]
512026-08-17T20:51:30.074ZINFOcrucible-agent (dropshot): request completed latency_us = 17796 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:62594 req_id = 1ae35475-44ec-4874-9be2-0a02999f359e response_code = 200 uri = /crucible/0/regions/8bf19f57-90bd-4a02-81d3-07224b64e470/snapshots/be14df08-f243-4141-a440-9084bc8e06c6/run