Max level shown:
12026-07-27T21:33:39.000ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::19]:32345 remote_addr = [fd00:1122:3344:101::a]:36097
22026-07-27T21:33:39.000ZINFOcrucible-agent (datafile): region c17971aa-4665-4119-add1-dc6a97f77436 state: Requested
32026-07-27T21:33:39.002ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42026-07-27T21:33:39.002ZINFOcrucible-agent (dropshot): request completed latency_us = 1185 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:36097 req_id = 2e1f771d-bf6e-4129-bdea-c3951a3d197f response_code = 200 uri = /crucible/0/regions
52026-07-27T21:33:39.013ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_2d9ae54d-9a03-4ce9-a8dd-e94a94592c55/crucible/regions/c17971aa-4665-4119-add1-dc6a97f77436
62026-07-27T21:33:39.013ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_2d9ae54d-9a03-4ce9-a8dd-e94a94592c55/crucible/regions/c17971aa-4665-4119-add1-dc6a97f77436
72026-07-27T21:33:39.074ZINFOcrucible-agent (worker): creating region Region { id: RegionId("c17971aa-4665-4119-add1-dc6a97f77436"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/c17971aa-4665-4119-add1-dc6a97f77436" region = c17971aa-4665-4119-add1-dc6a97f77436
82026-07-27T21:33:39.074ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "c17971aa-4665-4119-add1-dc6a97f77436" "--data" "/data/regions/c17971aa-4665-4119-add1-dc6a97f77436" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = c17971aa-4665-4119-add1-dc6a97f77436
92026-07-27T21:33:39.182ZINFOcrucible-agent (worker): region files created ok region = c17971aa-4665-4119-add1-dc6a97f77436
102026-07-27T21:33:39.182ZINFOcrucible-agent (datafile): region c17971aa-4665-4119-add1-dc6a97f77436 state: Requested -> Created
112026-07-27T21:33:39.182ZINFOcrucible-agent (worker): applying SMF actions post create...
122026-07-27T21:33:39.191ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-c17971aa-4665-4119-add1-dc6a97f77436
132026-07-27T21:33:39.209ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-c17971aa-4665-4119-add1-dc6a97f77436
142026-07-27T21:33:39.223ZINFOcrucible-agent (worker): creating config property group
152026-07-27T21:33:39.232ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-c17971aa-4665-4119-add1-dc6a97f77436
162026-07-27T21:33:39.232ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/c17971aa-4665-4119-add1-dc6a97f77436
172026-07-27T21:33:39.232ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
182026-07-27T21:33:39.232ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::19
192026-07-27T21:33:39.233ZINFOcrucible-agent (worker): commit
202026-07-27T21:33:39.238ZINFOcrucible-agent (worker): ok!
212026-07-27T21:33:39.245ZINFOcrucible-agent (worker): SMF ok!
222026-07-27T21:33:39.374ZINFOcrucible-agent (dropshot): request completed latency_us = 70 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:36097 req_id = 70e3e0f8-cfaa-4aba-b72d-f312a0ecf93d response_code = 200 uri = /crucible/0/regions
232026-07-27T21:33:40.609ZINFOcrucible-agent (dropshot): request completed latency_us = 56 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:36097 req_id = 2509dfda-2a9b-4b7f-96c7-30ad65847020 response_code = 200 uri = /crucible/0/regions/3047b7bd-1e2e-4fbc-9bb2-53760945eaf3
242026-07-27T21:33:40.613ZINFOcrucible-agent (datafile): path is "/data/regions/3047b7bd-1e2e-4fbc-9bb2-53760945eaf3"
252026-07-27T21:33:40.619ZINFOcrucible-agent (datafile): dataset is oxp_2d9ae54d-9a03-4ce9-a8dd-e94a94592c55/crucible/regions/3047b7bd-1e2e-4fbc-9bb2-53760945eaf3
262026-07-27T21:33:40.624ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_2d9ae54d-9a03-4ce9-a8dd-e94a94592c55/crucible/regions/3047b7bd-1e2e-4fbc-9bb2-53760945eaf3@5069d17c-78d6-4c7d-8b94-c2d5aeb08e75
272026-07-27T21:33:40.624ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_2d9ae54d-9a03-4ce9-a8dd-e94a94592c55/crucible/regions/3047b7bd-1e2e-4fbc-9bb2-53760945eaf3", "5069d17c-78d6-4c7d-8b94-c2d5aeb08e75"]
282026-07-27T21:33:40.635ZINFOcrucible-agent (dropshot): request completed latency_us = 22633 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:36097 req_id = 37e9fa33-986d-41f0-b107-8df8f5c46501 response_code = 200 uri = /crucible/0/regions/3047b7bd-1e2e-4fbc-9bb2-53760945eaf3/snapshots/5069d17c-78d6-4c7d-8b94-c2d5aeb08e75
292026-07-27T21:33:40.639ZINFOcrucible-agent (datafile): path is "/data/regions/3047b7bd-1e2e-4fbc-9bb2-53760945eaf3"
302026-07-27T21:33:40.645ZINFOcrucible-agent (datafile): dataset is oxp_2d9ae54d-9a03-4ce9-a8dd-e94a94592c55/crucible/regions/3047b7bd-1e2e-4fbc-9bb2-53760945eaf3
312026-07-27T21:33:40.651ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_2d9ae54d-9a03-4ce9-a8dd-e94a94592c55/crucible/regions/3047b7bd-1e2e-4fbc-9bb2-53760945eaf3@5069d17c-78d6-4c7d-8b94-c2d5aeb08e75
322026-07-27T21:33:40.651ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_2d9ae54d-9a03-4ce9-a8dd-e94a94592c55/crucible/regions/3047b7bd-1e2e-4fbc-9bb2-53760945eaf3", "5069d17c-78d6-4c7d-8b94-c2d5aeb08e75"]
332026-07-27T21:33:40.658ZINFOcrucible-agent (datafile): requesting running snapshot 3047b7bd-1e2e-4fbc-9bb2-53760945eaf3-5069d17c-78d6-4c7d-8b94-c2d5aeb08e75 state: Requested
342026-07-27T21:33:40.660ZINFOcrucible-agent (worker): applying SMF actions for region 3047b7bd-1e2e-4fbc-9bb2-53760945eaf3 running snapshot 5069d17c-78d6-4c7d-8b94-c2d5aeb08e75 (state Requested)...
352026-07-27T21:33:40.660ZINFOcrucible-agent (dropshot): request completed latency_us = 21815 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:36097 req_id = 1b5ee937-a88f-4276-b1bc-df0ad56d3534 response_code = 200 uri = /crucible/0/regions/3047b7bd-1e2e-4fbc-9bb2-53760945eaf3/snapshots/5069d17c-78d6-4c7d-8b94-c2d5aeb08e75/run
362026-07-27T21:33:40.666ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-3047b7bd-1e2e-4fbc-9bb2-53760945eaf3-5069d17c-78d6-4c7d-8b94-c2d5aeb08e75
372026-07-27T21:33:40.671ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-3047b7bd-1e2e-4fbc-9bb2-53760945eaf3-5069d17c-78d6-4c7d-8b94-c2d5aeb08e75
382026-07-27T21:33:40.686ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-3047b7bd-1e2e-4fbc-9bb2-53760945eaf3-5069d17c-78d6-4c7d-8b94-c2d5aeb08e75
392026-07-27T21:33:40.687ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/3047b7bd-1e2e-4fbc-9bb2-53760945eaf3/.zfs/snapshot/5069d17c-78d6-4c7d-8b94-c2d5aeb08e75
402026-07-27T21:33:40.687ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
412026-07-27T21:33:40.687ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
422026-07-27T21:33:40.687ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::19
432026-07-27T21:33:40.687ZINFOcrucible-agent (worker): commit
442026-07-27T21:33:40.691ZINFOcrucible-agent (worker): ok!
452026-07-27T21:33:40.698ZINFOcrucible-agent (worker): SMF ok!
462026-07-27T21:33:40.698ZINFOcrucible-agent (datafile): region 3047b7bd-1e2e-4fbc-9bb2-53760945eaf3 running snapshot 5069d17c-78d6-4c7d-8b94-c2d5aeb08e75 state: Requested -> Created
472026-07-27T21:33:41.022ZINFOcrucible-agent (datafile): path is "/data/regions/3047b7bd-1e2e-4fbc-9bb2-53760945eaf3"
482026-07-27T21:33:41.029ZINFOcrucible-agent (datafile): dataset is oxp_2d9ae54d-9a03-4ce9-a8dd-e94a94592c55/crucible/regions/3047b7bd-1e2e-4fbc-9bb2-53760945eaf3
492026-07-27T21:33:41.034ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_2d9ae54d-9a03-4ce9-a8dd-e94a94592c55/crucible/regions/3047b7bd-1e2e-4fbc-9bb2-53760945eaf3@5069d17c-78d6-4c7d-8b94-c2d5aeb08e75
502026-07-27T21:33:41.034ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_2d9ae54d-9a03-4ce9-a8dd-e94a94592c55/crucible/regions/3047b7bd-1e2e-4fbc-9bb2-53760945eaf3", "5069d17c-78d6-4c7d-8b94-c2d5aeb08e75"]
512026-07-27T21:33:41.039ZINFOcrucible-agent (dropshot): request completed latency_us = 16730 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:36097 req_id = 426bd2fd-a129-42ac-b59e-403bdf8f6da9 response_code = 200 uri = /crucible/0/regions/3047b7bd-1e2e-4fbc-9bb2-53760945eaf3/snapshots/5069d17c-78d6-4c7d-8b94-c2d5aeb08e75/run