Max level shown:
12025-12-16T01:30:15.141ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::16]:32345 remote_addr = [fd00:1122:3344:101::b]:50219
22025-12-16T01:30:15.142ZINFOcrucible-agent (datafile): region 010f8830-8eef-4cf3-9f66-cfae525cddeb state: Requested
32025-12-16T01:30:15.142ZINFOcrucible-agent (dropshot): request completed latency_us = 789 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:50219 req_id = b4dccfab-440f-424b-9121-0b691be00e31 response_code = 200 uri = /crucible/0/regions
42025-12-16T01:30:15.142ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
52025-12-16T01:30:15.152ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_22af9caf-ba33-407d-a880-63bd94d83fad/crucible/regions/010f8830-8eef-4cf3-9f66-cfae525cddeb
62025-12-16T01:30:15.152ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_22af9caf-ba33-407d-a880-63bd94d83fad/crucible/regions/010f8830-8eef-4cf3-9f66-cfae525cddeb
72025-12-16T01:30:15.222ZINFOcrucible-agent (worker): creating region Region { id: RegionId("010f8830-8eef-4cf3-9f66-cfae525cddeb"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/010f8830-8eef-4cf3-9f66-cfae525cddeb" region = 010f8830-8eef-4cf3-9f66-cfae525cddeb
82025-12-16T01:30:15.222ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "010f8830-8eef-4cf3-9f66-cfae525cddeb" "--data" "/data/regions/010f8830-8eef-4cf3-9f66-cfae525cddeb" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 010f8830-8eef-4cf3-9f66-cfae525cddeb
92025-12-16T01:30:15.375ZINFOcrucible-agent (worker): region files created ok region = 010f8830-8eef-4cf3-9f66-cfae525cddeb
102025-12-16T01:30:15.376ZINFOcrucible-agent (datafile): region 010f8830-8eef-4cf3-9f66-cfae525cddeb state: Requested -> Created
112025-12-16T01:30:15.376ZINFOcrucible-agent (worker): applying SMF actions post create...
122025-12-16T01:30:15.376ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-010f8830-8eef-4cf3-9f66-cfae525cddeb
132025-12-16T01:30:15.385ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-010f8830-8eef-4cf3-9f66-cfae525cddeb
142025-12-16T01:30:15.386ZINFOcrucible-agent (dropshot): request completed latency_us = 61 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:50219 req_id = 7a1eeefe-c008-44e5-afce-e22675afd954 response_code = 200 uri = /crucible/0/regions
152025-12-16T01:30:15.416ZINFOcrucible-agent (worker): creating config property group
162025-12-16T01:30:15.422ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-010f8830-8eef-4cf3-9f66-cfae525cddeb
172025-12-16T01:30:15.423ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/010f8830-8eef-4cf3-9f66-cfae525cddeb
182025-12-16T01:30:15.423ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
192025-12-16T01:30:15.423ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::16
202025-12-16T01:30:15.423ZINFOcrucible-agent (worker): commit
212025-12-16T01:30:15.427ZINFOcrucible-agent (worker): ok!
222025-12-16T01:30:15.450ZINFOcrucible-agent (worker): SMF ok!
232025-12-16T01:30:16.978ZINFOcrucible-agent (dropshot): request completed latency_us = 70 local_addr = [fd00:1122:3344:101::16]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:50219 req_id = 0034acb6-d628-45b5-a98c-e42f2ad6a436 response_code = 200 uri = /crucible/0/regions/2d7feda0-4668-4337-a15e-114bfb74f375
242025-12-16T01:30:16.981ZINFOcrucible-agent (datafile): path is "/data/regions/2d7feda0-4668-4337-a15e-114bfb74f375"
252025-12-16T01:30:16.987ZINFOcrucible-agent (datafile): dataset is oxp_22af9caf-ba33-407d-a880-63bd94d83fad/crucible/regions/2d7feda0-4668-4337-a15e-114bfb74f375
262025-12-16T01:30:16.992ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_22af9caf-ba33-407d-a880-63bd94d83fad/crucible/regions/2d7feda0-4668-4337-a15e-114bfb74f375@69ee641d-46fa-4463-9679-45c444bb2964
272025-12-16T01:30:16.992ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_22af9caf-ba33-407d-a880-63bd94d83fad/crucible/regions/2d7feda0-4668-4337-a15e-114bfb74f375", "69ee641d-46fa-4463-9679-45c444bb2964"]
282025-12-16T01:30:17.001ZINFOcrucible-agent (dropshot): request completed latency_us = 19692 local_addr = [fd00:1122:3344:101::16]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:50219 req_id = 18984363-a637-490d-b048-cd6652771583 response_code = 200 uri = /crucible/0/regions/2d7feda0-4668-4337-a15e-114bfb74f375/snapshots/69ee641d-46fa-4463-9679-45c444bb2964
292025-12-16T01:30:17.005ZINFOcrucible-agent (datafile): path is "/data/regions/2d7feda0-4668-4337-a15e-114bfb74f375"
302025-12-16T01:30:17.011ZINFOcrucible-agent (datafile): dataset is oxp_22af9caf-ba33-407d-a880-63bd94d83fad/crucible/regions/2d7feda0-4668-4337-a15e-114bfb74f375
312025-12-16T01:30:17.017ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_22af9caf-ba33-407d-a880-63bd94d83fad/crucible/regions/2d7feda0-4668-4337-a15e-114bfb74f375@69ee641d-46fa-4463-9679-45c444bb2964
322025-12-16T01:30:17.017ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_22af9caf-ba33-407d-a880-63bd94d83fad/crucible/regions/2d7feda0-4668-4337-a15e-114bfb74f375", "69ee641d-46fa-4463-9679-45c444bb2964"]
332025-12-16T01:30:17.025ZINFOcrucible-agent (datafile): requesting running snapshot 2d7feda0-4668-4337-a15e-114bfb74f375-69ee641d-46fa-4463-9679-45c444bb2964 state: Requested
342025-12-16T01:30:17.025ZINFOcrucible-agent (dropshot): request completed latency_us = 20427 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:50219 req_id = 1329b34d-6efd-4f94-8ccc-939a314e3456 response_code = 200 uri = /crucible/0/regions/2d7feda0-4668-4337-a15e-114bfb74f375/snapshots/69ee641d-46fa-4463-9679-45c444bb2964/run
352025-12-16T01:30:17.025ZINFOcrucible-agent (worker): applying SMF actions for region 2d7feda0-4668-4337-a15e-114bfb74f375 running snapshot 69ee641d-46fa-4463-9679-45c444bb2964 (state Requested)...
362025-12-16T01:30:17.029ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-2d7feda0-4668-4337-a15e-114bfb74f375-69ee641d-46fa-4463-9679-45c444bb2964
372025-12-16T01:30:17.038ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-2d7feda0-4668-4337-a15e-114bfb74f375-69ee641d-46fa-4463-9679-45c444bb2964
382025-12-16T01:30:17.056ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-2d7feda0-4668-4337-a15e-114bfb74f375-69ee641d-46fa-4463-9679-45c444bb2964
392025-12-16T01:30:17.056ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/2d7feda0-4668-4337-a15e-114bfb74f375/.zfs/snapshot/69ee641d-46fa-4463-9679-45c444bb2964
402025-12-16T01:30:17.056ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
412025-12-16T01:30:17.056ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
422025-12-16T01:30:17.056ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::16
432025-12-16T01:30:17.056ZINFOcrucible-agent (worker): commit
442025-12-16T01:30:17.061ZINFOcrucible-agent (worker): ok!
452025-12-16T01:30:17.069ZINFOcrucible-agent (worker): SMF ok!
462025-12-16T01:30:17.069ZINFOcrucible-agent (datafile): region 2d7feda0-4668-4337-a15e-114bfb74f375 running snapshot 69ee641d-46fa-4463-9679-45c444bb2964 state: Requested -> Created
472025-12-16T01:30:17.386ZINFOcrucible-agent (datafile): path is "/data/regions/2d7feda0-4668-4337-a15e-114bfb74f375"
482025-12-16T01:30:17.392ZINFOcrucible-agent (datafile): dataset is oxp_22af9caf-ba33-407d-a880-63bd94d83fad/crucible/regions/2d7feda0-4668-4337-a15e-114bfb74f375
492025-12-16T01:30:17.397ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_22af9caf-ba33-407d-a880-63bd94d83fad/crucible/regions/2d7feda0-4668-4337-a15e-114bfb74f375@69ee641d-46fa-4463-9679-45c444bb2964
502025-12-16T01:30:17.397ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_22af9caf-ba33-407d-a880-63bd94d83fad/crucible/regions/2d7feda0-4668-4337-a15e-114bfb74f375", "69ee641d-46fa-4463-9679-45c444bb2964"]
512025-12-16T01:30:17.402ZINFOcrucible-agent (dropshot): request completed latency_us = 15753 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:50219 req_id = 62be4f75-a11b-4e1b-a67d-82ad497f718b response_code = 200 uri = /crucible/0/regions/2d7feda0-4668-4337-a15e-114bfb74f375/snapshots/69ee641d-46fa-4463-9679-45c444bb2964/run