Max level shown:
12025-07-18T00:02:49.231ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::13]:32345 remote_addr = [fd00:1122:3344:101::a]:64586
22025-07-18T00:02:49.232ZINFOcrucible-agent (datafile): region 5dc8c661-6bb2-4820-bed9-97042b6d78a7 state: Requested
32025-07-18T00:02:49.232ZINFOcrucible-agent (dropshot): request completed latency_us = 732 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:64586 req_id = b9b63eba-45bc-491d-a982-686db6bd7117 response_code = 200 uri = /crucible/0/regions
42025-07-18T00:02:49.232ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
52025-07-18T00:02:49.242ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_b356c724-279f-4863-b8c8-c8b586691770/crucible/regions/5dc8c661-6bb2-4820-bed9-97042b6d78a7
62025-07-18T00:02:49.242ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_b356c724-279f-4863-b8c8-c8b586691770/crucible/regions/5dc8c661-6bb2-4820-bed9-97042b6d78a7
72025-07-18T00:02:49.305ZINFOcrucible-agent (worker): creating region Region { id: RegionId("5dc8c661-6bb2-4820-bed9-97042b6d78a7"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/5dc8c661-6bb2-4820-bed9-97042b6d78a7" region = 5dc8c661-6bb2-4820-bed9-97042b6d78a7
82025-07-18T00:02:49.305ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "5dc8c661-6bb2-4820-bed9-97042b6d78a7" "--data" "/data/regions/5dc8c661-6bb2-4820-bed9-97042b6d78a7" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 5dc8c661-6bb2-4820-bed9-97042b6d78a7
92025-07-18T00:02:49.400ZINFOcrucible-agent (dropshot): request completed latency_us = 70 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:64586 req_id = e8cfd6ed-78b4-4100-8480-dcfdf7df80c4 response_code = 200 uri = /crucible/0/regions
102025-07-18T00:02:49.431ZINFOcrucible-agent (worker): region files created ok region = 5dc8c661-6bb2-4820-bed9-97042b6d78a7
112025-07-18T00:02:49.431ZINFOcrucible-agent (datafile): region 5dc8c661-6bb2-4820-bed9-97042b6d78a7 state: Requested -> Created
122025-07-18T00:02:49.431ZINFOcrucible-agent (worker): applying SMF actions post create...
132025-07-18T00:02:49.449ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-5dc8c661-6bb2-4820-bed9-97042b6d78a7
142025-07-18T00:02:49.459ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-5dc8c661-6bb2-4820-bed9-97042b6d78a7
152025-07-18T00:02:49.482ZINFOcrucible-agent (worker): creating config property group
162025-07-18T00:02:49.488ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-5dc8c661-6bb2-4820-bed9-97042b6d78a7
172025-07-18T00:02:49.489ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/5dc8c661-6bb2-4820-bed9-97042b6d78a7
182025-07-18T00:02:49.489ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
192025-07-18T00:02:49.489ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::13
202025-07-18T00:02:49.489ZINFOcrucible-agent (worker): commit
212025-07-18T00:02:49.497ZINFOcrucible-agent (worker): ok!
222025-07-18T00:02:49.505ZINFOcrucible-agent (worker): SMF ok!
232025-07-18T00:02:50.074ZINFOcrucible-agent (dropshot): request completed latency_us = 47 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:64586 req_id = 6bcfe3b6-4278-4947-8ffc-59aa41f72a98 response_code = 200 uri = /crucible/0/regions
242025-07-18T00:02:51.734ZINFOcrucible-agent (dropshot): request completed latency_us = 4308 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:64586 req_id = 3f0900e3-1b14-40ae-8bd8-a92ce79de029 response_code = 200 uri = /crucible/0/regions/4737ec31-1c42-492b-842d-1fbbcfbbaa0c
252025-07-18T00:02:51.738ZINFOcrucible-agent (datafile): path is "/data/regions/4737ec31-1c42-492b-842d-1fbbcfbbaa0c"
262025-07-18T00:02:51.747ZINFOcrucible-agent (datafile): dataset is oxp_b356c724-279f-4863-b8c8-c8b586691770/crucible/regions/4737ec31-1c42-492b-842d-1fbbcfbbaa0c
272025-07-18T00:02:51.756ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_b356c724-279f-4863-b8c8-c8b586691770/crucible/regions/4737ec31-1c42-492b-842d-1fbbcfbbaa0c@7207834e-00ec-4f28-9a88-84c75a565025
282025-07-18T00:02:51.756ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_b356c724-279f-4863-b8c8-c8b586691770/crucible/regions/4737ec31-1c42-492b-842d-1fbbcfbbaa0c", "7207834e-00ec-4f28-9a88-84c75a565025"]
292025-07-18T00:02:51.766ZINFOcrucible-agent (dropshot): request completed latency_us = 28138 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:64586 req_id = 1390952f-d650-4a12-b6a3-265e772fc8be response_code = 200 uri = /crucible/0/regions/4737ec31-1c42-492b-842d-1fbbcfbbaa0c/snapshots/7207834e-00ec-4f28-9a88-84c75a565025
302025-07-18T00:02:51.770ZINFOcrucible-agent (datafile): path is "/data/regions/4737ec31-1c42-492b-842d-1fbbcfbbaa0c"
312025-07-18T00:02:51.778ZINFOcrucible-agent (datafile): dataset is oxp_b356c724-279f-4863-b8c8-c8b586691770/crucible/regions/4737ec31-1c42-492b-842d-1fbbcfbbaa0c
322025-07-18T00:02:51.785ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_b356c724-279f-4863-b8c8-c8b586691770/crucible/regions/4737ec31-1c42-492b-842d-1fbbcfbbaa0c@7207834e-00ec-4f28-9a88-84c75a565025
332025-07-18T00:02:51.785ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_b356c724-279f-4863-b8c8-c8b586691770/crucible/regions/4737ec31-1c42-492b-842d-1fbbcfbbaa0c", "7207834e-00ec-4f28-9a88-84c75a565025"]
342025-07-18T00:02:51.795ZINFOcrucible-agent (datafile): requesting running snapshot 4737ec31-1c42-492b-842d-1fbbcfbbaa0c-7207834e-00ec-4f28-9a88-84c75a565025 state: Requested
352025-07-18T00:02:51.795ZINFOcrucible-agent (worker): applying SMF actions for region 4737ec31-1c42-492b-842d-1fbbcfbbaa0c running snapshot 7207834e-00ec-4f28-9a88-84c75a565025 (state Requested)...
362025-07-18T00:02:51.795ZINFOcrucible-agent (dropshot): request completed latency_us = 25532 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:64586 req_id = 0860e96e-e834-4624-9685-564040683b07 response_code = 200 uri = /crucible/0/regions/4737ec31-1c42-492b-842d-1fbbcfbbaa0c/snapshots/7207834e-00ec-4f28-9a88-84c75a565025/run
372025-07-18T00:02:51.797ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-4737ec31-1c42-492b-842d-1fbbcfbbaa0c-7207834e-00ec-4f28-9a88-84c75a565025
382025-07-18T00:02:51.809ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-4737ec31-1c42-492b-842d-1fbbcfbbaa0c-7207834e-00ec-4f28-9a88-84c75a565025
392025-07-18T00:02:51.826ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-4737ec31-1c42-492b-842d-1fbbcfbbaa0c-7207834e-00ec-4f28-9a88-84c75a565025
402025-07-18T00:02:51.826ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/4737ec31-1c42-492b-842d-1fbbcfbbaa0c/.zfs/snapshot/7207834e-00ec-4f28-9a88-84c75a565025
412025-07-18T00:02:51.826ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
422025-07-18T00:02:51.826ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
432025-07-18T00:02:51.826ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::13
442025-07-18T00:02:51.826ZINFOcrucible-agent (worker): commit
452025-07-18T00:02:51.832ZINFOcrucible-agent (worker): ok!
462025-07-18T00:02:51.838ZINFOcrucible-agent (worker): SMF ok!
472025-07-18T00:02:51.838ZINFOcrucible-agent (datafile): region 4737ec31-1c42-492b-842d-1fbbcfbbaa0c running snapshot 7207834e-00ec-4f28-9a88-84c75a565025 state: Requested -> Created
482025-07-18T00:02:52.041ZINFOcrucible-agent (datafile): path is "/data/regions/4737ec31-1c42-492b-842d-1fbbcfbbaa0c"
492025-07-18T00:02:52.050ZINFOcrucible-agent (datafile): dataset is oxp_b356c724-279f-4863-b8c8-c8b586691770/crucible/regions/4737ec31-1c42-492b-842d-1fbbcfbbaa0c
502025-07-18T00:02:52.058ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_b356c724-279f-4863-b8c8-c8b586691770/crucible/regions/4737ec31-1c42-492b-842d-1fbbcfbbaa0c@7207834e-00ec-4f28-9a88-84c75a565025
512025-07-18T00:02:52.058ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_b356c724-279f-4863-b8c8-c8b586691770/crucible/regions/4737ec31-1c42-492b-842d-1fbbcfbbaa0c", "7207834e-00ec-4f28-9a88-84c75a565025"]
522025-07-18T00:02:52.067ZINFOcrucible-agent (dropshot): request completed latency_us = 25891 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:64586 req_id = fafe5206-0e57-49d2-ac9d-00ff33289f63 response_code = 200 uri = /crucible/0/regions/4737ec31-1c42-492b-842d-1fbbcfbbaa0c/snapshots/7207834e-00ec-4f28-9a88-84c75a565025/run