Max level shown:
12025-06-18T18:47:20.629ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::17]:32345 remote_addr = [fd00:1122:3344:101::c]:34141
22025-06-18T18:47:20.629ZINFOcrucible-agent (datafile): region 36c30173-0888-415c-91db-db6d368c0557 state: Requested
32025-06-18T18:47:20.629ZINFOcrucible-agent (dropshot): request completed latency_us = 573 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:34141 req_id = 8bd1e267-3a7f-47fd-b331-fee3040b6d6a response_code = 200 uri = /crucible/0/regions
42025-06-18T18:47:20.629ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
52025-06-18T18:47:20.641ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_da97d3e8-e9df-44a1-9287-82e50ef8a6d1/crucible/regions/36c30173-0888-415c-91db-db6d368c0557
62025-06-18T18:47:20.641ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_da97d3e8-e9df-44a1-9287-82e50ef8a6d1/crucible/regions/36c30173-0888-415c-91db-db6d368c0557
72025-06-18T18:47:20.697ZINFOcrucible-agent (worker): creating region Region { id: RegionId("36c30173-0888-415c-91db-db6d368c0557"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/36c30173-0888-415c-91db-db6d368c0557" region = 36c30173-0888-415c-91db-db6d368c0557
82025-06-18T18:47:20.697ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "36c30173-0888-415c-91db-db6d368c0557" "--data" "/data/regions/36c30173-0888-415c-91db-db6d368c0557" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 36c30173-0888-415c-91db-db6d368c0557
92025-06-18T18:47:20.834ZINFOcrucible-agent (worker): region files created ok region = 36c30173-0888-415c-91db-db6d368c0557
102025-06-18T18:47:20.834ZINFOcrucible-agent (datafile): region 36c30173-0888-415c-91db-db6d368c0557 state: Requested -> Created
112025-06-18T18:47:20.834ZINFOcrucible-agent (worker): applying SMF actions post create...
122025-06-18T18:47:20.835ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-36c30173-0888-415c-91db-db6d368c0557
132025-06-18T18:47:20.854ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-36c30173-0888-415c-91db-db6d368c0557
142025-06-18T18:47:20.858ZINFOcrucible-agent (dropshot): request completed latency_us = 63 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:34141 req_id = 6811319c-e098-464c-a093-1612bab5da4d response_code = 200 uri = /crucible/0/regions
152025-06-18T18:47:20.875ZINFOcrucible-agent (worker): creating config property group
162025-06-18T18:47:20.878ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-36c30173-0888-415c-91db-db6d368c0557
172025-06-18T18:47:20.878ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/36c30173-0888-415c-91db-db6d368c0557
182025-06-18T18:47:20.878ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
192025-06-18T18:47:20.878ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::17
202025-06-18T18:47:20.878ZINFOcrucible-agent (worker): commit
212025-06-18T18:47:20.882ZINFOcrucible-agent (worker): ok!
222025-06-18T18:47:20.889ZINFOcrucible-agent (worker): SMF ok!
232025-06-18T18:47:22.322ZINFOcrucible-agent (dropshot): request completed latency_us = 45 local_addr = [fd00:1122:3344:101::17]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:34141 req_id = 0981e4c9-3ae7-4453-bbab-b30a6fa6eb6f response_code = 200 uri = /crucible/0/regions/cded1907-8763-4d17-aa44-1cc37dff5eec
242025-06-18T18:47:22.326ZINFOcrucible-agent (datafile): path is "/data/regions/cded1907-8763-4d17-aa44-1cc37dff5eec"
252025-06-18T18:47:22.335ZINFOcrucible-agent (datafile): dataset is oxp_da97d3e8-e9df-44a1-9287-82e50ef8a6d1/crucible/regions/cded1907-8763-4d17-aa44-1cc37dff5eec
262025-06-18T18:47:22.343ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_da97d3e8-e9df-44a1-9287-82e50ef8a6d1/crucible/regions/cded1907-8763-4d17-aa44-1cc37dff5eec@07652c4e-2ccb-4986-9ce0-aa54daa031c9
272025-06-18T18:47:22.343ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_da97d3e8-e9df-44a1-9287-82e50ef8a6d1/crucible/regions/cded1907-8763-4d17-aa44-1cc37dff5eec", "07652c4e-2ccb-4986-9ce0-aa54daa031c9"]
282025-06-18T18:47:22.355ZINFOcrucible-agent (dropshot): request completed latency_us = 29327 local_addr = [fd00:1122:3344:101::17]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:34141 req_id = 59360bbb-02e7-489c-a1d0-fd6a0fad62a2 response_code = 200 uri = /crucible/0/regions/cded1907-8763-4d17-aa44-1cc37dff5eec/snapshots/07652c4e-2ccb-4986-9ce0-aa54daa031c9
292025-06-18T18:47:22.358ZINFOcrucible-agent (datafile): path is "/data/regions/cded1907-8763-4d17-aa44-1cc37dff5eec"
302025-06-18T18:47:22.366ZINFOcrucible-agent (datafile): dataset is oxp_da97d3e8-e9df-44a1-9287-82e50ef8a6d1/crucible/regions/cded1907-8763-4d17-aa44-1cc37dff5eec
312025-06-18T18:47:22.375ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_da97d3e8-e9df-44a1-9287-82e50ef8a6d1/crucible/regions/cded1907-8763-4d17-aa44-1cc37dff5eec@07652c4e-2ccb-4986-9ce0-aa54daa031c9
322025-06-18T18:47:22.375ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_da97d3e8-e9df-44a1-9287-82e50ef8a6d1/crucible/regions/cded1907-8763-4d17-aa44-1cc37dff5eec", "07652c4e-2ccb-4986-9ce0-aa54daa031c9"]
332025-06-18T18:47:22.385ZINFOcrucible-agent (datafile): requesting running snapshot cded1907-8763-4d17-aa44-1cc37dff5eec-07652c4e-2ccb-4986-9ce0-aa54daa031c9 state: Requested
342025-06-18T18:47:22.385ZINFOcrucible-agent (worker): applying SMF actions for region cded1907-8763-4d17-aa44-1cc37dff5eec running snapshot 07652c4e-2ccb-4986-9ce0-aa54daa031c9 (state Requested)...
352025-06-18T18:47:22.385ZINFOcrucible-agent (dropshot): request completed latency_us = 27213 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:34141 req_id = 32892f54-4884-456d-8322-404a899c9130 response_code = 200 uri = /crucible/0/regions/cded1907-8763-4d17-aa44-1cc37dff5eec/snapshots/07652c4e-2ccb-4986-9ce0-aa54daa031c9/run
362025-06-18T18:47:22.388ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-cded1907-8763-4d17-aa44-1cc37dff5eec-07652c4e-2ccb-4986-9ce0-aa54daa031c9
372025-06-18T18:47:22.395ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-cded1907-8763-4d17-aa44-1cc37dff5eec-07652c4e-2ccb-4986-9ce0-aa54daa031c9
382025-06-18T18:47:22.406ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-cded1907-8763-4d17-aa44-1cc37dff5eec-07652c4e-2ccb-4986-9ce0-aa54daa031c9
392025-06-18T18:47:22.406ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/cded1907-8763-4d17-aa44-1cc37dff5eec/.zfs/snapshot/07652c4e-2ccb-4986-9ce0-aa54daa031c9
402025-06-18T18:47:22.406ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
412025-06-18T18:47:22.406ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
422025-06-18T18:47:22.406ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::17
432025-06-18T18:47:22.407ZINFOcrucible-agent (worker): commit
442025-06-18T18:47:22.410ZINFOcrucible-agent (worker): ok!
452025-06-18T18:47:22.415ZINFOcrucible-agent (worker): SMF ok!
462025-06-18T18:47:22.415ZINFOcrucible-agent (datafile): region cded1907-8763-4d17-aa44-1cc37dff5eec running snapshot 07652c4e-2ccb-4986-9ce0-aa54daa031c9 state: Requested -> Created
472025-06-18T18:47:22.640ZINFOcrucible-agent (datafile): path is "/data/regions/cded1907-8763-4d17-aa44-1cc37dff5eec"
482025-06-18T18:47:22.650ZINFOcrucible-agent (datafile): dataset is oxp_da97d3e8-e9df-44a1-9287-82e50ef8a6d1/crucible/regions/cded1907-8763-4d17-aa44-1cc37dff5eec
492025-06-18T18:47:22.659ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_da97d3e8-e9df-44a1-9287-82e50ef8a6d1/crucible/regions/cded1907-8763-4d17-aa44-1cc37dff5eec@07652c4e-2ccb-4986-9ce0-aa54daa031c9
502025-06-18T18:47:22.659ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_da97d3e8-e9df-44a1-9287-82e50ef8a6d1/crucible/regions/cded1907-8763-4d17-aa44-1cc37dff5eec", "07652c4e-2ccb-4986-9ce0-aa54daa031c9"]
512025-06-18T18:47:22.679ZINFOcrucible-agent (dropshot): request completed latency_us = 38982 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:34141 req_id = 4833cf8b-0d3c-4b45-b781-847eb0d1246d response_code = 200 uri = /crucible/0/regions/cded1907-8763-4d17-aa44-1cc37dff5eec/snapshots/07652c4e-2ccb-4986-9ce0-aa54daa031c9/run