Max level shown:
12025-12-17T00:21:58.776ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::16]:32345 remote_addr = [fd00:1122:3344:101::a]:60867
22025-12-17T00:21:58.776ZINFOcrucible-agent (datafile): region 8d9f45f2-aa00-41a5-b5ba-41b0aae8cc0f state: Requested
32025-12-17T00:21:58.777ZINFOcrucible-agent (dropshot): request completed latency_us = 665 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:60867 req_id = eefe395a-e939-45aa-998e-c4d1ca24f0dc response_code = 200 uri = /crucible/0/regions
42025-12-17T00:21:58.777ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
52025-12-17T00:21:58.786ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_4c18a31f-cf25-414c-b0b9-353b91aaccbc/crucible/regions/8d9f45f2-aa00-41a5-b5ba-41b0aae8cc0f
62025-12-17T00:21:58.786ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_4c18a31f-cf25-414c-b0b9-353b91aaccbc/crucible/regions/8d9f45f2-aa00-41a5-b5ba-41b0aae8cc0f
72025-12-17T00:21:58.833ZINFOcrucible-agent (worker): creating region Region { id: RegionId("8d9f45f2-aa00-41a5-b5ba-41b0aae8cc0f"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/8d9f45f2-aa00-41a5-b5ba-41b0aae8cc0f" region = 8d9f45f2-aa00-41a5-b5ba-41b0aae8cc0f
82025-12-17T00:21:58.833ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "8d9f45f2-aa00-41a5-b5ba-41b0aae8cc0f" "--data" "/data/regions/8d9f45f2-aa00-41a5-b5ba-41b0aae8cc0f" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 8d9f45f2-aa00-41a5-b5ba-41b0aae8cc0f
92025-12-17T00:21:58.920ZINFOcrucible-agent (dropshot): request completed latency_us = 55 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:60867 req_id = b1a8d15c-16ad-44a1-b70f-22e64e7882c4 response_code = 200 uri = /crucible/0/regions
102025-12-17T00:21:58.941ZINFOcrucible-agent (worker): region files created ok region = 8d9f45f2-aa00-41a5-b5ba-41b0aae8cc0f
112025-12-17T00:21:58.941ZINFOcrucible-agent (datafile): region 8d9f45f2-aa00-41a5-b5ba-41b0aae8cc0f state: Requested -> Created
122025-12-17T00:21:58.941ZINFOcrucible-agent (worker): applying SMF actions post create...
132025-12-17T00:21:58.941ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-8d9f45f2-aa00-41a5-b5ba-41b0aae8cc0f
142025-12-17T00:21:58.950ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-8d9f45f2-aa00-41a5-b5ba-41b0aae8cc0f
152025-12-17T00:21:58.970ZINFOcrucible-agent (worker): creating config property group
162025-12-17T00:21:58.973ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-8d9f45f2-aa00-41a5-b5ba-41b0aae8cc0f
172025-12-17T00:21:58.973ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/8d9f45f2-aa00-41a5-b5ba-41b0aae8cc0f
182025-12-17T00:21:58.973ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
192025-12-17T00:21:58.973ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::16
202025-12-17T00:21:58.973ZINFOcrucible-agent (worker): commit
212025-12-17T00:21:58.976ZINFOcrucible-agent (worker): ok!
222025-12-17T00:21:58.993ZINFOcrucible-agent (worker): SMF ok!
232025-12-17T00:21:59.464ZINFOcrucible-agent (dropshot): request completed latency_us = 76 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:60867 req_id = 186ebe69-9b37-4031-83b8-2c4055f91755 response_code = 200 uri = /crucible/0/regions
242025-12-17T00:22:00.494ZINFOcrucible-agent (dropshot): request completed latency_us = 68 local_addr = [fd00:1122:3344:101::16]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:60867 req_id = 17c82bec-4cea-4964-affd-0888cfba175e response_code = 200 uri = /crucible/0/regions/ce700e5f-1672-475f-99e5-a0306c0e1c85
252025-12-17T00:22:00.497ZINFOcrucible-agent (datafile): path is "/data/regions/ce700e5f-1672-475f-99e5-a0306c0e1c85"
262025-12-17T00:22:00.504ZINFOcrucible-agent (datafile): dataset is oxp_4c18a31f-cf25-414c-b0b9-353b91aaccbc/crucible/regions/ce700e5f-1672-475f-99e5-a0306c0e1c85
272025-12-17T00:22:00.510ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_4c18a31f-cf25-414c-b0b9-353b91aaccbc/crucible/regions/ce700e5f-1672-475f-99e5-a0306c0e1c85@b06b72a6-bbf9-49d7-9253-c4ffa8bbba75
282025-12-17T00:22:00.510ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_4c18a31f-cf25-414c-b0b9-353b91aaccbc/crucible/regions/ce700e5f-1672-475f-99e5-a0306c0e1c85", "b06b72a6-bbf9-49d7-9253-c4ffa8bbba75"]
292025-12-17T00:22:00.519ZINFOcrucible-agent (dropshot): request completed latency_us = 21646 local_addr = [fd00:1122:3344:101::16]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:60867 req_id = 285fbc79-f6e9-434b-887d-05a3acb03f0a response_code = 200 uri = /crucible/0/regions/ce700e5f-1672-475f-99e5-a0306c0e1c85/snapshots/b06b72a6-bbf9-49d7-9253-c4ffa8bbba75
302025-12-17T00:22:00.522ZINFOcrucible-agent (datafile): path is "/data/regions/ce700e5f-1672-475f-99e5-a0306c0e1c85"
312025-12-17T00:22:00.527ZINFOcrucible-agent (datafile): dataset is oxp_4c18a31f-cf25-414c-b0b9-353b91aaccbc/crucible/regions/ce700e5f-1672-475f-99e5-a0306c0e1c85
322025-12-17T00:22:00.534ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_4c18a31f-cf25-414c-b0b9-353b91aaccbc/crucible/regions/ce700e5f-1672-475f-99e5-a0306c0e1c85@b06b72a6-bbf9-49d7-9253-c4ffa8bbba75
332025-12-17T00:22:00.534ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_4c18a31f-cf25-414c-b0b9-353b91aaccbc/crucible/regions/ce700e5f-1672-475f-99e5-a0306c0e1c85", "b06b72a6-bbf9-49d7-9253-c4ffa8bbba75"]
342025-12-17T00:22:00.540ZINFOcrucible-agent (datafile): requesting running snapshot ce700e5f-1672-475f-99e5-a0306c0e1c85-b06b72a6-bbf9-49d7-9253-c4ffa8bbba75 state: Requested
352025-12-17T00:22:00.541ZINFOcrucible-agent (dropshot): request completed latency_us = 18794 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:60867 req_id = 6fc00e16-1771-4350-9bce-094609b91ccd response_code = 200 uri = /crucible/0/regions/ce700e5f-1672-475f-99e5-a0306c0e1c85/snapshots/b06b72a6-bbf9-49d7-9253-c4ffa8bbba75/run
362025-12-17T00:22:00.541ZINFOcrucible-agent (worker): applying SMF actions for region ce700e5f-1672-475f-99e5-a0306c0e1c85 running snapshot b06b72a6-bbf9-49d7-9253-c4ffa8bbba75 (state Requested)...
372025-12-17T00:22:00.545ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-ce700e5f-1672-475f-99e5-a0306c0e1c85-b06b72a6-bbf9-49d7-9253-c4ffa8bbba75
382025-12-17T00:22:00.553ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-ce700e5f-1672-475f-99e5-a0306c0e1c85-b06b72a6-bbf9-49d7-9253-c4ffa8bbba75
392025-12-17T00:22:00.563ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-ce700e5f-1672-475f-99e5-a0306c0e1c85-b06b72a6-bbf9-49d7-9253-c4ffa8bbba75
402025-12-17T00:22:00.563ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/ce700e5f-1672-475f-99e5-a0306c0e1c85/.zfs/snapshot/b06b72a6-bbf9-49d7-9253-c4ffa8bbba75
412025-12-17T00:22:00.563ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
422025-12-17T00:22:00.563ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
432025-12-17T00:22:00.563ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::16
442025-12-17T00:22:00.563ZINFOcrucible-agent (worker): commit
452025-12-17T00:22:00.567ZINFOcrucible-agent (worker): ok!
462025-12-17T00:22:00.571ZINFOcrucible-agent (worker): SMF ok!
472025-12-17T00:22:00.571ZINFOcrucible-agent (datafile): region ce700e5f-1672-475f-99e5-a0306c0e1c85 running snapshot b06b72a6-bbf9-49d7-9253-c4ffa8bbba75 state: Requested -> Created
482025-12-17T00:22:00.686ZINFOcrucible-agent (datafile): path is "/data/regions/ce700e5f-1672-475f-99e5-a0306c0e1c85"
492025-12-17T00:22:00.692ZINFOcrucible-agent (datafile): dataset is oxp_4c18a31f-cf25-414c-b0b9-353b91aaccbc/crucible/regions/ce700e5f-1672-475f-99e5-a0306c0e1c85
502025-12-17T00:22:00.698ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_4c18a31f-cf25-414c-b0b9-353b91aaccbc/crucible/regions/ce700e5f-1672-475f-99e5-a0306c0e1c85@b06b72a6-bbf9-49d7-9253-c4ffa8bbba75
512025-12-17T00:22:00.698ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_4c18a31f-cf25-414c-b0b9-353b91aaccbc/crucible/regions/ce700e5f-1672-475f-99e5-a0306c0e1c85", "b06b72a6-bbf9-49d7-9253-c4ffa8bbba75"]
522025-12-17T00:22:00.704ZINFOcrucible-agent (dropshot): request completed latency_us = 18689 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:60867 req_id = e3019e0b-05dd-4e17-bac0-a32e05bc3fb1 response_code = 200 uri = /crucible/0/regions/ce700e5f-1672-475f-99e5-a0306c0e1c85/snapshots/b06b72a6-bbf9-49d7-9253-c4ffa8bbba75/run