Max level shown:
12025-02-28T02:20:24.435ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::1a]:32345 remote_addr = [fd00:1122:3344:101::a]:43992
22025-02-28T02:20:24.435ZINFOcrucible-agent (datafile): region 7bbed3a2-b054-4b1f-9d55-b40acc0d332a state: Requested
32025-02-28T02:20:24.436ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42025-02-28T02:20:24.436ZINFOcrucible-agent (dropshot): request completed latency_us = 657 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:43992 req_id = 79eb8e80-2fd4-4cd4-8557-627686f8d173 response_code = 200 uri = /crucible/0/regions
52025-02-28T02:20:24.449ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_cbba9e4a-2c5a-45f6-a2bf-a3a7a30df21e/crucible/regions/7bbed3a2-b054-4b1f-9d55-b40acc0d332a
62025-02-28T02:20:24.449ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_cbba9e4a-2c5a-45f6-a2bf-a3a7a30df21e/crucible/regions/7bbed3a2-b054-4b1f-9d55-b40acc0d332a
72025-02-28T02:20:24.518ZINFOcrucible-agent (worker): creating region Region { id: RegionId("7bbed3a2-b054-4b1f-9d55-b40acc0d332a"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/7bbed3a2-b054-4b1f-9d55-b40acc0d332a" region = 7bbed3a2-b054-4b1f-9d55-b40acc0d332a
82025-02-28T02:20:24.520ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "7bbed3a2-b054-4b1f-9d55-b40acc0d332a" "--data" "/data/regions/7bbed3a2-b054-4b1f-9d55-b40acc0d332a" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 7bbed3a2-b054-4b1f-9d55-b40acc0d332a
92025-02-28T02:20:24.604ZINFOcrucible-agent (dropshot): request completed latency_us = 88 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:43992 req_id = a5aa26ba-0638-4d16-b090-8fefe97f2efe response_code = 200 uri = /crucible/0/regions
102025-02-28T02:20:24.644ZINFOcrucible-agent (worker): region files created ok region = 7bbed3a2-b054-4b1f-9d55-b40acc0d332a
112025-02-28T02:20:24.644ZINFOcrucible-agent (datafile): region 7bbed3a2-b054-4b1f-9d55-b40acc0d332a state: Requested -> Created
122025-02-28T02:20:24.644ZINFOcrucible-agent (worker): applying SMF actions post create...
132025-02-28T02:20:24.645ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-7bbed3a2-b054-4b1f-9d55-b40acc0d332a
142025-02-28T02:20:24.657ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-7bbed3a2-b054-4b1f-9d55-b40acc0d332a
152025-02-28T02:20:24.668ZINFOcrucible-agent (worker): creating config property group
162025-02-28T02:20:24.671ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-7bbed3a2-b054-4b1f-9d55-b40acc0d332a
172025-02-28T02:20:24.671ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/7bbed3a2-b054-4b1f-9d55-b40acc0d332a
182025-02-28T02:20:24.671ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
192025-02-28T02:20:24.671ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::1a
202025-02-28T02:20:24.671ZINFOcrucible-agent (worker): commit
212025-02-28T02:20:24.675ZINFOcrucible-agent (worker): ok!
222025-02-28T02:20:24.681ZINFOcrucible-agent (worker): SMF ok!
232025-02-28T02:20:25.043ZINFOcrucible-agent (dropshot): request completed latency_us = 53 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:43992 req_id = 86260530-aa57-469d-877f-1547b32e6ecc response_code = 200 uri = /crucible/0/regions
242025-02-28T02:20:25.775ZINFOcrucible-agent (dropshot): request completed latency_us = 68 local_addr = [fd00:1122:3344:101::1a]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:43992 req_id = 20a4aee9-c992-4837-825b-1c3b36478c77 response_code = 200 uri = /crucible/0/regions/bdbef397-d8d6-4782-9afd-327e4a528c95
252025-02-28T02:20:25.782ZINFOcrucible-agent (datafile): path is "/data/regions/bdbef397-d8d6-4782-9afd-327e4a528c95"
262025-02-28T02:20:25.790ZINFOcrucible-agent (datafile): dataset is oxp_cbba9e4a-2c5a-45f6-a2bf-a3a7a30df21e/crucible/regions/bdbef397-d8d6-4782-9afd-327e4a528c95
272025-02-28T02:20:25.799ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_cbba9e4a-2c5a-45f6-a2bf-a3a7a30df21e/crucible/regions/bdbef397-d8d6-4782-9afd-327e4a528c95@4eb6c67e-909e-489b-8e70-5f27b12d20db
282025-02-28T02:20:25.799ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_cbba9e4a-2c5a-45f6-a2bf-a3a7a30df21e/crucible/regions/bdbef397-d8d6-4782-9afd-327e4a528c95", "4eb6c67e-909e-489b-8e70-5f27b12d20db"]
292025-02-28T02:20:25.809ZINFOcrucible-agent (dropshot): request completed latency_us = 30303 local_addr = [fd00:1122:3344:101::1a]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:43992 req_id = adfe3c4d-f8b6-47ae-9a17-8f3e567f8cbb response_code = 200 uri = /crucible/0/regions/bdbef397-d8d6-4782-9afd-327e4a528c95/snapshots/4eb6c67e-909e-489b-8e70-5f27b12d20db
302025-02-28T02:20:25.813ZINFOcrucible-agent (datafile): path is "/data/regions/bdbef397-d8d6-4782-9afd-327e4a528c95"
312025-02-28T02:20:25.821ZINFOcrucible-agent (datafile): dataset is oxp_cbba9e4a-2c5a-45f6-a2bf-a3a7a30df21e/crucible/regions/bdbef397-d8d6-4782-9afd-327e4a528c95
322025-02-28T02:20:25.828ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_cbba9e4a-2c5a-45f6-a2bf-a3a7a30df21e/crucible/regions/bdbef397-d8d6-4782-9afd-327e4a528c95@4eb6c67e-909e-489b-8e70-5f27b12d20db
332025-02-28T02:20:25.828ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_cbba9e4a-2c5a-45f6-a2bf-a3a7a30df21e/crucible/regions/bdbef397-d8d6-4782-9afd-327e4a528c95", "4eb6c67e-909e-489b-8e70-5f27b12d20db"]
342025-02-28T02:20:25.837ZINFOcrucible-agent (datafile): requesting running snapshot bdbef397-d8d6-4782-9afd-327e4a528c95-4eb6c67e-909e-489b-8e70-5f27b12d20db state: Requested
352025-02-28T02:20:25.838ZINFOcrucible-agent (worker): applying SMF actions for region bdbef397-d8d6-4782-9afd-327e4a528c95 running snapshot 4eb6c67e-909e-489b-8e70-5f27b12d20db (state Requested)...
362025-02-28T02:20:25.838ZINFOcrucible-agent (dropshot): request completed latency_us = 24843 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:43992 req_id = f834ff29-bda5-434d-a179-68f4cf74d433 response_code = 200 uri = /crucible/0/regions/bdbef397-d8d6-4782-9afd-327e4a528c95/snapshots/4eb6c67e-909e-489b-8e70-5f27b12d20db/run
372025-02-28T02:20:25.841ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-bdbef397-d8d6-4782-9afd-327e4a528c95-4eb6c67e-909e-489b-8e70-5f27b12d20db
382025-02-28T02:20:25.844ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-bdbef397-d8d6-4782-9afd-327e4a528c95-4eb6c67e-909e-489b-8e70-5f27b12d20db
392025-02-28T02:20:25.855ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-bdbef397-d8d6-4782-9afd-327e4a528c95-4eb6c67e-909e-489b-8e70-5f27b12d20db
402025-02-28T02:20:25.855ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/bdbef397-d8d6-4782-9afd-327e4a528c95/.zfs/snapshot/4eb6c67e-909e-489b-8e70-5f27b12d20db
412025-02-28T02:20:25.855ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
422025-02-28T02:20:25.855ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
432025-02-28T02:20:25.855ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::1a
442025-02-28T02:20:25.855ZINFOcrucible-agent (worker): commit
452025-02-28T02:20:25.859ZINFOcrucible-agent (worker): ok!
462025-02-28T02:20:25.864ZINFOcrucible-agent (worker): SMF ok!
472025-02-28T02:20:25.864ZINFOcrucible-agent (datafile): region bdbef397-d8d6-4782-9afd-327e4a528c95 running snapshot 4eb6c67e-909e-489b-8e70-5f27b12d20db state: Requested -> Created
482025-02-28T02:20:26.006ZINFOcrucible-agent (datafile): path is "/data/regions/bdbef397-d8d6-4782-9afd-327e4a528c95"
492025-02-28T02:20:26.015ZINFOcrucible-agent (datafile): dataset is oxp_cbba9e4a-2c5a-45f6-a2bf-a3a7a30df21e/crucible/regions/bdbef397-d8d6-4782-9afd-327e4a528c95
502025-02-28T02:20:26.025ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_cbba9e4a-2c5a-45f6-a2bf-a3a7a30df21e/crucible/regions/bdbef397-d8d6-4782-9afd-327e4a528c95@4eb6c67e-909e-489b-8e70-5f27b12d20db
512025-02-28T02:20:26.025ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_cbba9e4a-2c5a-45f6-a2bf-a3a7a30df21e/crucible/regions/bdbef397-d8d6-4782-9afd-327e4a528c95", "4eb6c67e-909e-489b-8e70-5f27b12d20db"]
522025-02-28T02:20:26.032ZINFOcrucible-agent (dropshot): request completed latency_us = 25923 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:43992 req_id = 0fd66c4a-84dc-459c-b579-39202905e0ef response_code = 200 uri = /crucible/0/regions/bdbef397-d8d6-4782-9afd-327e4a528c95/snapshots/4eb6c67e-909e-489b-8e70-5f27b12d20db/run