Max level shown:
12025-12-16T09:25:46.659ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::14]:32345 remote_addr = [fd00:1122:3344:101::a]:53058
22025-12-16T09:25:46.659ZINFOcrucible-agent (datafile): region 7f48d43a-1134-4d90-8cf9-c316fb270d19 state: Requested
32025-12-16T09:25:46.661ZINFOcrucible-agent (dropshot): request completed latency_us = 1319 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:53058 req_id = 67a2fc81-945e-43ea-b0d7-44d67be91093 response_code = 200 uri = /crucible/0/regions
42025-12-16T09:25:46.661ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
52025-12-16T09:25:46.668ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_4466a1cc-1b94-4f15-ae29-5085d045be8f/crucible/regions/7f48d43a-1134-4d90-8cf9-c316fb270d19
62025-12-16T09:25:46.668ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_4466a1cc-1b94-4f15-ae29-5085d045be8f/crucible/regions/7f48d43a-1134-4d90-8cf9-c316fb270d19
72025-12-16T09:25:46.733ZINFOcrucible-agent (worker): creating region Region { id: RegionId("7f48d43a-1134-4d90-8cf9-c316fb270d19"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19001, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/7f48d43a-1134-4d90-8cf9-c316fb270d19" region = 7f48d43a-1134-4d90-8cf9-c316fb270d19
82025-12-16T09:25:46.733ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "7f48d43a-1134-4d90-8cf9-c316fb270d19" "--data" "/data/regions/7f48d43a-1134-4d90-8cf9-c316fb270d19" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 7f48d43a-1134-4d90-8cf9-c316fb270d19
92025-12-16T09:25:46.907ZINFOcrucible-agent (worker): region files created ok region = 7f48d43a-1134-4d90-8cf9-c316fb270d19
102025-12-16T09:25:46.907ZINFOcrucible-agent (datafile): region 7f48d43a-1134-4d90-8cf9-c316fb270d19 state: Requested -> Created
112025-12-16T09:25:46.907ZINFOcrucible-agent (worker): applying SMF actions post create...
122025-12-16T09:25:46.909ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-7f48d43a-1134-4d90-8cf9-c316fb270d19
132025-12-16T09:25:46.929ZINFOcrucible-agent (dropshot): request completed latency_us = 80 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:53058 req_id = 212c4725-73b0-49f0-aaf1-c4067ef8c9bd response_code = 200 uri = /crucible/0/regions
142025-12-16T09:25:46.929ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-7f48d43a-1134-4d90-8cf9-c316fb270d19
152025-12-16T09:25:46.952ZINFOcrucible-agent (worker): creating config property group
162025-12-16T09:25:46.955ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-7f48d43a-1134-4d90-8cf9-c316fb270d19
172025-12-16T09:25:46.955ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/7f48d43a-1134-4d90-8cf9-c316fb270d19
182025-12-16T09:25:46.955ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
192025-12-16T09:25:46.955ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::14
202025-12-16T09:25:46.955ZINFOcrucible-agent (worker): commit
212025-12-16T09:25:46.959ZINFOcrucible-agent (worker): ok!
222025-12-16T09:25:46.975ZINFOcrucible-agent (worker): SMF ok!
232025-12-16T09:25:48.000ZINFOcrucible-agent (dropshot): request completed latency_us = 58 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:53058 req_id = feac1353-fda8-4408-9e56-2c28a113878d response_code = 200 uri = /crucible/0/regions/f36e39dd-283b-4c8a-a901-de021141cd57
242025-12-16T09:25:48.006ZINFOcrucible-agent (datafile): path is "/data/regions/f36e39dd-283b-4c8a-a901-de021141cd57"
252025-12-16T09:25:48.012ZINFOcrucible-agent (datafile): dataset is oxp_4466a1cc-1b94-4f15-ae29-5085d045be8f/crucible/regions/f36e39dd-283b-4c8a-a901-de021141cd57
262025-12-16T09:25:48.018ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_4466a1cc-1b94-4f15-ae29-5085d045be8f/crucible/regions/f36e39dd-283b-4c8a-a901-de021141cd57@0bf515a7-eec1-42a5-ac86-fd656497767c
272025-12-16T09:25:48.018ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_4466a1cc-1b94-4f15-ae29-5085d045be8f/crucible/regions/f36e39dd-283b-4c8a-a901-de021141cd57", "0bf515a7-eec1-42a5-ac86-fd656497767c"]
282025-12-16T09:25:48.027ZINFOcrucible-agent (dropshot): request completed latency_us = 21627 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:53058 req_id = f5cdf43f-72a2-4346-b336-197fccb63323 response_code = 200 uri = /crucible/0/regions/f36e39dd-283b-4c8a-a901-de021141cd57/snapshots/0bf515a7-eec1-42a5-ac86-fd656497767c
292025-12-16T09:25:48.033ZINFOcrucible-agent (datafile): path is "/data/regions/f36e39dd-283b-4c8a-a901-de021141cd57"
302025-12-16T09:25:48.038ZINFOcrucible-agent (datafile): dataset is oxp_4466a1cc-1b94-4f15-ae29-5085d045be8f/crucible/regions/f36e39dd-283b-4c8a-a901-de021141cd57
312025-12-16T09:25:48.044ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_4466a1cc-1b94-4f15-ae29-5085d045be8f/crucible/regions/f36e39dd-283b-4c8a-a901-de021141cd57@0bf515a7-eec1-42a5-ac86-fd656497767c
322025-12-16T09:25:48.044ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_4466a1cc-1b94-4f15-ae29-5085d045be8f/crucible/regions/f36e39dd-283b-4c8a-a901-de021141cd57", "0bf515a7-eec1-42a5-ac86-fd656497767c"]
332025-12-16T09:25:48.051ZINFOcrucible-agent (datafile): requesting running snapshot f36e39dd-283b-4c8a-a901-de021141cd57-0bf515a7-eec1-42a5-ac86-fd656497767c state: Requested
342025-12-16T09:25:48.052ZINFOcrucible-agent (dropshot): request completed latency_us = 18827 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:53058 req_id = aeedb27c-098e-4525-8edb-47965d029b33 response_code = 200 uri = /crucible/0/regions/f36e39dd-283b-4c8a-a901-de021141cd57/snapshots/0bf515a7-eec1-42a5-ac86-fd656497767c/run
352025-12-16T09:25:48.052ZINFOcrucible-agent (worker): applying SMF actions for region f36e39dd-283b-4c8a-a901-de021141cd57 running snapshot 0bf515a7-eec1-42a5-ac86-fd656497767c (state Requested)...
362025-12-16T09:25:48.057ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-f36e39dd-283b-4c8a-a901-de021141cd57-0bf515a7-eec1-42a5-ac86-fd656497767c
372025-12-16T09:25:48.059ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-f36e39dd-283b-4c8a-a901-de021141cd57-0bf515a7-eec1-42a5-ac86-fd656497767c
382025-12-16T09:25:48.070ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-f36e39dd-283b-4c8a-a901-de021141cd57-0bf515a7-eec1-42a5-ac86-fd656497767c
392025-12-16T09:25:48.071ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/f36e39dd-283b-4c8a-a901-de021141cd57/.zfs/snapshot/0bf515a7-eec1-42a5-ac86-fd656497767c
402025-12-16T09:25:48.071ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19002
412025-12-16T09:25:48.071ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
422025-12-16T09:25:48.071ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::14
432025-12-16T09:25:48.071ZINFOcrucible-agent (worker): commit
442025-12-16T09:25:48.076ZINFOcrucible-agent (worker): ok!
452025-12-16T09:25:48.080ZINFOcrucible-agent (worker): SMF ok!
462025-12-16T09:25:48.080ZINFOcrucible-agent (datafile): region f36e39dd-283b-4c8a-a901-de021141cd57 running snapshot 0bf515a7-eec1-42a5-ac86-fd656497767c state: Requested -> Created
472025-12-16T09:25:48.356ZINFOcrucible-agent (datafile): path is "/data/regions/f36e39dd-283b-4c8a-a901-de021141cd57"
482025-12-16T09:25:48.362ZINFOcrucible-agent (datafile): dataset is oxp_4466a1cc-1b94-4f15-ae29-5085d045be8f/crucible/regions/f36e39dd-283b-4c8a-a901-de021141cd57
492025-12-16T09:25:48.368ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_4466a1cc-1b94-4f15-ae29-5085d045be8f/crucible/regions/f36e39dd-283b-4c8a-a901-de021141cd57@0bf515a7-eec1-42a5-ac86-fd656497767c
502025-12-16T09:25:48.368ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_4466a1cc-1b94-4f15-ae29-5085d045be8f/crucible/regions/f36e39dd-283b-4c8a-a901-de021141cd57", "0bf515a7-eec1-42a5-ac86-fd656497767c"]
512025-12-16T09:25:48.374ZINFOcrucible-agent (dropshot): request completed latency_us = 17811 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:53058 req_id = 898231f8-5273-4fdb-b36e-c0b7c7bb63c8 response_code = 200 uri = /crucible/0/regions/f36e39dd-283b-4c8a-a901-de021141cd57/snapshots/0bf515a7-eec1-42a5-ac86-fd656497767c/run