Max level shown:
12025-11-18T15:15:50.881ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::1a]:32345 remote_addr = [fd00:1122:3344:101::c]:50484
22025-11-18T15:15:50.907ZINFOcrucible-agent (datafile): region 23a68e08-7a4e-4e36-a495-baaf7cd87558 state: Requested
32025-11-18T15:15:50.910ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
42025-11-18T15:15:50.910ZINFOcrucible-agent (dropshot): request completed latency_us = 13662 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:50484 req_id = 4892e918-4d25-45de-be26-9799907af41a response_code = 200 uri = /crucible/0/regions
52025-11-18T15:15:50.919ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_f4203071-77e7-4eed-883e-b8b59c688919/crucible/regions/23a68e08-7a4e-4e36-a495-baaf7cd87558
62025-11-18T15:15:50.919ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_f4203071-77e7-4eed-883e-b8b59c688919/crucible/regions/23a68e08-7a4e-4e36-a495-baaf7cd87558
72025-11-18T15:15:50.972ZINFOcrucible-agent (worker): creating region Region { id: RegionId("23a68e08-7a4e-4e36-a495-baaf7cd87558"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/23a68e08-7a4e-4e36-a495-baaf7cd87558" region = 23a68e08-7a4e-4e36-a495-baaf7cd87558
82025-11-18T15:15:50.974ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "23a68e08-7a4e-4e36-a495-baaf7cd87558" "--data" "/data/regions/23a68e08-7a4e-4e36-a495-baaf7cd87558" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 23a68e08-7a4e-4e36-a495-baaf7cd87558
92025-11-18T15:15:51.216ZINFOcrucible-agent (dropshot): request completed latency_us = 66 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:50484 req_id = 4d5e7f84-8cf1-45fb-98f1-02bc5ecb4b13 response_code = 200 uri = /crucible/0/regions
102025-11-18T15:15:51.327ZINFOcrucible-agent (worker): region files created ok region = 23a68e08-7a4e-4e36-a495-baaf7cd87558
112025-11-18T15:15:51.327ZINFOcrucible-agent (datafile): region 23a68e08-7a4e-4e36-a495-baaf7cd87558 state: Requested -> Created
122025-11-18T15:15:51.328ZINFOcrucible-agent (worker): applying SMF actions post create...
132025-11-18T15:15:51.328ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-23a68e08-7a4e-4e36-a495-baaf7cd87558
142025-11-18T15:15:51.333ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-23a68e08-7a4e-4e36-a495-baaf7cd87558
152025-11-18T15:15:51.349ZINFOcrucible-agent (worker): creating config property group
162025-11-18T15:15:51.353ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-23a68e08-7a4e-4e36-a495-baaf7cd87558
172025-11-18T15:15:51.353ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/23a68e08-7a4e-4e36-a495-baaf7cd87558
182025-11-18T15:15:51.353ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
192025-11-18T15:15:51.353ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::1a
202025-11-18T15:15:51.353ZINFOcrucible-agent (worker): commit
212025-11-18T15:15:51.357ZINFOcrucible-agent (worker): ok!
222025-11-18T15:15:51.362ZINFOcrucible-agent (worker): SMF ok!
232025-11-18T15:15:51.574ZINFOcrucible-agent (dropshot): request completed latency_us = 58 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:50484 req_id = d1a535d0-af01-4bca-9a76-2b7ad88f5dfd response_code = 200 uri = /crucible/0/regions
242025-11-18T15:26:51.026ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::1a]:32345 remote_addr = [fd00:1122:3344:101::c]:44210
252025-11-18T15:26:51.027ZINFOcrucible-agent (dropshot): request completed latency_us = 73 local_addr = [fd00:1122:3344:101::1a]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:44210 req_id = 38c3e42a-a9ef-4b23-8e0b-73b328f0c701 response_code = 200 uri = /crucible/0/regions/23a68e08-7a4e-4e36-a495-baaf7cd87558
262025-11-18T15:26:51.041ZINFOcrucible-agent (datafile): path is "/data/regions/23a68e08-7a4e-4e36-a495-baaf7cd87558"
272025-11-18T15:26:51.048ZINFOcrucible-agent (datafile): dataset is oxp_f4203071-77e7-4eed-883e-b8b59c688919/crucible/regions/23a68e08-7a4e-4e36-a495-baaf7cd87558
282025-11-18T15:26:51.055ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_f4203071-77e7-4eed-883e-b8b59c688919/crucible/regions/23a68e08-7a4e-4e36-a495-baaf7cd87558@3ffbc7d5-1a88-4cbe-b4f1-31247b16b619
292025-11-18T15:26:51.055ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_f4203071-77e7-4eed-883e-b8b59c688919/crucible/regions/23a68e08-7a4e-4e36-a495-baaf7cd87558", "3ffbc7d5-1a88-4cbe-b4f1-31247b16b619"]
302025-11-18T15:26:51.069ZINFOcrucible-agent (dropshot): request completed latency_us = 27865 local_addr = [fd00:1122:3344:101::1a]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:44210 req_id = 10637cc1-0749-4c53-ab21-2096dfaad23c response_code = 200 uri = /crucible/0/regions/23a68e08-7a4e-4e36-a495-baaf7cd87558/snapshots/3ffbc7d5-1a88-4cbe-b4f1-31247b16b619
312025-11-18T15:26:51.075ZINFOcrucible-agent (datafile): path is "/data/regions/23a68e08-7a4e-4e36-a495-baaf7cd87558"
322025-11-18T15:26:51.081ZINFOcrucible-agent (datafile): dataset is oxp_f4203071-77e7-4eed-883e-b8b59c688919/crucible/regions/23a68e08-7a4e-4e36-a495-baaf7cd87558
332025-11-18T15:26:51.087ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_f4203071-77e7-4eed-883e-b8b59c688919/crucible/regions/23a68e08-7a4e-4e36-a495-baaf7cd87558@3ffbc7d5-1a88-4cbe-b4f1-31247b16b619
342025-11-18T15:26:51.087ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_f4203071-77e7-4eed-883e-b8b59c688919/crucible/regions/23a68e08-7a4e-4e36-a495-baaf7cd87558", "3ffbc7d5-1a88-4cbe-b4f1-31247b16b619"]
352025-11-18T15:26:51.097ZINFOcrucible-agent (datafile): requesting running snapshot 23a68e08-7a4e-4e36-a495-baaf7cd87558-3ffbc7d5-1a88-4cbe-b4f1-31247b16b619 state: Requested
362025-11-18T15:26:51.097ZINFOcrucible-agent (worker): applying SMF actions for region 23a68e08-7a4e-4e36-a495-baaf7cd87558 running snapshot 3ffbc7d5-1a88-4cbe-b4f1-31247b16b619 (state Requested)...
372025-11-18T15:26:51.097ZINFOcrucible-agent (dropshot): request completed latency_us = 22587 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:44210 req_id = fe70ab59-c306-41fb-9e73-b96ed1a17ab6 response_code = 200 uri = /crucible/0/regions/23a68e08-7a4e-4e36-a495-baaf7cd87558/snapshots/3ffbc7d5-1a88-4cbe-b4f1-31247b16b619/run
382025-11-18T15:26:51.118ZINFOcrucible-agent (worker): creating missing snapshot instance snapshot-23a68e08-7a4e-4e36-a495-baaf7cd87558-3ffbc7d5-1a88-4cbe-b4f1-31247b16b619
392025-11-18T15:26:51.133ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:snapshot-23a68e08-7a4e-4e36-a495-baaf7cd87558-3ffbc7d5-1a88-4cbe-b4f1-31247b16b619
402025-11-18T15:26:51.157ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:snapshot-23a68e08-7a4e-4e36-a495-baaf7cd87558-3ffbc7d5-1a88-4cbe-b4f1-31247b16b619
412025-11-18T15:26:51.157ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/23a68e08-7a4e-4e36-a495-baaf7cd87558/.zfs/snapshot/3ffbc7d5-1a88-4cbe-b4f1-31247b16b619
422025-11-18T15:26:51.157ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19001
432025-11-18T15:26:51.157ZINFOcrucible-agent (worker): ensure mode SCF_TYPE_ASTRING ro
442025-11-18T15:26:51.157ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::1a
452025-11-18T15:26:51.157ZINFOcrucible-agent (worker): commit
462025-11-18T15:26:51.163ZINFOcrucible-agent (worker): ok!
472025-11-18T15:26:51.171ZINFOcrucible-agent (worker): SMF ok!
482025-11-18T15:26:51.171ZINFOcrucible-agent (datafile): region 23a68e08-7a4e-4e36-a495-baaf7cd87558 running snapshot 3ffbc7d5-1a88-4cbe-b4f1-31247b16b619 state: Requested -> Created
492025-11-18T15:26:51.342ZINFOcrucible-agent (datafile): path is "/data/regions/23a68e08-7a4e-4e36-a495-baaf7cd87558"
502025-11-18T15:26:51.349ZINFOcrucible-agent (datafile): dataset is oxp_f4203071-77e7-4eed-883e-b8b59c688919/crucible/regions/23a68e08-7a4e-4e36-a495-baaf7cd87558
512025-11-18T15:26:51.356ZINFOcrucible-agent (ZfsSnapshotInterface): snapshot is oxp_f4203071-77e7-4eed-883e-b8b59c688919/crucible/regions/23a68e08-7a4e-4e36-a495-baaf7cd87558@3ffbc7d5-1a88-4cbe-b4f1-31247b16b619
522025-11-18T15:26:51.356ZINFOcrucible-agent (ZfsSnapshotInterface): parts is ["oxp_f4203071-77e7-4eed-883e-b8b59c688919/crucible/regions/23a68e08-7a4e-4e36-a495-baaf7cd87558", "3ffbc7d5-1a88-4cbe-b4f1-31247b16b619"]
532025-11-18T15:26:51.362ZINFOcrucible-agent (dropshot): request completed latency_us = 19595 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:44210 req_id = e67292b3-5ed8-43d2-ab4f-49ac1825b874 response_code = 200 uri = /crucible/0/regions/23a68e08-7a4e-4e36-a495-baaf7cd87558/snapshots/3ffbc7d5-1a88-4cbe-b4f1-31247b16b619/run