Max level shown:
1 [ Sep 19 23:59:00 Enabled. ]
2 [ Sep 19 23:59:00 Rereading configuration. ]
3 [ Sep 19 23:59:02 Rereading configuration. ]
4 [ Sep 19 23:59:07 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_37591a22-9ffc-46ed-a843-854bc37ef81a/crucible -l [fd00:1122:3344:101::14]:32345 -P 19000 -p downstairs -s snapshot"). ]
5 note: configured to log to "/dev/stdout"
62025-09-19T23:59:07.642ZINFOcrucible-agent: Crucible Version: Crucible Version: 0.0.1 Commit SHA: 779775d5130ff7a4836f52f48b7e64d1479ee104 Commit timestamp: 2025-08-09T00:27:59.000000000Z branch: main rustc: 1.86.0 stable x86_64-unknown-illumos Cargo: x86_64-unknown-illumos Debug: false Opt level: 3
72025-09-19T23:59:07.646ZINFOcrucible-agent: dataset: "oxp_37591a22-9ffc-46ed-a843-854bc37ef81a/crucible"
82025-09-19T23:59:07.646ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::14]:32345
92025-09-19T23:59:07.646ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
102025-09-19T23:59:07.666ZINFOcrucible-agent (datafile): Using conf_path:"/data/crucible.json"
112025-09-19T23:59:07.741ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::14]:32345
122025-09-19T23:59:44.622ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::14]:32345 remote_addr = [fd00:1122:3344:101::a]:41137
132025-09-19T23:59:44.656ZINFOcrucible-agent (datafile): region 717367f4-3ddb-4006-99df-4b8f1ce64da7 state: Requested
142025-09-19T23:59:44.661ZINFOcrucible-agent (dropshot): request completed latency_us = 16913 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:41137 req_id = 491dc3e1-5d21-4cd6-86b4-09a62727740c response_code = 200 uri = /crucible/0/regions
152025-09-19T23:59:44.663ZINFOcrucible-agent (worker): Region size:1073741824 reservation:1342177280 quota:3221225472
162025-09-19T23:59:44.673ZINFOcrucible-agent (worker): zfs set reservation of 1342177280 for oxp_37591a22-9ffc-46ed-a843-854bc37ef81a/crucible/regions/717367f4-3ddb-4006-99df-4b8f1ce64da7
172025-09-19T23:59:44.673ZINFOcrucible-agent (worker): zfs set quota of 3221225472 for oxp_37591a22-9ffc-46ed-a843-854bc37ef81a/crucible/regions/717367f4-3ddb-4006-99df-4b8f1ce64da7
182025-09-19T23:59:44.811ZINFOcrucible-agent (worker): creating region Region { id: RegionId("717367f4-3ddb-4006-99df-4b8f1ce64da7"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 16, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/717367f4-3ddb-4006-99df-4b8f1ce64da7" region = 717367f4-3ddb-4006-99df-4b8f1ce64da7
192025-09-19T23:59:44.811ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "717367f4-3ddb-4006-99df-4b8f1ce64da7" "--data" "/data/regions/717367f4-3ddb-4006-99df-4b8f1ce64da7" "--block-size" "512" "--extent-size" "131072" "--extent-count" "16" "--encrypted" region = 717367f4-3ddb-4006-99df-4b8f1ce64da7
202025-09-19T23:59:44.980ZINFOcrucible-agent (dropshot): request completed latency_us = 73 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:41137 req_id = 8a0f69cc-f0b0-409b-a6aa-f8cd2fbb7542 response_code = 200 uri = /crucible/0/regions
212025-09-19T23:59:45.191ZINFOcrucible-agent (worker): region files created ok region = 717367f4-3ddb-4006-99df-4b8f1ce64da7
222025-09-19T23:59:45.191ZINFOcrucible-agent (datafile): region 717367f4-3ddb-4006-99df-4b8f1ce64da7 state: Requested -> Created
232025-09-19T23:59:45.191ZINFOcrucible-agent (worker): applying SMF actions post create...
242025-09-19T23:59:45.191ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-717367f4-3ddb-4006-99df-4b8f1ce64da7
252025-09-19T23:59:45.204ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-717367f4-3ddb-4006-99df-4b8f1ce64da7
262025-09-19T23:59:45.248ZINFOcrucible-agent (worker): creating config property group
272025-09-19T23:59:45.305ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-717367f4-3ddb-4006-99df-4b8f1ce64da7
282025-09-19T23:59:45.306ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/717367f4-3ddb-4006-99df-4b8f1ce64da7
292025-09-19T23:59:45.313ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
302025-09-19T23:59:45.313ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::14
312025-09-19T23:59:45.313ZINFOcrucible-agent (worker): commit
322025-09-19T23:59:45.376ZINFOcrucible-agent (worker): ok!
332025-09-19T23:59:45.415ZINFOcrucible-agent (worker): SMF ok!
342025-09-19T23:59:45.655ZINFOcrucible-agent (dropshot): request completed latency_us = 46 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:41137 req_id = da2a17a3-4c19-4cc5-8bef-1e52c882af81 response_code = 200 uri = /crucible/0/regions
352025-09-19T23:59:46.279ZINFOcrucible-agent (dropshot): request completed latency_us = 74 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:41137 req_id = a5e556ea-93cc-4adb-806c-d2fd8254d814 response_code = 200 uri = /crucible/0/regions/717367f4-3ddb-4006-99df-4b8f1ce64da7
362025-09-19T23:59:46.282ZINFOcrucible-agent (datafile): path is "/data/regions/717367f4-3ddb-4006-99df-4b8f1ce64da7"
372025-09-19T23:59:46.294ZINFOcrucible-agent (datafile): dataset is oxp_37591a22-9ffc-46ed-a843-854bc37ef81a/crucible/regions/717367f4-3ddb-4006-99df-4b8f1ce64da7
382025-09-19T23:59:46.308ZINFOcrucible-agent (datafile): region 717367f4-3ddb-4006-99df-4b8f1ce64da7 state: Created -> Tombstoned
392025-09-19T23:59:46.308ZINFOcrucible-agent (worker): applying SMF actions before removal...
402025-09-19T23:59:46.308ZINFOcrucible-agent (dropshot): request completed latency_us = 25785 local_addr = [fd00:1122:3344:101::14]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::a]:41137 req_id = 7495d8a7-0f96-48d6-b79e-ba1a6b7b67ef response_code = 204 uri = /crucible/0/regions/717367f4-3ddb-4006-99df-4b8f1ce64da7
412025-09-19T23:59:46.309ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-717367f4-3ddb-4006-99df-4b8f1ce64da7 (instance states: (Some(Online), None))
422025-09-19T23:59:46.312ZINFOcrucible-agent (dropshot): request completed latency_us = 26 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:41137 req_id = f1d20a72-55a1-4a72-9505-9dcae3fafbe2 response_code = 200 uri = /crucible/0/regions/717367f4-3ddb-4006-99df-4b8f1ce64da7
432025-09-19T23:59:46.326ZINFOcrucible-agent (worker): SMF ok!
442025-09-19T23:59:46.338ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_37591a22-9ffc-46ed-a843-854bc37ef81a/crucible/regions/717367f4-3ddb-4006-99df-4b8f1ce64da7" region = 717367f4-3ddb-4006-99df-4b8f1ce64da7
452025-09-19T23:59:46.396ZINFOcrucible-agent (dropshot): request completed latency_us = 68 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:41137 req_id = 017e98df-8531-48cb-8548-89b4b6b94e76 response_code = 200 uri = /crucible/0/regions/717367f4-3ddb-4006-99df-4b8f1ce64da7
462025-09-19T23:59:46.467ZINFOcrucible-agent (datafile): region 717367f4-3ddb-4006-99df-4b8f1ce64da7 state: Tombstoned -> Destroyed
472025-09-19T23:59:46.557ZINFOcrucible-agent (dropshot): request completed latency_us = 26 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:41137 req_id = e8c190e0-e912-404f-b3ea-e2107677ec99 response_code = 200 uri = /crucible/0/regions/717367f4-3ddb-4006-99df-4b8f1ce64da7