Max level shown:
1 [ Sep 19 20:46:06 Enabled. ]
2 [ Sep 19 20:46:06 Rereading configuration. ]
3 [ Sep 19 20:46:09 Rereading configuration. ]
4 [ Sep 19 20:46:14 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_c33e0bb8-407b-47c3-8b4c-e85bc09e0018/crucible -l [fd00:1122:3344:101::16]:32345 -P 19000 -p downstairs -s snapshot"). ]
5 note: configured to log to "/dev/stdout"
62025-09-19T20:46:14.517ZINFOcrucible-agent: Crucible Version: Crucible Version: 0.0.1 Commit SHA: 779775d5130ff7a4836f52f48b7e64d1479ee104 Commit timestamp: 2025-08-09T00:27:59.000000000Z branch: main rustc: 1.86.0 stable x86_64-unknown-illumos Cargo: x86_64-unknown-illumos Debug: false Opt level: 3
72025-09-19T20:46:14.520ZINFOcrucible-agent: dataset: "oxp_c33e0bb8-407b-47c3-8b4c-e85bc09e0018/crucible"
82025-09-19T20:46:14.520ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::16]:32345
92025-09-19T20:46:14.520ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
102025-09-19T20:46:14.536ZINFOcrucible-agent (datafile): Using conf_path:"/data/crucible.json"
112025-09-19T20:46:14.648ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::16]:32345
122025-09-19T20:57:56.480ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::16]:32345 remote_addr = [fd00:1122:3344:101::b]:39173
132025-09-19T20:57:56.531ZINFOcrucible-agent (datafile): region cd330b40-2876-4de1-bf77-fbdaad4b96e6 state: Requested
142025-09-19T20:57:56.538ZINFOcrucible-agent (dropshot): request completed latency_us = 26178 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:39173 req_id = bb976cc1-548e-42e4-a451-62678ace4b39 response_code = 200 uri = /crucible/0/regions
152025-09-19T20:57:56.543ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
162025-09-19T20:57:56.553ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_c33e0bb8-407b-47c3-8b4c-e85bc09e0018/crucible/regions/cd330b40-2876-4de1-bf77-fbdaad4b96e6
172025-09-19T20:57:56.553ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_c33e0bb8-407b-47c3-8b4c-e85bc09e0018/crucible/regions/cd330b40-2876-4de1-bf77-fbdaad4b96e6
182025-09-19T20:57:56.616ZINFOcrucible-agent (worker): creating region Region { id: RegionId("cd330b40-2876-4de1-bf77-fbdaad4b96e6"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/cd330b40-2876-4de1-bf77-fbdaad4b96e6" region = cd330b40-2876-4de1-bf77-fbdaad4b96e6
192025-09-19T20:57:56.618ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "cd330b40-2876-4de1-bf77-fbdaad4b96e6" "--data" "/data/regions/cd330b40-2876-4de1-bf77-fbdaad4b96e6" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = cd330b40-2876-4de1-bf77-fbdaad4b96e6
202025-09-19T20:57:56.875ZINFOcrucible-agent (dropshot): request completed latency_us = 80 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:39173 req_id = 34b69e7a-0671-40fa-8b01-d6a48a545b97 response_code = 200 uri = /crucible/0/regions
212025-09-19T20:57:57.010ZINFOcrucible-agent (worker): region files created ok region = cd330b40-2876-4de1-bf77-fbdaad4b96e6
222025-09-19T20:57:57.010ZINFOcrucible-agent (datafile): region cd330b40-2876-4de1-bf77-fbdaad4b96e6 state: Requested -> Created
232025-09-19T20:57:57.010ZINFOcrucible-agent (worker): applying SMF actions post create...
242025-09-19T20:57:57.011ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-cd330b40-2876-4de1-bf77-fbdaad4b96e6
252025-09-19T20:57:57.022ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-cd330b40-2876-4de1-bf77-fbdaad4b96e6
262025-09-19T20:57:57.055ZINFOcrucible-agent (worker): creating config property group
272025-09-19T20:57:57.061ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-cd330b40-2876-4de1-bf77-fbdaad4b96e6
282025-09-19T20:57:57.062ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/cd330b40-2876-4de1-bf77-fbdaad4b96e6
292025-09-19T20:57:57.070ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
302025-09-19T20:57:57.070ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::16
312025-09-19T20:57:57.070ZINFOcrucible-agent (worker): commit
322025-09-19T20:57:57.088ZINFOcrucible-agent (worker): ok!
332025-09-19T20:57:57.097ZINFOcrucible-agent (worker): SMF ok!
342025-09-19T20:57:57.152ZINFOcrucible-agent (dropshot): request completed latency_us = 43 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:39173 req_id = 3ba5331f-4b6f-451b-bdec-fd9c9978fb99 response_code = 200 uri = /crucible/0/regions
352025-09-19T20:58:22.319ZINFOcrucible-agent (dropshot): request completed latency_us = 66 local_addr = [fd00:1122:3344:101::16]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:39173 req_id = 00cb9036-04a1-4dd7-b28a-106ed2d500f7 response_code = 200 uri = /crucible/0/regions/cd330b40-2876-4de1-bf77-fbdaad4b96e6
362025-09-19T20:58:22.325ZINFOcrucible-agent (datafile): path is "/data/regions/cd330b40-2876-4de1-bf77-fbdaad4b96e6"
372025-09-19T20:58:22.337ZINFOcrucible-agent (datafile): dataset is oxp_c33e0bb8-407b-47c3-8b4c-e85bc09e0018/crucible/regions/cd330b40-2876-4de1-bf77-fbdaad4b96e6
382025-09-19T20:58:22.349ZINFOcrucible-agent (datafile): region cd330b40-2876-4de1-bf77-fbdaad4b96e6 state: Created -> Tombstoned
392025-09-19T20:58:22.349ZINFOcrucible-agent (worker): applying SMF actions before removal...
402025-09-19T20:58:22.349ZINFOcrucible-agent (dropshot): request completed latency_us = 26508 local_addr = [fd00:1122:3344:101::16]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::b]:39173 req_id = e5dc63a9-e72d-4211-ad85-919d43c59688 response_code = 204 uri = /crucible/0/regions/cd330b40-2876-4de1-bf77-fbdaad4b96e6
412025-09-19T20:58:22.350ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-cd330b40-2876-4de1-bf77-fbdaad4b96e6 (instance states: (Some(Online), None))
422025-09-19T20:58:22.353ZINFOcrucible-agent (dropshot): request completed latency_us = 28 local_addr = [fd00:1122:3344:101::16]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:39173 req_id = 51e083e8-c24d-47a7-9623-3ebb62c0b8bb response_code = 200 uri = /crucible/0/regions/cd330b40-2876-4de1-bf77-fbdaad4b96e6
432025-09-19T20:58:22.358ZINFOcrucible-agent (worker): SMF ok!
442025-09-19T20:58:22.368ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_c33e0bb8-407b-47c3-8b4c-e85bc09e0018/crucible/regions/cd330b40-2876-4de1-bf77-fbdaad4b96e6" region = cd330b40-2876-4de1-bf77-fbdaad4b96e6
452025-09-19T20:58:22.430ZINFOcrucible-agent (datafile): region cd330b40-2876-4de1-bf77-fbdaad4b96e6 state: Tombstoned -> Destroyed
462025-09-19T20:58:22.492ZINFOcrucible-agent (dropshot): request completed latency_us = 53 local_addr = [fd00:1122:3344:101::16]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:39173 req_id = 8875ad8a-fb93-427d-a66e-0476743edbff response_code = 200 uri = /crucible/0/regions/cd330b40-2876-4de1-bf77-fbdaad4b96e6