Max level shown:
1 [ Aug 29 23:39:39 Enabled. ]
2 [ Aug 29 23:39:39 Rereading configuration. ]
3 [ Aug 29 23:39:40 Rereading configuration. ]
4 [ Aug 29 23:39:45 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_7d3b73ea-ce38-46b3-8429-a69c7fa0b20f/crucible -l [fd00:1122:3344:101::13]:32345 -P 19000 -p downstairs -s snapshot"). ]
5 note: configured to log to "/dev/stdout"
62025-08-29T23:39:45.429ZINFOcrucible-agent: Crucible Version: Crucible Version: 0.0.1 Commit SHA: 779775d5130ff7a4836f52f48b7e64d1479ee104 Commit timestamp: 2025-08-09T00:27:59.000000000Z branch: main rustc: 1.86.0 stable x86_64-unknown-illumos Cargo: x86_64-unknown-illumos Debug: false Opt level: 3
72025-08-29T23:39:45.433ZINFOcrucible-agent: dataset: "oxp_7d3b73ea-ce38-46b3-8429-a69c7fa0b20f/crucible"
82025-08-29T23:39:45.433ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::13]:32345
92025-08-29T23:39:45.433ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
102025-08-29T23:39:45.450ZINFOcrucible-agent (datafile): Using conf_path:"/data/crucible.json"
112025-08-29T23:39:45.549ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::13]:32345
122025-08-29T23:40:32.242ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::13]:32345 remote_addr = [fd00:1122:3344:101::a]:58027
132025-08-29T23:40:32.338ZINFOcrucible-agent (datafile): region 414ed653-bf13-4cc2-b514-4f2dbcbe50a3 state: Requested
142025-08-29T23:40:32.349ZINFOcrucible-agent (dropshot): request completed latency_us = 63188 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:58027 req_id = b4ed1242-2280-45bc-a88e-da513dd6083c response_code = 200 uri = /crucible/0/regions
152025-08-29T23:40:32.355ZINFOcrucible-agent (worker): Region size:1073741824 reservation:1342177280 quota:3221225472
162025-08-29T23:40:32.364ZINFOcrucible-agent (worker): zfs set reservation of 1342177280 for oxp_7d3b73ea-ce38-46b3-8429-a69c7fa0b20f/crucible/regions/414ed653-bf13-4cc2-b514-4f2dbcbe50a3
172025-08-29T23:40:32.364ZINFOcrucible-agent (worker): zfs set quota of 3221225472 for oxp_7d3b73ea-ce38-46b3-8429-a69c7fa0b20f/crucible/regions/414ed653-bf13-4cc2-b514-4f2dbcbe50a3
182025-08-29T23:40:32.478ZINFOcrucible-agent (worker): creating region Region { id: RegionId("414ed653-bf13-4cc2-b514-4f2dbcbe50a3"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 16, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/414ed653-bf13-4cc2-b514-4f2dbcbe50a3" region = 414ed653-bf13-4cc2-b514-4f2dbcbe50a3
192025-08-29T23:40:32.481ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "414ed653-bf13-4cc2-b514-4f2dbcbe50a3" "--data" "/data/regions/414ed653-bf13-4cc2-b514-4f2dbcbe50a3" "--block-size" "512" "--extent-size" "131072" "--extent-count" "16" "--encrypted" region = 414ed653-bf13-4cc2-b514-4f2dbcbe50a3
202025-08-29T23:40:32.758ZINFOcrucible-agent (dropshot): request completed latency_us = 79 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:58027 req_id = 2f772bc2-72ca-4252-910b-45aaa7b0d674 response_code = 200 uri = /crucible/0/regions
212025-08-29T23:40:33.070ZINFOcrucible-agent (worker): region files created ok region = 414ed653-bf13-4cc2-b514-4f2dbcbe50a3
222025-08-29T23:40:33.071ZINFOcrucible-agent (datafile): region 414ed653-bf13-4cc2-b514-4f2dbcbe50a3 state: Requested -> Created
232025-08-29T23:40:33.071ZINFOcrucible-agent (worker): applying SMF actions post create...
242025-08-29T23:40:33.071ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-414ed653-bf13-4cc2-b514-4f2dbcbe50a3
252025-08-29T23:40:33.086ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-414ed653-bf13-4cc2-b514-4f2dbcbe50a3
262025-08-29T23:40:33.125ZINFOcrucible-agent (worker): creating config property group
272025-08-29T23:40:33.139ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-414ed653-bf13-4cc2-b514-4f2dbcbe50a3
282025-08-29T23:40:33.140ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/414ed653-bf13-4cc2-b514-4f2dbcbe50a3
292025-08-29T23:40:33.157ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
302025-08-29T23:40:33.157ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::13
312025-08-29T23:40:33.157ZINFOcrucible-agent (worker): commit
322025-08-29T23:40:33.172ZINFOcrucible-agent (worker): ok!
332025-08-29T23:40:33.181ZINFOcrucible-agent (worker): SMF ok!
342025-08-29T23:40:33.413ZINFOcrucible-agent (dropshot): request completed latency_us = 51 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:58027 req_id = a9d3ad55-c7c3-4629-b259-435a81f6f4f8 response_code = 200 uri = /crucible/0/regions
352025-08-29T23:40:34.336ZINFOcrucible-agent (dropshot): request completed latency_us = 61 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:58027 req_id = 40f5c554-bb9b-4685-8a80-f786d221c565 response_code = 200 uri = /crucible/0/regions/414ed653-bf13-4cc2-b514-4f2dbcbe50a3
362025-08-29T23:40:34.338ZINFOcrucible-agent (datafile): path is "/data/regions/414ed653-bf13-4cc2-b514-4f2dbcbe50a3"
372025-08-29T23:40:34.350ZINFOcrucible-agent (datafile): dataset is oxp_7d3b73ea-ce38-46b3-8429-a69c7fa0b20f/crucible/regions/414ed653-bf13-4cc2-b514-4f2dbcbe50a3
382025-08-29T23:40:34.363ZINFOcrucible-agent (datafile): region 414ed653-bf13-4cc2-b514-4f2dbcbe50a3 state: Created -> Tombstoned
392025-08-29T23:40:34.363ZINFOcrucible-agent (worker): applying SMF actions before removal...
402025-08-29T23:40:34.363ZINFOcrucible-agent (dropshot): request completed latency_us = 24625 local_addr = [fd00:1122:3344:101::13]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::a]:58027 req_id = ffcc3936-327d-48dd-a471-e4f6505e05c7 response_code = 204 uri = /crucible/0/regions/414ed653-bf13-4cc2-b514-4f2dbcbe50a3
412025-08-29T23:40:34.364ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-414ed653-bf13-4cc2-b514-4f2dbcbe50a3 (instance states: (Some(Online), None))
422025-08-29T23:40:34.367ZINFOcrucible-agent (dropshot): request completed latency_us = 34 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:58027 req_id = 17cae719-516b-4439-97cb-c76e4ec4ad40 response_code = 200 uri = /crucible/0/regions/414ed653-bf13-4cc2-b514-4f2dbcbe50a3
432025-08-29T23:40:34.372ZINFOcrucible-agent (worker): SMF ok!
442025-08-29T23:40:34.383ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_7d3b73ea-ce38-46b3-8429-a69c7fa0b20f/crucible/regions/414ed653-bf13-4cc2-b514-4f2dbcbe50a3" region = 414ed653-bf13-4cc2-b514-4f2dbcbe50a3
452025-08-29T23:40:34.424ZINFOcrucible-agent (dropshot): request completed latency_us = 80 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:58027 req_id = a6ca99c9-234e-4736-8e00-d36e2f34361c response_code = 200 uri = /crucible/0/regions/414ed653-bf13-4cc2-b514-4f2dbcbe50a3
462025-08-29T23:40:34.560ZINFOcrucible-agent (dropshot): request completed latency_us = 40 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:58027 req_id = 6d814fa7-a8f7-4fa7-801c-6593713f1141 response_code = 200 uri = /crucible/0/regions/414ed653-bf13-4cc2-b514-4f2dbcbe50a3
472025-08-29T23:40:34.629ZINFOcrucible-agent (datafile): region 414ed653-bf13-4cc2-b514-4f2dbcbe50a3 state: Tombstoned -> Destroyed
482025-08-29T23:40:34.746ZINFOcrucible-agent (dropshot): request completed latency_us = 43 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:58027 req_id = b50b29d4-bb05-4ee4-b0af-bfc018831f84 response_code = 200 uri = /crucible/0/regions/414ed653-bf13-4cc2-b514-4f2dbcbe50a3