Max level shown:
1 [ Nov 11 21:11:15 Enabled. ]
2 [ Nov 11 21:11:15 Rereading configuration. ]
3 [ Nov 11 21:11:18 Rereading configuration. ]
4 [ Nov 11 21:11:28 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_567e37fb-cb1f-4405-ba45-7ab057a79127/crucible -l [fd00:1122:3344:101::19]:32345 -P 19000 -p downstairs -s snapshot"). ]
5 note: configured to log to "/dev/stdout"
62025-11-11T21:11:29.105ZINFOcrucible-agent: Crucible Version: Crucible Version: 0.0.1 Commit SHA: 75ea3408643664877aa603ffc65996ed6dc34c0a Commit timestamp: 2025-10-24T15:21:57.000000000Z branch: main rustc: 1.90.0 stable x86_64-unknown-illumos Cargo: x86_64-unknown-illumos Debug: false Opt level: 3
72025-11-11T21:11:29.106ZINFOcrucible-agent: dataset: "oxp_567e37fb-cb1f-4405-ba45-7ab057a79127/crucible"
82025-11-11T21:11:29.106ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::19]:32345
92025-11-11T21:11:29.106ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
102025-11-11T21:11:29.121ZINFOcrucible-agent (datafile): Using conf_path:"/data/crucible.json"
112025-11-11T21:11:29.200ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::19]:32345
122025-11-11T21:12:26.432ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::19]:32345 remote_addr = [fd00:1122:3344:101::a]:53938
132025-11-11T21:12:26.469ZINFOcrucible-agent (datafile): region d3a1ca35-bf88-4afa-b2e2-8deaaf39a2d2 state: Requested
142025-11-11T21:12:26.471ZINFOcrucible-agent (dropshot): request completed latency_us = 17399 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:53938 req_id = 7c47ba33-d23a-4449-9478-7f25db18482d response_code = 200 uri = /crucible/0/regions
152025-11-11T21:12:26.472ZINFOcrucible-agent (worker): Region size:1073741824 reservation:1342177280 quota:3221225472
162025-11-11T21:12:26.481ZINFOcrucible-agent (worker): zfs set reservation of 1342177280 for oxp_567e37fb-cb1f-4405-ba45-7ab057a79127/crucible/regions/d3a1ca35-bf88-4afa-b2e2-8deaaf39a2d2
172025-11-11T21:12:26.481ZINFOcrucible-agent (worker): zfs set quota of 3221225472 for oxp_567e37fb-cb1f-4405-ba45-7ab057a79127/crucible/regions/d3a1ca35-bf88-4afa-b2e2-8deaaf39a2d2
182025-11-11T21:12:26.539ZINFOcrucible-agent (worker): creating region Region { id: RegionId("d3a1ca35-bf88-4afa-b2e2-8deaaf39a2d2"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 16, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/d3a1ca35-bf88-4afa-b2e2-8deaaf39a2d2" region = d3a1ca35-bf88-4afa-b2e2-8deaaf39a2d2
192025-11-11T21:12:26.542ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "d3a1ca35-bf88-4afa-b2e2-8deaaf39a2d2" "--data" "/data/regions/d3a1ca35-bf88-4afa-b2e2-8deaaf39a2d2" "--block-size" "512" "--extent-size" "131072" "--extent-count" "16" "--encrypted" region = d3a1ca35-bf88-4afa-b2e2-8deaaf39a2d2
202025-11-11T21:12:26.628ZINFOcrucible-agent (dropshot): request completed latency_us = 62 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:53938 req_id = 4c6c11a9-0581-4a93-8325-c3b3db9d14fa response_code = 200 uri = /crucible/0/regions
212025-11-11T21:12:26.877ZINFOcrucible-agent (worker): region files created ok region = d3a1ca35-bf88-4afa-b2e2-8deaaf39a2d2
222025-11-11T21:12:26.877ZINFOcrucible-agent (datafile): region d3a1ca35-bf88-4afa-b2e2-8deaaf39a2d2 state: Requested -> Created
232025-11-11T21:12:26.877ZINFOcrucible-agent (worker): applying SMF actions post create...
242025-11-11T21:12:26.877ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-d3a1ca35-bf88-4afa-b2e2-8deaaf39a2d2
252025-11-11T21:12:26.885ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-d3a1ca35-bf88-4afa-b2e2-8deaaf39a2d2
262025-11-11T21:12:26.903ZINFOcrucible-agent (worker): creating config property group
272025-11-11T21:12:26.907ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-d3a1ca35-bf88-4afa-b2e2-8deaaf39a2d2
282025-11-11T21:12:26.908ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/d3a1ca35-bf88-4afa-b2e2-8deaaf39a2d2
292025-11-11T21:12:26.908ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
302025-11-11T21:12:26.908ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::19
312025-11-11T21:12:26.908ZINFOcrucible-agent (worker): commit
322025-11-11T21:12:26.912ZINFOcrucible-agent (worker): ok!
332025-11-11T21:12:26.916ZINFOcrucible-agent (worker): SMF ok!
342025-11-11T21:12:27.268ZINFOcrucible-agent (dropshot): request completed latency_us = 58 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:53938 req_id = 2ccab7f8-4703-41d8-ac60-da23b792ff22 response_code = 200 uri = /crucible/0/regions
352025-11-11T21:12:28.164ZINFOcrucible-agent (dropshot): request completed latency_us = 91 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:53938 req_id = 244a0528-2090-49f6-a2b0-b0f9acf667c2 response_code = 200 uri = /crucible/0/regions/d3a1ca35-bf88-4afa-b2e2-8deaaf39a2d2
362025-11-11T21:12:28.168ZINFOcrucible-agent (datafile): path is "/data/regions/d3a1ca35-bf88-4afa-b2e2-8deaaf39a2d2"
372025-11-11T21:12:28.176ZINFOcrucible-agent (datafile): dataset is oxp_567e37fb-cb1f-4405-ba45-7ab057a79127/crucible/regions/d3a1ca35-bf88-4afa-b2e2-8deaaf39a2d2
382025-11-11T21:12:28.183ZINFOcrucible-agent (datafile): region d3a1ca35-bf88-4afa-b2e2-8deaaf39a2d2 state: Created -> Tombstoned
392025-11-11T21:12:28.183ZINFOcrucible-agent (worker): applying SMF actions before removal...
402025-11-11T21:12:28.183ZINFOcrucible-agent (dropshot): request completed latency_us = 15090 local_addr = [fd00:1122:3344:101::19]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::a]:53938 req_id = f51b4f66-847d-42b3-b519-317bbf7255d5 response_code = 204 uri = /crucible/0/regions/d3a1ca35-bf88-4afa-b2e2-8deaaf39a2d2
412025-11-11T21:12:28.184ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-d3a1ca35-bf88-4afa-b2e2-8deaaf39a2d2 (instance states: (Some(Online), None))
422025-11-11T21:12:28.190ZINFOcrucible-agent (dropshot): request completed latency_us = 33 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:53938 req_id = b812879f-c709-4c87-94a4-97f2d85169d3 response_code = 200 uri = /crucible/0/regions/d3a1ca35-bf88-4afa-b2e2-8deaaf39a2d2
432025-11-11T21:12:28.192ZINFOcrucible-agent (worker): SMF ok!
442025-11-11T21:12:28.200ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_567e37fb-cb1f-4405-ba45-7ab057a79127/crucible/regions/d3a1ca35-bf88-4afa-b2e2-8deaaf39a2d2" region = d3a1ca35-bf88-4afa-b2e2-8deaaf39a2d2
452025-11-11T21:12:28.270ZINFOcrucible-agent (datafile): region d3a1ca35-bf88-4afa-b2e2-8deaaf39a2d2 state: Tombstoned -> Destroyed
462025-11-11T21:12:28.295ZINFOcrucible-agent (dropshot): request completed latency_us = 52 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:53938 req_id = fd1e23fc-e5dc-4666-95d8-ace38794a4db response_code = 200 uri = /crucible/0/regions/d3a1ca35-bf88-4afa-b2e2-8deaaf39a2d2