Max level shown:
1 [ Jul 22 01:41:46 Enabled. ]
2 [ Jul 22 01:41:46 Rereading configuration. ]
3 [ Jul 22 01:41:47 Rereading configuration. ]
4 [ Jul 22 01:41:50 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_8eab669a-f5f2-4dff-b735-f5c54ef84349/crucible -l [fd00:1122:3344:101::14]:32345 -P 19000 -p downstairs -s snapshot"). ]
5 note: configured to log to "/dev/stdout"
62026-07-22T01:41:50.768ZINFOcrucible-agent: Crucible Version: Crucible Version: 0.0.1 Commit SHA: 2bfe090eb5318ec8c467157018db2429d4df535b Commit timestamp: 2026-06-25T19:33:01.000000000Z branch: main rustc: 1.90.0 stable x86_64-unknown-illumos Cargo: x86_64-unknown-illumos Debug: false Opt level: 3
72026-07-22T01:41:50.768ZINFOcrucible-agent: dataset: "oxp_8eab669a-f5f2-4dff-b735-f5c54ef84349/crucible"
82026-07-22T01:41:50.768ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::14]:32345
92026-07-22T01:41:50.768ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
102026-07-22T01:41:50.792ZINFOcrucible-agent (datafile): Using conf_path:"/data/crucible.json"
112026-07-22T01:41:50.898ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::14]:32345
122026-07-22T01:43:13.241ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::14]:32345 remote_addr = [fd00:1122:3344:101::b]:36081
132026-07-22T01:43:13.270ZINFOcrucible-agent (datafile): region 5648b647-0584-4bc9-a5d5-10259519d833 state: Requested
142026-07-22T01:43:13.273ZINFOcrucible-agent (worker): Region size:1073741824 reservation:1342177280 quota:3221225472
152026-07-22T01:43:13.276ZINFOcrucible-agent (dropshot): request completed latency_us = 18448 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:36081 req_id = d6652435-8f8b-479f-9f75-fcf61ca208ba response_code = 200 uri = /crucible/0/regions
162026-07-22T01:43:13.282ZINFOcrucible-agent (worker): zfs set reservation of 1342177280 for oxp_8eab669a-f5f2-4dff-b735-f5c54ef84349/crucible/regions/5648b647-0584-4bc9-a5d5-10259519d833
172026-07-22T01:43:13.282ZINFOcrucible-agent (worker): zfs set quota of 3221225472 for oxp_8eab669a-f5f2-4dff-b735-f5c54ef84349/crucible/regions/5648b647-0584-4bc9-a5d5-10259519d833
182026-07-22T01:43:13.325ZINFOcrucible-agent (worker): creating region Region { id: RegionId("5648b647-0584-4bc9-a5d5-10259519d833"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 16, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/5648b647-0584-4bc9-a5d5-10259519d833" region = 5648b647-0584-4bc9-a5d5-10259519d833
192026-07-22T01:43:13.325ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "5648b647-0584-4bc9-a5d5-10259519d833" "--data" "/data/regions/5648b647-0584-4bc9-a5d5-10259519d833" "--block-size" "512" "--extent-size" "131072" "--extent-count" "16" "--encrypted" region = 5648b647-0584-4bc9-a5d5-10259519d833
202026-07-22T01:43:13.502ZINFOcrucible-agent (dropshot): request completed latency_us = 59 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:36081 req_id = e90d8da5-dce9-4540-b6bc-e062b3a1a99b response_code = 200 uri = /crucible/0/regions
212026-07-22T01:43:13.648ZINFOcrucible-agent (worker): region files created ok region = 5648b647-0584-4bc9-a5d5-10259519d833
222026-07-22T01:43:13.650ZINFOcrucible-agent (datafile): region 5648b647-0584-4bc9-a5d5-10259519d833 state: Requested -> Created
232026-07-22T01:43:13.650ZINFOcrucible-agent (worker): applying SMF actions post create...
242026-07-22T01:43:13.653ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-5648b647-0584-4bc9-a5d5-10259519d833
252026-07-22T01:43:13.657ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-5648b647-0584-4bc9-a5d5-10259519d833
262026-07-22T01:43:13.666ZINFOcrucible-agent (worker): creating config property group
272026-07-22T01:43:13.667ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-5648b647-0584-4bc9-a5d5-10259519d833
282026-07-22T01:43:13.668ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/5648b647-0584-4bc9-a5d5-10259519d833
292026-07-22T01:43:13.670ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
302026-07-22T01:43:13.671ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::14
312026-07-22T01:43:13.671ZINFOcrucible-agent (worker): commit
322026-07-22T01:43:13.677ZINFOcrucible-agent (worker): ok!
332026-07-22T01:43:13.680ZINFOcrucible-agent (worker): SMF ok!
342026-07-22T01:43:13.916ZINFOcrucible-agent (dropshot): request completed latency_us = 86 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:36081 req_id = 2ed0e28a-c15b-4d06-b7f5-7910126a973e response_code = 200 uri = /crucible/0/regions
352026-07-22T01:43:14.551ZINFOcrucible-agent (dropshot): request completed latency_us = 69 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:36081 req_id = 786ea5e9-7efa-475e-9da2-5569c457672a response_code = 200 uri = /crucible/0/regions/5648b647-0584-4bc9-a5d5-10259519d833
362026-07-22T01:43:14.554ZINFOcrucible-agent (datafile): path is "/data/regions/5648b647-0584-4bc9-a5d5-10259519d833"
372026-07-22T01:43:14.562ZINFOcrucible-agent (datafile): dataset is oxp_8eab669a-f5f2-4dff-b735-f5c54ef84349/crucible/regions/5648b647-0584-4bc9-a5d5-10259519d833
382026-07-22T01:43:14.570ZINFOcrucible-agent (datafile): region 5648b647-0584-4bc9-a5d5-10259519d833 state: Created -> Tombstoned
392026-07-22T01:43:14.570ZINFOcrucible-agent (worker): applying SMF actions before removal...
402026-07-22T01:43:14.570ZINFOcrucible-agent (dropshot): request completed latency_us = 16314 local_addr = [fd00:1122:3344:101::14]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::b]:36081 req_id = be141831-97b9-4fe9-8c14-f4b298900da9 response_code = 204 uri = /crucible/0/regions/5648b647-0584-4bc9-a5d5-10259519d833
412026-07-22T01:43:14.572ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-5648b647-0584-4bc9-a5d5-10259519d833 (instance states: (Some(Online), None))
422026-07-22T01:43:14.574ZINFOcrucible-agent (worker): SMF ok!
432026-07-22T01:43:14.575ZINFOcrucible-agent (dropshot): request completed latency_us = 48 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:36081 req_id = 8d78b5b5-13a9-4395-93a0-2cb1320b68a0 response_code = 200 uri = /crucible/0/regions/5648b647-0584-4bc9-a5d5-10259519d833
442026-07-22T01:43:14.584ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_8eab669a-f5f2-4dff-b735-f5c54ef84349/crucible/regions/5648b647-0584-4bc9-a5d5-10259519d833" region = 5648b647-0584-4bc9-a5d5-10259519d833
452026-07-22T01:43:14.647ZINFOcrucible-agent (datafile): region 5648b647-0584-4bc9-a5d5-10259519d833 state: Tombstoned -> Destroyed
462026-07-22T01:43:14.712ZINFOcrucible-agent (dropshot): request completed latency_us = 58 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:36081 req_id = d9aca25f-0922-4703-b64d-5fdd8a71759e response_code = 200 uri = /crucible/0/regions/5648b647-0584-4bc9-a5d5-10259519d833