Max level shown:
1 [ Jun 3 22:45:04 Enabled. ]
2 [ Jun 3 22:45:04 Rereading configuration. ]
3 [ Jun 3 22:45:05 Rereading configuration. ]
4 [ Jun 3 22:45:08 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_4043f8d5-6c98-45f3-9687-cc5d340bd98f/crucible -l [fd00:1122:3344:101::19]:32345 -P 19000 -p downstairs -s snapshot"). ]
5 note: configured to log to "/dev/stdout"
62026-06-03T22:45:08.371ZINFOcrucible-agent: Crucible Version: Crucible Version: 0.0.1 Commit SHA: bd9a0e2abe6b6b89aec8c85f4ee57474144ed150 Commit timestamp: 2026-05-14T15:48:00.000000000Z branch: main rustc: 1.90.0 stable x86_64-unknown-illumos Cargo: x86_64-unknown-illumos Debug: false Opt level: 3
72026-06-03T22:45:08.371ZINFOcrucible-agent: dataset: "oxp_4043f8d5-6c98-45f3-9687-cc5d340bd98f/crucible"
82026-06-03T22:45:08.371ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::19]:32345
92026-06-03T22:45:08.371ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
102026-06-03T22:45:08.393ZINFOcrucible-agent (datafile): Using conf_path:"/data/crucible.json"
112026-06-03T22:45:08.461ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::19]:32345
122026-06-03T22:57:46.054ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::19]:32345 remote_addr = [fd00:1122:3344:101::b]:33314
132026-06-03T22:57:46.101ZINFOcrucible-agent (datafile): region c184e392-9ee0-41ab-8f9d-06e0b4bb934f state: Requested
142026-06-03T22:57:46.106ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
152026-06-03T22:57:46.106ZINFOcrucible-agent (dropshot): request completed latency_us = 17579 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:33314 req_id = eb16ea5c-171f-40ed-8c2b-d27cbb8262e5 response_code = 200 uri = /crucible/0/regions
162026-06-03T22:57:46.116ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_4043f8d5-6c98-45f3-9687-cc5d340bd98f/crucible/regions/c184e392-9ee0-41ab-8f9d-06e0b4bb934f
172026-06-03T22:57:46.116ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_4043f8d5-6c98-45f3-9687-cc5d340bd98f/crucible/regions/c184e392-9ee0-41ab-8f9d-06e0b4bb934f
182026-06-03T22:57:46.162ZINFOcrucible-agent (worker): creating region Region { id: RegionId("c184e392-9ee0-41ab-8f9d-06e0b4bb934f"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/c184e392-9ee0-41ab-8f9d-06e0b4bb934f" region = c184e392-9ee0-41ab-8f9d-06e0b4bb934f
192026-06-03T22:57:46.165ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "c184e392-9ee0-41ab-8f9d-06e0b4bb934f" "--data" "/data/regions/c184e392-9ee0-41ab-8f9d-06e0b4bb934f" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = c184e392-9ee0-41ab-8f9d-06e0b4bb934f
202026-06-03T22:57:46.496ZINFOcrucible-agent (dropshot): request completed latency_us = 65 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:33314 req_id = b89682ca-edb8-4687-8d54-c302e7b831e8 response_code = 200 uri = /crucible/0/regions
212026-06-03T22:57:46.505ZINFOcrucible-agent (worker): region files created ok region = c184e392-9ee0-41ab-8f9d-06e0b4bb934f
222026-06-03T22:57:46.505ZINFOcrucible-agent (datafile): region c184e392-9ee0-41ab-8f9d-06e0b4bb934f state: Requested -> Created
232026-06-03T22:57:46.505ZINFOcrucible-agent (worker): applying SMF actions post create...
242026-06-03T22:57:46.508ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-c184e392-9ee0-41ab-8f9d-06e0b4bb934f
252026-06-03T22:57:46.517ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-c184e392-9ee0-41ab-8f9d-06e0b4bb934f
262026-06-03T22:57:46.533ZINFOcrucible-agent (worker): creating config property group
272026-06-03T22:57:46.534ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-c184e392-9ee0-41ab-8f9d-06e0b4bb934f
282026-06-03T22:57:46.537ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/c184e392-9ee0-41ab-8f9d-06e0b4bb934f
292026-06-03T22:57:46.537ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
302026-06-03T22:57:46.537ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::19
312026-06-03T22:57:46.537ZINFOcrucible-agent (worker): commit
322026-06-03T22:57:46.550ZINFOcrucible-agent (worker): ok!
332026-06-03T22:57:46.553ZINFOcrucible-agent (worker): SMF ok!
342026-06-03T22:57:46.804ZINFOcrucible-agent (dropshot): request completed latency_us = 85 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:33314 req_id = e242fa89-97f8-4fe9-8f79-084c38ace7e9 response_code = 200 uri = /crucible/0/regions
352026-06-03T22:58:11.183ZINFOcrucible-agent (dropshot): request completed latency_us = 72 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:33314 req_id = bab515f5-6f18-45c4-80d3-ecd3855724cf response_code = 200 uri = /crucible/0/regions/c184e392-9ee0-41ab-8f9d-06e0b4bb934f
362026-06-03T22:58:11.186ZINFOcrucible-agent (datafile): path is "/data/regions/c184e392-9ee0-41ab-8f9d-06e0b4bb934f"
372026-06-03T22:58:11.196ZINFOcrucible-agent (datafile): dataset is oxp_4043f8d5-6c98-45f3-9687-cc5d340bd98f/crucible/regions/c184e392-9ee0-41ab-8f9d-06e0b4bb934f
382026-06-03T22:58:11.204ZINFOcrucible-agent (datafile): region c184e392-9ee0-41ab-8f9d-06e0b4bb934f state: Created -> Tombstoned
392026-06-03T22:58:11.204ZINFOcrucible-agent (worker): applying SMF actions before removal...
402026-06-03T22:58:11.204ZINFOcrucible-agent (dropshot): request completed latency_us = 17701 local_addr = [fd00:1122:3344:101::19]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::b]:33314 req_id = c672224a-ba5f-4db8-a3be-b6edba4863b3 response_code = 204 uri = /crucible/0/regions/c184e392-9ee0-41ab-8f9d-06e0b4bb934f
412026-06-03T22:58:11.205ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-c184e392-9ee0-41ab-8f9d-06e0b4bb934f (instance states: (Some(Online), None))
422026-06-03T22:58:11.207ZINFOcrucible-agent (dropshot): request completed latency_us = 55 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:33314 req_id = 6abbdce0-2117-4cd6-81cc-e0698fd53995 response_code = 200 uri = /crucible/0/regions/c184e392-9ee0-41ab-8f9d-06e0b4bb934f
432026-06-03T22:58:11.207ZINFOcrucible-agent (worker): SMF ok!
442026-06-03T22:58:11.215ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_4043f8d5-6c98-45f3-9687-cc5d340bd98f/crucible/regions/c184e392-9ee0-41ab-8f9d-06e0b4bb934f" region = c184e392-9ee0-41ab-8f9d-06e0b4bb934f
452026-06-03T22:58:11.269ZINFOcrucible-agent (dropshot): request completed latency_us = 52 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:33314 req_id = d9098948-48a5-4063-94ea-4be15674362b response_code = 200 uri = /crucible/0/regions/c184e392-9ee0-41ab-8f9d-06e0b4bb934f
462026-06-03T22:58:11.279ZINFOcrucible-agent (datafile): region c184e392-9ee0-41ab-8f9d-06e0b4bb934f state: Tombstoned -> Destroyed
472026-06-03T22:58:11.432ZINFOcrucible-agent (dropshot): request completed latency_us = 33 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:33314 req_id = 37d595b5-476e-4ede-a6e2-343109876d4d response_code = 200 uri = /crucible/0/regions/c184e392-9ee0-41ab-8f9d-06e0b4bb934f