Max level shown:
1 [ Nov 2 21:46:16 Enabled. ]
2 [ Nov 2 21:46:16 Rereading configuration. ]
3 [ Nov 2 21:46:18 Rereading configuration. ]
4 [ Nov 2 21:46:24 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_68f2a9a6-ea1b-46e4-baa8-cdd8cd01c818/crucible -l [fd00:1122:3344:101::1a]:32345 -P 19000 -p downstairs -s snapshot"). ]
5 note: configured to log to "/dev/stdout"
62026-11-02T21:46:24.676ZINFOcrucible-agent: Crucible Version: Crucible Version: 0.0.1 Commit SHA: f85cf0dc3631e2f0c13384787efb0efc1b642162 Commit timestamp: 2026-10-10T00:38:51.000000000Z branch: main rustc: 1.90.0 stable x86_64-unknown-illumos Cargo: x86_64-unknown-illumos Debug: false Opt level: 3
72026-11-02T21:46:24.677ZINFOcrucible-agent: dataset: "oxp_68f2a9a6-ea1b-46e4-baa8-cdd8cd01c818/crucible"
82026-11-02T21:46:24.677ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::1a]:32345
92026-11-02T21:46:24.677ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
102026-11-02T21:46:24.689ZINFOcrucible-agent (datafile): Using conf_path:"/data/crucible.json"
112026-11-02T21:46:24.768ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::1a]:32345
122026-11-02T21:58:07.644ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::1a]:32345 remote_addr = [fd00:1122:3344:101::b]:45827
132026-11-02T21:58:07.686ZINFOcrucible-agent (datafile): region 7abff053-5a49-4141-99d4-0ed0e4b7086c state: Requested
142026-11-02T21:58:07.693ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
152026-11-02T21:58:07.698ZINFOcrucible-agent (dropshot): request completed latency_us = 19032 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:45827 req_id = 9ff5d4e6-d3a0-47af-a867-f8d432c7e15f response_code = 200 uri = /crucible/0/regions
162026-11-02T21:58:07.703ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_68f2a9a6-ea1b-46e4-baa8-cdd8cd01c818/crucible/regions/7abff053-5a49-4141-99d4-0ed0e4b7086c
172026-11-02T21:58:07.703ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_68f2a9a6-ea1b-46e4-baa8-cdd8cd01c818/crucible/regions/7abff053-5a49-4141-99d4-0ed0e4b7086c
182026-11-02T21:58:07.764ZINFOcrucible-agent (worker): creating region Region { id: RegionId("7abff053-5a49-4141-99d4-0ed0e4b7086c"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/7abff053-5a49-4141-99d4-0ed0e4b7086c" region = 7abff053-5a49-4141-99d4-0ed0e4b7086c
192026-11-02T21:58:07.764ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "7abff053-5a49-4141-99d4-0ed0e4b7086c" "--data" "/data/regions/7abff053-5a49-4141-99d4-0ed0e4b7086c" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 7abff053-5a49-4141-99d4-0ed0e4b7086c
202026-11-02T21:58:07.906ZINFOcrucible-agent (dropshot): request completed latency_us = 79 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:45827 req_id = 9050cbee-6d53-496b-95d8-a1d9ce5d92a0 response_code = 200 uri = /crucible/0/regions
212026-11-02T21:58:08.181ZINFOcrucible-agent (worker): region files created ok region = 7abff053-5a49-4141-99d4-0ed0e4b7086c
222026-11-02T21:58:08.183ZINFOcrucible-agent (datafile): region 7abff053-5a49-4141-99d4-0ed0e4b7086c state: Requested -> Created
232026-11-02T21:58:08.183ZINFOcrucible-agent (worker): applying SMF actions post create...
242026-11-02T21:58:08.183ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-7abff053-5a49-4141-99d4-0ed0e4b7086c
252026-11-02T21:58:08.200ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-7abff053-5a49-4141-99d4-0ed0e4b7086c
262026-11-02T21:58:08.228ZINFOcrucible-agent (worker): creating config property group
272026-11-02T21:58:08.234ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-7abff053-5a49-4141-99d4-0ed0e4b7086c
282026-11-02T21:58:08.235ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/7abff053-5a49-4141-99d4-0ed0e4b7086c
292026-11-02T21:58:08.235ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
302026-11-02T21:58:08.235ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::1a
312026-11-02T21:58:08.235ZINFOcrucible-agent (worker): commit
322026-11-02T21:58:08.242ZINFOcrucible-agent (worker): ok!
332026-11-02T21:58:08.252ZINFOcrucible-agent (worker): SMF ok!
342026-11-02T21:58:08.267ZINFOcrucible-agent (dropshot): request completed latency_us = 93 local_addr = [fd00:1122:3344:101::1a]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:45827 req_id = 304a6fc8-7c11-4d0a-a6c6-4d7877c9c241 response_code = 200 uri = /crucible/0/regions
352026-11-02T21:58:43.450ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::1a]:32345 remote_addr = [fd00:1122:3344:101::b]:60694
362026-11-02T21:58:43.450ZINFOcrucible-agent (dropshot): request completed latency_us = 67 local_addr = [fd00:1122:3344:101::1a]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:60694 req_id = 4316c182-a0f4-4851-802f-3a82cf480c5e response_code = 200 uri = /crucible/0/regions/7abff053-5a49-4141-99d4-0ed0e4b7086c
372026-11-02T21:58:43.453ZINFOcrucible-agent (datafile): path is "/data/regions/7abff053-5a49-4141-99d4-0ed0e4b7086c"
382026-11-02T21:58:43.473ZINFOcrucible-agent (datafile): dataset is oxp_68f2a9a6-ea1b-46e4-baa8-cdd8cd01c818/crucible/regions/7abff053-5a49-4141-99d4-0ed0e4b7086c
392026-11-02T21:58:43.479ZINFOcrucible-agent (datafile): region 7abff053-5a49-4141-99d4-0ed0e4b7086c state: Created -> Tombstoned
402026-11-02T21:58:43.480ZINFOcrucible-agent (dropshot): request completed latency_us = 26329 local_addr = [fd00:1122:3344:101::1a]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::b]:60694 req_id = 46c7a8b5-fb05-4af3-a799-fdcd54806f3f response_code = 204 uri = /crucible/0/regions/7abff053-5a49-4141-99d4-0ed0e4b7086c
412026-11-02T21:58:43.480ZINFOcrucible-agent (worker): applying SMF actions before removal...
422026-11-02T21:58:43.481ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-7abff053-5a49-4141-99d4-0ed0e4b7086c (instance states: (Some(Online), None))
432026-11-02T21:58:43.482ZINFOcrucible-agent (dropshot): request completed latency_us = 38 local_addr = [fd00:1122:3344:101::1a]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:60694 req_id = 912848bf-29b9-4d5d-bc84-b2e650d1fcd0 response_code = 200 uri = /crucible/0/regions/7abff053-5a49-4141-99d4-0ed0e4b7086c
442026-11-02T21:58:43.495ZINFOcrucible-agent (worker): SMF ok!
452026-11-02T21:58:43.502ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_68f2a9a6-ea1b-46e4-baa8-cdd8cd01c818/crucible/regions/7abff053-5a49-4141-99d4-0ed0e4b7086c" region = 7abff053-5a49-4141-99d4-0ed0e4b7086c
462026-11-02T21:58:43.578ZINFOcrucible-agent (dropshot): request completed latency_us = 55 local_addr = [fd00:1122:3344:101::1a]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:60694 req_id = d0476031-0c78-4bba-8600-9e4d887d0cdb response_code = 200 uri = /crucible/0/regions/7abff053-5a49-4141-99d4-0ed0e4b7086c
472026-11-02T21:58:43.590ZINFOcrucible-agent (datafile): region 7abff053-5a49-4141-99d4-0ed0e4b7086c state: Tombstoned -> Destroyed
482026-11-02T21:58:43.748ZINFOcrucible-agent (dropshot): request completed latency_us = 61 local_addr = [fd00:1122:3344:101::1a]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:60694 req_id = b4050e81-a500-46eb-94dd-3ab15eed0577 response_code = 200 uri = /crucible/0/regions/7abff053-5a49-4141-99d4-0ed0e4b7086c