Max level shown:
1 [ Oct 22 19:58:47 Enabled. ]
2 [ Oct 22 19:58:47 Rereading configuration. ]
3 [ Oct 22 19:58:50 Rereading configuration. ]
4 [ Oct 22 19:58:54 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_e3c6b334-14d7-48fa-bf2a-c7f3b09c1021/crucible -l [fd00:1122:3344:101::19]:32345 -P 19000 -p downstairs -s snapshot"). ]
5 note: configured to log to "/dev/stdout"
62026-10-22T19:58:55.039ZINFOcrucible-agent: Crucible Version: Crucible Version: 0.0.1 Commit SHA: f85cf0dc3631e2f0c13384787efb0efc1b642162 Commit timestamp: 2026-10-10T00:38:51.000000000Z branch: main rustc: 1.90.0 stable x86_64-unknown-illumos Cargo: x86_64-unknown-illumos Debug: false Opt level: 3
72026-10-22T19:58:55.039ZINFOcrucible-agent: dataset: "oxp_e3c6b334-14d7-48fa-bf2a-c7f3b09c1021/crucible"
82026-10-22T19:58:55.039ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::19]:32345
92026-10-22T19:58:55.039ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
102026-10-22T19:58:55.053ZINFOcrucible-agent (datafile): Using conf_path:"/data/crucible.json"
112026-10-22T19:58:55.146ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::19]:32345
122026-10-22T19:59:36.728ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::19]:32345 remote_addr = [fd00:1122:3344:101::c]:38590
132026-10-22T19:59:36.760ZINFOcrucible-agent (datafile): region 4d6e0b51-06b1-4c1b-aad1-34bb1a07e9eb state: Requested
142026-10-22T19:59:36.768ZINFOcrucible-agent (worker): Region size:1073741824 reservation:1342177280 quota:3221225472
152026-10-22T19:59:36.772ZINFOcrucible-agent (dropshot): request completed latency_us = 16912 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:38590 req_id = 1c9133e4-d582-425f-96be-51406af623e7 response_code = 200 uri = /crucible/0/regions
162026-10-22T19:59:36.773ZINFOcrucible-agent (worker): zfs set reservation of 1342177280 for oxp_e3c6b334-14d7-48fa-bf2a-c7f3b09c1021/crucible/regions/4d6e0b51-06b1-4c1b-aad1-34bb1a07e9eb
172026-10-22T19:59:36.773ZINFOcrucible-agent (worker): zfs set quota of 3221225472 for oxp_e3c6b334-14d7-48fa-bf2a-c7f3b09c1021/crucible/regions/4d6e0b51-06b1-4c1b-aad1-34bb1a07e9eb
182026-10-22T19:59:36.994ZINFOcrucible-agent (worker): creating region Region { id: RegionId("4d6e0b51-06b1-4c1b-aad1-34bb1a07e9eb"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 16, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/4d6e0b51-06b1-4c1b-aad1-34bb1a07e9eb" region = 4d6e0b51-06b1-4c1b-aad1-34bb1a07e9eb
192026-10-22T19:59:36.994ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "4d6e0b51-06b1-4c1b-aad1-34bb1a07e9eb" "--data" "/data/regions/4d6e0b51-06b1-4c1b-aad1-34bb1a07e9eb" "--block-size" "512" "--extent-size" "131072" "--extent-count" "16" "--encrypted" region = 4d6e0b51-06b1-4c1b-aad1-34bb1a07e9eb
202026-10-22T19:59:37.017ZINFOcrucible-agent (dropshot): request completed latency_us = 149 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:38590 req_id = 8f412cf9-3edf-49df-b22b-d364c96ba6f0 response_code = 200 uri = /crucible/0/regions
212026-10-22T19:59:37.387ZINFOcrucible-agent (worker): region files created ok region = 4d6e0b51-06b1-4c1b-aad1-34bb1a07e9eb
222026-10-22T19:59:37.389ZINFOcrucible-agent (datafile): region 4d6e0b51-06b1-4c1b-aad1-34bb1a07e9eb state: Requested -> Created
232026-10-22T19:59:37.389ZINFOcrucible-agent (worker): applying SMF actions post create...
242026-10-22T19:59:37.390ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-4d6e0b51-06b1-4c1b-aad1-34bb1a07e9eb
252026-10-22T19:59:37.416ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-4d6e0b51-06b1-4c1b-aad1-34bb1a07e9eb
262026-10-22T19:59:37.479ZINFOcrucible-agent (worker): creating config property group
272026-10-22T19:59:37.525ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-4d6e0b51-06b1-4c1b-aad1-34bb1a07e9eb
282026-10-22T19:59:37.526ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/4d6e0b51-06b1-4c1b-aad1-34bb1a07e9eb
292026-10-22T19:59:37.526ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
302026-10-22T19:59:37.526ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::19
312026-10-22T19:59:37.526ZINFOcrucible-agent (worker): commit
322026-10-22T19:59:37.556ZINFOcrucible-agent (worker): ok!
332026-10-22T19:59:37.599ZINFOcrucible-agent (dropshot): request completed latency_us = 79 local_addr = [fd00:1122:3344:101::19]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:38590 req_id = 4ff2d818-f95b-466d-9cd5-d43983bfa53b response_code = 200 uri = /crucible/0/regions
342026-10-22T19:59:37.617ZINFOcrucible-agent (worker): SMF ok!
352026-10-22T19:59:39.642ZINFOcrucible-agent (dropshot): request completed latency_us = 72 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:38590 req_id = c7c9371f-fa86-4bb8-8852-014720afa6da response_code = 200 uri = /crucible/0/regions/4d6e0b51-06b1-4c1b-aad1-34bb1a07e9eb
362026-10-22T19:59:39.646ZINFOcrucible-agent (datafile): path is "/data/regions/4d6e0b51-06b1-4c1b-aad1-34bb1a07e9eb"
372026-10-22T19:59:39.654ZINFOcrucible-agent (datafile): dataset is oxp_e3c6b334-14d7-48fa-bf2a-c7f3b09c1021/crucible/regions/4d6e0b51-06b1-4c1b-aad1-34bb1a07e9eb
382026-10-22T19:59:39.660ZINFOcrucible-agent (datafile): region 4d6e0b51-06b1-4c1b-aad1-34bb1a07e9eb state: Created -> Tombstoned
392026-10-22T19:59:39.661ZINFOcrucible-agent (worker): applying SMF actions before removal...
402026-10-22T19:59:39.661ZINFOcrucible-agent (dropshot): request completed latency_us = 14792 local_addr = [fd00:1122:3344:101::19]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::c]:38590 req_id = 1d9386cc-537c-497c-8505-5f86b9b1dda1 response_code = 204 uri = /crucible/0/regions/4d6e0b51-06b1-4c1b-aad1-34bb1a07e9eb
412026-10-22T19:59:39.662ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-4d6e0b51-06b1-4c1b-aad1-34bb1a07e9eb (instance states: (Some(Online), None))
422026-10-22T19:59:39.664ZINFOcrucible-agent (dropshot): request completed latency_us = 47 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:38590 req_id = e622d9dd-5a43-47d1-9008-16761b2ec420 response_code = 200 uri = /crucible/0/regions/4d6e0b51-06b1-4c1b-aad1-34bb1a07e9eb
432026-10-22T19:59:39.689ZINFOcrucible-agent (worker): SMF ok!
442026-10-22T19:59:39.698ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_e3c6b334-14d7-48fa-bf2a-c7f3b09c1021/crucible/regions/4d6e0b51-06b1-4c1b-aad1-34bb1a07e9eb" region = 4d6e0b51-06b1-4c1b-aad1-34bb1a07e9eb
452026-10-22T19:59:39.749ZINFOcrucible-agent (dropshot): request completed latency_us = 51 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:38590 req_id = 642a034b-c829-4dab-89fe-dbadd4ac2e2d response_code = 200 uri = /crucible/0/regions/4d6e0b51-06b1-4c1b-aad1-34bb1a07e9eb
462026-10-22T19:59:39.884ZINFOcrucible-agent (dropshot): request completed latency_us = 40 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:38590 req_id = ceca3e4a-8018-4749-9625-2782257a0674 response_code = 200 uri = /crucible/0/regions/4d6e0b51-06b1-4c1b-aad1-34bb1a07e9eb
472026-10-22T19:59:40.001ZINFOcrucible-agent (datafile): region 4d6e0b51-06b1-4c1b-aad1-34bb1a07e9eb state: Tombstoned -> Destroyed
482026-10-22T19:59:40.077ZINFOcrucible-agent (dropshot): request completed latency_us = 52 local_addr = [fd00:1122:3344:101::19]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:38590 req_id = 82d3bb68-11fc-4cd7-ba12-2664d651a9e2 response_code = 200 uri = /crucible/0/regions/4d6e0b51-06b1-4c1b-aad1-34bb1a07e9eb