Max level shown:
1 [ Jan 21 23:42:37 Enabled. ]
2 [ Jan 21 23:42:37 Rereading configuration. ]
3 [ Jan 21 23:42:41 Rereading configuration. ]
4 [ Jan 21 23:42:45 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_57ad9c1f-5857-43c6-ac23-6ab5ab01ac17/crucible -l [fd00:1122:3344:101::18]:32345 -P 19000 -p downstairs -s snapshot"). ]
5 note: configured to log to "/dev/stdout"
62026-01-21T23:42:45.766ZINFOcrucible-agent: Crucible Version: Crucible Version: 0.0.1 Commit SHA: 7103cd3a3d7b0112d2949dd135db06fef0c156bb Commit timestamp: 2025-11-10T22:24:53.000000000Z branch: main rustc: 1.90.0 stable x86_64-unknown-illumos Cargo: x86_64-unknown-illumos Debug: false Opt level: 3
72026-01-21T23:42:45.767ZINFOcrucible-agent: dataset: "oxp_57ad9c1f-5857-43c6-ac23-6ab5ab01ac17/crucible"
82026-01-21T23:42:45.767ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::18]:32345
92026-01-21T23:42:45.767ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
102026-01-21T23:42:45.782ZINFOcrucible-agent (datafile): Using conf_path:"/data/crucible.json"
112026-01-21T23:42:46.010ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::18]:32345
122026-01-21T23:43:15.531ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::18]:32345 remote_addr = [fd00:1122:3344:101::b]:51997
132026-01-21T23:43:15.572ZINFOcrucible-agent (datafile): region 606fdb4a-695f-417d-ad2d-09677d37a45f state: Requested
142026-01-21T23:43:15.575ZINFOcrucible-agent (worker): Region size:1073741824 reservation:1342177280 quota:3221225472
152026-01-21T23:43:15.575ZINFOcrucible-agent (dropshot): request completed latency_us = 19561 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:51997 req_id = b66d4b04-0fa0-4eab-a282-ce5bc79d0830 response_code = 200 uri = /crucible/0/regions
162026-01-21T23:43:15.583ZINFOcrucible-agent (worker): zfs set reservation of 1342177280 for oxp_57ad9c1f-5857-43c6-ac23-6ab5ab01ac17/crucible/regions/606fdb4a-695f-417d-ad2d-09677d37a45f
172026-01-21T23:43:15.583ZINFOcrucible-agent (worker): zfs set quota of 3221225472 for oxp_57ad9c1f-5857-43c6-ac23-6ab5ab01ac17/crucible/regions/606fdb4a-695f-417d-ad2d-09677d37a45f
182026-01-21T23:43:15.714ZINFOcrucible-agent (worker): creating region Region { id: RegionId("606fdb4a-695f-417d-ad2d-09677d37a45f"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 16, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/606fdb4a-695f-417d-ad2d-09677d37a45f" region = 606fdb4a-695f-417d-ad2d-09677d37a45f
192026-01-21T23:43:15.719ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "606fdb4a-695f-417d-ad2d-09677d37a45f" "--data" "/data/regions/606fdb4a-695f-417d-ad2d-09677d37a45f" "--block-size" "512" "--extent-size" "131072" "--extent-count" "16" "--encrypted" region = 606fdb4a-695f-417d-ad2d-09677d37a45f
202026-01-21T23:43:15.780ZINFOcrucible-agent (dropshot): request completed latency_us = 61 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:51997 req_id = 41695006-584d-40e6-8762-fd090f86635f response_code = 200 uri = /crucible/0/regions
212026-01-21T23:43:16.216ZINFOcrucible-agent (worker): region files created ok region = 606fdb4a-695f-417d-ad2d-09677d37a45f
222026-01-21T23:43:16.216ZINFOcrucible-agent (datafile): region 606fdb4a-695f-417d-ad2d-09677d37a45f state: Requested -> Created
232026-01-21T23:43:16.216ZINFOcrucible-agent (worker): applying SMF actions post create...
242026-01-21T23:43:16.216ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-606fdb4a-695f-417d-ad2d-09677d37a45f
252026-01-21T23:43:16.221ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-606fdb4a-695f-417d-ad2d-09677d37a45f
262026-01-21T23:43:16.243ZINFOcrucible-agent (worker): creating config property group
272026-01-21T23:43:16.246ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-606fdb4a-695f-417d-ad2d-09677d37a45f
282026-01-21T23:43:16.247ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/606fdb4a-695f-417d-ad2d-09677d37a45f
292026-01-21T23:43:16.247ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
302026-01-21T23:43:16.247ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::18
312026-01-21T23:43:16.247ZINFOcrucible-agent (worker): commit
322026-01-21T23:43:16.251ZINFOcrucible-agent (worker): ok!
332026-01-21T23:43:16.260ZINFOcrucible-agent (worker): SMF ok!
342026-01-21T23:43:16.426ZINFOcrucible-agent (dropshot): request completed latency_us = 68 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:51997 req_id = ae6be64f-2302-4cb4-b4ed-3e15c5875f15 response_code = 200 uri = /crucible/0/regions
352026-01-21T23:43:17.407ZINFOcrucible-agent (dropshot): request completed latency_us = 82 local_addr = [fd00:1122:3344:101::18]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:51997 req_id = 49f128d4-fc23-471f-becf-b8835f4f8b02 response_code = 200 uri = /crucible/0/regions/606fdb4a-695f-417d-ad2d-09677d37a45f
362026-01-21T23:43:17.411ZINFOcrucible-agent (datafile): path is "/data/regions/606fdb4a-695f-417d-ad2d-09677d37a45f"
372026-01-21T23:43:17.418ZINFOcrucible-agent (datafile): dataset is oxp_57ad9c1f-5857-43c6-ac23-6ab5ab01ac17/crucible/regions/606fdb4a-695f-417d-ad2d-09677d37a45f
382026-01-21T23:43:17.425ZINFOcrucible-agent (datafile): region 606fdb4a-695f-417d-ad2d-09677d37a45f state: Created -> Tombstoned
392026-01-21T23:43:17.425ZINFOcrucible-agent (worker): applying SMF actions before removal...
402026-01-21T23:43:17.425ZINFOcrucible-agent (dropshot): request completed latency_us = 14698 local_addr = [fd00:1122:3344:101::18]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::b]:51997 req_id = a4d22db9-0410-4265-bf55-05a0b0b5d9ea response_code = 204 uri = /crucible/0/regions/606fdb4a-695f-417d-ad2d-09677d37a45f
412026-01-21T23:43:17.426ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-606fdb4a-695f-417d-ad2d-09677d37a45f (instance states: (Some(Online), None))
422026-01-21T23:43:17.429ZINFOcrucible-agent (dropshot): request completed latency_us = 31 local_addr = [fd00:1122:3344:101::18]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:51997 req_id = 4823a2ea-b9bf-4a12-ad42-ea667d167e93 response_code = 200 uri = /crucible/0/regions/606fdb4a-695f-417d-ad2d-09677d37a45f
432026-01-21T23:43:17.436ZINFOcrucible-agent (worker): SMF ok!
442026-01-21T23:43:17.445ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_57ad9c1f-5857-43c6-ac23-6ab5ab01ac17/crucible/regions/606fdb4a-695f-417d-ad2d-09677d37a45f" region = 606fdb4a-695f-417d-ad2d-09677d37a45f
452026-01-21T23:43:17.556ZINFOcrucible-agent (dropshot): request completed latency_us = 52 local_addr = [fd00:1122:3344:101::18]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:51997 req_id = 6bd9553b-b437-4e7e-8b2b-435a7bdeb7b4 response_code = 200 uri = /crucible/0/regions/606fdb4a-695f-417d-ad2d-09677d37a45f
462026-01-21T23:43:17.595ZINFOcrucible-agent (datafile): region 606fdb4a-695f-417d-ad2d-09677d37a45f state: Tombstoned -> Destroyed
472026-01-21T23:43:17.628ZINFOcrucible-agent (dropshot): request completed latency_us = 37 local_addr = [fd00:1122:3344:101::18]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:51997 req_id = 230476a1-3d29-441b-a0b5-5b8bf5c9fdeb response_code = 200 uri = /crucible/0/regions/606fdb4a-695f-417d-ad2d-09677d37a45f