Max level shown:
1 [ Sep 12 22:30:04 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_8644165a-6545-40af-8214-e5f0a423410e/crucible -l [fd00:1122:3344:101::13]:32345 -P 19000 -p downstairs -s snapshot"). ]
2 note: configured to log to "/dev/stdout"
32026-09-12T22:30:04.662ZINFOcrucible-agent: Crucible Version: Crucible Version: 0.0.1 Commit SHA: ad8a31742adc45e925e63443a5b43c8e30604022 Commit timestamp: 2026-07-28T19:41:59.000000000Z branch: main rustc: 1.90.0 stable x86_64-unknown-illumos Cargo: x86_64-unknown-illumos Debug: false Opt level: 3
42026-09-12T22:30:04.662ZINFOcrucible-agent: dataset: "oxp_8644165a-6545-40af-8214-e5f0a423410e/crucible"
52026-09-12T22:30:04.662ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::13]:32345
62026-09-12T22:30:04.662ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
72026-09-12T22:30:04.676ZINFOcrucible-agent (datafile): Using conf_path:"/data/crucible.json"
82026-09-12T22:30:04.843ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::13]:32345
92026-09-12T22:42:51.133ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::13]:32345 remote_addr = [fd00:1122:3344:101::c]:36191
102026-09-12T22:42:51.181ZINFOcrucible-agent (datafile): region 3bff6de6-793d-4045-8262-f5773c9173ee state: Requested
112026-09-12T22:42:51.189ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
122026-09-12T22:42:51.194ZINFOcrucible-agent (dropshot): request completed latency_us = 24734 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:36191 req_id = 78a0d4b7-0b9d-4d1b-9c2a-4eb5e792ec54 response_code = 200 uri = /crucible/0/regions
132026-09-12T22:42:51.199ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_8644165a-6545-40af-8214-e5f0a423410e/crucible/regions/3bff6de6-793d-4045-8262-f5773c9173ee
142026-09-12T22:42:51.199ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_8644165a-6545-40af-8214-e5f0a423410e/crucible/regions/3bff6de6-793d-4045-8262-f5773c9173ee
152026-09-12T22:42:51.266ZINFOcrucible-agent (worker): creating region Region { id: RegionId("3bff6de6-793d-4045-8262-f5773c9173ee"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/3bff6de6-793d-4045-8262-f5773c9173ee" region = 3bff6de6-793d-4045-8262-f5773c9173ee
162026-09-12T22:42:51.269ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "3bff6de6-793d-4045-8262-f5773c9173ee" "--data" "/data/regions/3bff6de6-793d-4045-8262-f5773c9173ee" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 3bff6de6-793d-4045-8262-f5773c9173ee
172026-09-12T22:42:51.410ZINFOcrucible-agent (dropshot): request completed latency_us = 59 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:36191 req_id = 7b9a8fdd-fa94-4f30-a696-a80447b1a707 response_code = 200 uri = /crucible/0/regions
182026-09-12T22:42:51.668ZINFOcrucible-agent (worker): region files created ok region = 3bff6de6-793d-4045-8262-f5773c9173ee
192026-09-12T22:42:51.673ZINFOcrucible-agent (datafile): region 3bff6de6-793d-4045-8262-f5773c9173ee state: Requested -> Created
202026-09-12T22:42:51.673ZINFOcrucible-agent (worker): applying SMF actions post create...
212026-09-12T22:42:51.675ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-3bff6de6-793d-4045-8262-f5773c9173ee
222026-09-12T22:42:51.691ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-3bff6de6-793d-4045-8262-f5773c9173ee
232026-09-12T22:42:51.713ZINFOcrucible-agent (worker): creating config property group
242026-09-12T22:42:51.719ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-3bff6de6-793d-4045-8262-f5773c9173ee
252026-09-12T22:42:51.720ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/3bff6de6-793d-4045-8262-f5773c9173ee
262026-09-12T22:42:51.720ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
272026-09-12T22:42:51.720ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::13
282026-09-12T22:42:51.720ZINFOcrucible-agent (worker): commit
292026-09-12T22:42:51.724ZINFOcrucible-agent (worker): ok!
302026-09-12T22:42:51.731ZINFOcrucible-agent (worker): SMF ok!
312026-09-12T22:42:52.012ZINFOcrucible-agent (dropshot): request completed latency_us = 82 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:36191 req_id = c49c7018-bd41-4fec-8fdc-617f1b2044fd response_code = 200 uri = /crucible/0/regions
322026-09-12T22:43:19.037ZINFOcrucible-agent (dropshot): request completed latency_us = 77 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:36191 req_id = 490fa1f6-daa8-4a45-902d-9558fba095ca response_code = 200 uri = /crucible/0/regions/3bff6de6-793d-4045-8262-f5773c9173ee
332026-09-12T22:43:19.042ZINFOcrucible-agent (datafile): path is "/data/regions/3bff6de6-793d-4045-8262-f5773c9173ee"
342026-09-12T22:43:19.051ZINFOcrucible-agent (datafile): dataset is oxp_8644165a-6545-40af-8214-e5f0a423410e/crucible/regions/3bff6de6-793d-4045-8262-f5773c9173ee
352026-09-12T22:43:19.057ZINFOcrucible-agent (datafile): region 3bff6de6-793d-4045-8262-f5773c9173ee state: Created -> Tombstoned
362026-09-12T22:43:19.057ZINFOcrucible-agent (worker): applying SMF actions before removal...
372026-09-12T22:43:19.058ZINFOcrucible-agent (dropshot): request completed latency_us = 15850 local_addr = [fd00:1122:3344:101::13]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::c]:36191 req_id = 2e7b274c-0195-4e81-b427-bd4f5847172c response_code = 204 uri = /crucible/0/regions/3bff6de6-793d-4045-8262-f5773c9173ee
382026-09-12T22:43:19.058ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-3bff6de6-793d-4045-8262-f5773c9173ee (instance states: (Some(Online), None))
392026-09-12T22:43:19.060ZINFOcrucible-agent (dropshot): request completed latency_us = 44 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:36191 req_id = c7b4f636-cad7-4658-a01e-4cc974385c6d response_code = 200 uri = /crucible/0/regions/3bff6de6-793d-4045-8262-f5773c9173ee
402026-09-12T22:43:19.063ZINFOcrucible-agent (worker): SMF ok!
412026-09-12T22:43:19.071ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_8644165a-6545-40af-8214-e5f0a423410e/crucible/regions/3bff6de6-793d-4045-8262-f5773c9173ee" region = 3bff6de6-793d-4045-8262-f5773c9173ee
422026-09-12T22:43:19.127ZINFOcrucible-agent (datafile): region 3bff6de6-793d-4045-8262-f5773c9173ee state: Tombstoned -> Destroyed
432026-09-12T22:43:19.190ZINFOcrucible-agent (dropshot): request completed latency_us = 48 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:36191 req_id = 67eb5561-ddb1-48e0-85a7-71361b649d66 response_code = 200 uri = /crucible/0/regions/3bff6de6-793d-4045-8262-f5773c9173ee