Max level shown:
1 [ Oct 23 22:45:04 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_1f16097a-33f2-4e05-bc4a-330d48fced9f/crucible -l [fd00:1122:3344:101::13]:32345 -P 19000 -p downstairs -s snapshot"). ]
2 note: configured to log to "/dev/stdout"
32026-10-23T22:45:04.836ZINFOcrucible-agent: Crucible Version: Crucible Version: 0.0.1 Commit SHA: f85cf0dc3631e2f0c13384787efb0efc1b642162 Commit timestamp: 2026-10-10T00:38:51.000000000Z branch: main rustc: 1.90.0 stable x86_64-unknown-illumos Cargo: x86_64-unknown-illumos Debug: false Opt level: 3
42026-10-23T22:45:04.836ZINFOcrucible-agent: dataset: "oxp_1f16097a-33f2-4e05-bc4a-330d48fced9f/crucible"
52026-10-23T22:45:04.836ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::13]:32345
62026-10-23T22:45:04.836ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
72026-10-23T22:45:04.850ZINFOcrucible-agent (datafile): Using conf_path:"/data/crucible.json"
82026-10-23T22:45:05.204ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::13]:32345
92026-10-23T22:57:16.622ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::13]:32345 remote_addr = [fd00:1122:3344:101::a]:57248
102026-10-23T22:57:16.666ZINFOcrucible-agent (datafile): region 6354b22e-3d7b-490c-8b21-a32ac01f172f state: Requested
112026-10-23T22:57:16.674ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
122026-10-23T22:57:16.679ZINFOcrucible-agent (dropshot): request completed latency_us = 19669 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:57248 req_id = 5d8314af-492c-4e61-adca-3454ba95ea9b response_code = 200 uri = /crucible/0/regions
132026-10-23T22:57:16.686ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_1f16097a-33f2-4e05-bc4a-330d48fced9f/crucible/regions/6354b22e-3d7b-490c-8b21-a32ac01f172f
142026-10-23T22:57:16.686ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_1f16097a-33f2-4e05-bc4a-330d48fced9f/crucible/regions/6354b22e-3d7b-490c-8b21-a32ac01f172f
152026-10-23T22:57:16.740ZINFOcrucible-agent (worker): creating region Region { id: RegionId("6354b22e-3d7b-490c-8b21-a32ac01f172f"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/6354b22e-3d7b-490c-8b21-a32ac01f172f" region = 6354b22e-3d7b-490c-8b21-a32ac01f172f
162026-10-23T22:57:16.740ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "6354b22e-3d7b-490c-8b21-a32ac01f172f" "--data" "/data/regions/6354b22e-3d7b-490c-8b21-a32ac01f172f" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 6354b22e-3d7b-490c-8b21-a32ac01f172f
172026-10-23T22:57:17.049ZINFOcrucible-agent (dropshot): request completed latency_us = 76 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:57248 req_id = f502ede3-79cc-44e8-ac8d-01293c385bdd response_code = 200 uri = /crucible/0/regions
182026-10-23T22:57:17.147ZINFOcrucible-agent (worker): region files created ok region = 6354b22e-3d7b-490c-8b21-a32ac01f172f
192026-10-23T22:57:17.149ZINFOcrucible-agent (datafile): region 6354b22e-3d7b-490c-8b21-a32ac01f172f state: Requested -> Created
202026-10-23T22:57:17.149ZINFOcrucible-agent (worker): applying SMF actions post create...
212026-10-23T22:57:17.149ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-6354b22e-3d7b-490c-8b21-a32ac01f172f
222026-10-23T22:57:17.162ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-6354b22e-3d7b-490c-8b21-a32ac01f172f
232026-10-23T22:57:17.186ZINFOcrucible-agent (worker): creating config property group
242026-10-23T22:57:17.188ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-6354b22e-3d7b-490c-8b21-a32ac01f172f
252026-10-23T22:57:17.189ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/6354b22e-3d7b-490c-8b21-a32ac01f172f
262026-10-23T22:57:17.189ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
272026-10-23T22:57:17.189ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::13
282026-10-23T22:57:17.189ZINFOcrucible-agent (worker): commit
292026-10-23T22:57:17.193ZINFOcrucible-agent (worker): ok!
302026-10-23T22:57:17.197ZINFOcrucible-agent (worker): SMF ok!
312026-10-23T22:57:17.551ZINFOcrucible-agent (dropshot): request completed latency_us = 70 local_addr = [fd00:1122:3344:101::13]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:57248 req_id = d56f7852-88ab-4f12-8058-7cacf2b69617 response_code = 200 uri = /crucible/0/regions
322026-10-23T22:57:50.343ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::13]:32345 remote_addr = [fd00:1122:3344:101::a]:54157
332026-10-23T22:57:50.343ZINFOcrucible-agent (dropshot): request completed latency_us = 65 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:54157 req_id = ec2e132a-014f-4681-9839-fb7d126bfdfe response_code = 200 uri = /crucible/0/regions/6354b22e-3d7b-490c-8b21-a32ac01f172f
342026-10-23T22:57:50.346ZINFOcrucible-agent (datafile): path is "/data/regions/6354b22e-3d7b-490c-8b21-a32ac01f172f"
352026-10-23T22:57:50.355ZINFOcrucible-agent (datafile): dataset is oxp_1f16097a-33f2-4e05-bc4a-330d48fced9f/crucible/regions/6354b22e-3d7b-490c-8b21-a32ac01f172f
362026-10-23T22:57:50.363ZINFOcrucible-agent (datafile): region 6354b22e-3d7b-490c-8b21-a32ac01f172f state: Created -> Tombstoned
372026-10-23T22:57:50.363ZINFOcrucible-agent (worker): applying SMF actions before removal...
382026-10-23T22:57:50.363ZINFOcrucible-agent (dropshot): request completed latency_us = 16997 local_addr = [fd00:1122:3344:101::13]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::a]:54157 req_id = e9234a5b-b9b2-4b75-a8d8-72a49f686e4d response_code = 204 uri = /crucible/0/regions/6354b22e-3d7b-490c-8b21-a32ac01f172f
392026-10-23T22:57:50.364ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-6354b22e-3d7b-490c-8b21-a32ac01f172f (instance states: (Some(Online), None))
402026-10-23T22:57:50.366ZINFOcrucible-agent (dropshot): request completed latency_us = 38 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:54157 req_id = bfff59f9-b179-481d-9416-663d3edaac1c response_code = 200 uri = /crucible/0/regions/6354b22e-3d7b-490c-8b21-a32ac01f172f
412026-10-23T22:57:50.374ZINFOcrucible-agent (worker): SMF ok!
422026-10-23T22:57:50.382ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_1f16097a-33f2-4e05-bc4a-330d48fced9f/crucible/regions/6354b22e-3d7b-490c-8b21-a32ac01f172f" region = 6354b22e-3d7b-490c-8b21-a32ac01f172f
432026-10-23T22:57:50.426ZINFOcrucible-agent (dropshot): request completed latency_us = 50 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:54157 req_id = d8d5d61c-6fb4-4219-a836-0f0fa7619964 response_code = 200 uri = /crucible/0/regions/6354b22e-3d7b-490c-8b21-a32ac01f172f
442026-10-23T22:57:50.458ZINFOcrucible-agent (datafile): region 6354b22e-3d7b-490c-8b21-a32ac01f172f state: Tombstoned -> Destroyed
452026-10-23T22:57:50.513ZINFOcrucible-agent (dropshot): request completed latency_us = 48 local_addr = [fd00:1122:3344:101::13]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:54157 req_id = 4bcaa350-8a5d-4a47-bd03-16ce82d027e7 response_code = 200 uri = /crucible/0/regions/6354b22e-3d7b-490c-8b21-a32ac01f172f