Max level shown:
1 [ Aug 25 08:31:26 Enabled. ]
2 [ Aug 25 08:31:26 Rereading configuration. ]
3 [ Aug 25 08:31:29 Rereading configuration. ]
4 [ Aug 25 08:31:32 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_b6d94d04-a4a4-43fb-8af8-f3793c25fdf1/crucible -l [fd00:1122:3344:101::18]:32345 -P 19000 -p downstairs -s snapshot"). ]
5 note: configured to log to "/dev/stdout"
62026-08-25T08:31:32.569ZINFOcrucible-agent: Crucible Version: Crucible Version: 0.0.1 Commit SHA: ad8a31742adc45e925e63443a5b43c8e30604022 Commit timestamp: 2026-07-28T19:41:59.000000000Z branch: main rustc: 1.90.0 stable x86_64-unknown-illumos Cargo: x86_64-unknown-illumos Debug: false Opt level: 3
72026-08-25T08:31:32.569ZINFOcrucible-agent: dataset: "oxp_b6d94d04-a4a4-43fb-8af8-f3793c25fdf1/crucible"
82026-08-25T08:31:32.569ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::18]:32345
92026-08-25T08:31:32.569ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
102026-08-25T08:31:32.590ZINFOcrucible-agent (datafile): Using conf_path:"/data/crucible.json"
112026-08-25T08:31:32.685ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::18]:32345
122026-08-25T08:32:05.440ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::18]:32345 remote_addr = [fd00:1122:3344:101::a]:60584
132026-08-25T08:32:05.467ZINFOcrucible-agent (datafile): region c72b0718-137f-45d2-8770-d7b44fcb5f78 state: Requested
142026-08-25T08:32:05.470ZINFOcrucible-agent (worker): Region size:1073741824 reservation:1342177280 quota:3221225472
152026-08-25T08:32:05.475ZINFOcrucible-agent (dropshot): request completed latency_us = 16885 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:60584 req_id = ac0cd983-10e0-4be0-9eb4-e7ea71e3bf2b response_code = 200 uri = /crucible/0/regions
162026-08-25T08:32:05.479ZINFOcrucible-agent (worker): zfs set reservation of 1342177280 for oxp_b6d94d04-a4a4-43fb-8af8-f3793c25fdf1/crucible/regions/c72b0718-137f-45d2-8770-d7b44fcb5f78
172026-08-25T08:32:05.479ZINFOcrucible-agent (worker): zfs set quota of 3221225472 for oxp_b6d94d04-a4a4-43fb-8af8-f3793c25fdf1/crucible/regions/c72b0718-137f-45d2-8770-d7b44fcb5f78
182026-08-25T08:32:05.518ZINFOcrucible-agent (worker): creating region Region { id: RegionId("c72b0718-137f-45d2-8770-d7b44fcb5f78"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 16, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/c72b0718-137f-45d2-8770-d7b44fcb5f78" region = c72b0718-137f-45d2-8770-d7b44fcb5f78
192026-08-25T08:32:05.518ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "c72b0718-137f-45d2-8770-d7b44fcb5f78" "--data" "/data/regions/c72b0718-137f-45d2-8770-d7b44fcb5f78" "--block-size" "512" "--extent-size" "131072" "--extent-count" "16" "--encrypted" region = c72b0718-137f-45d2-8770-d7b44fcb5f78
202026-08-25T08:32:05.777ZINFOcrucible-agent (dropshot): request completed latency_us = 65 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:60584 req_id = 1a474fca-669c-477f-83f0-2d9369b68070 response_code = 200 uri = /crucible/0/regions
212026-08-25T08:32:05.832ZINFOcrucible-agent (worker): region files created ok region = c72b0718-137f-45d2-8770-d7b44fcb5f78
222026-08-25T08:32:05.838ZINFOcrucible-agent (datafile): region c72b0718-137f-45d2-8770-d7b44fcb5f78 state: Requested -> Created
232026-08-25T08:32:05.838ZINFOcrucible-agent (worker): applying SMF actions post create...
242026-08-25T08:32:05.841ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-c72b0718-137f-45d2-8770-d7b44fcb5f78
252026-08-25T08:32:05.845ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-c72b0718-137f-45d2-8770-d7b44fcb5f78
262026-08-25T08:32:05.853ZINFOcrucible-agent (worker): creating config property group
272026-08-25T08:32:05.854ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-c72b0718-137f-45d2-8770-d7b44fcb5f78
282026-08-25T08:32:05.855ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/c72b0718-137f-45d2-8770-d7b44fcb5f78
292026-08-25T08:32:05.855ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
302026-08-25T08:32:05.855ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::18
312026-08-25T08:32:05.855ZINFOcrucible-agent (worker): commit
322026-08-25T08:32:05.857ZINFOcrucible-agent (worker): ok!
332026-08-25T08:32:05.859ZINFOcrucible-agent (worker): SMF ok!
342026-08-25T08:32:06.477ZINFOcrucible-agent (dropshot): request completed latency_us = 79 local_addr = [fd00:1122:3344:101::18]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:60584 req_id = cbe7861d-1e26-4607-a40e-f0a2324b75aa response_code = 200 uri = /crucible/0/regions
352026-08-25T08:32:06.952ZINFOcrucible-agent (dropshot): request completed latency_us = 86 local_addr = [fd00:1122:3344:101::18]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:60584 req_id = d202a14c-6fc2-4ab5-854b-b6f2b3e8e628 response_code = 200 uri = /crucible/0/regions/c72b0718-137f-45d2-8770-d7b44fcb5f78
362026-08-25T08:32:06.955ZINFOcrucible-agent (datafile): path is "/data/regions/c72b0718-137f-45d2-8770-d7b44fcb5f78"
372026-08-25T08:32:06.964ZINFOcrucible-agent (datafile): dataset is oxp_b6d94d04-a4a4-43fb-8af8-f3793c25fdf1/crucible/regions/c72b0718-137f-45d2-8770-d7b44fcb5f78
382026-08-25T08:32:06.971ZINFOcrucible-agent (datafile): region c72b0718-137f-45d2-8770-d7b44fcb5f78 state: Created -> Tombstoned
392026-08-25T08:32:06.971ZINFOcrucible-agent (worker): applying SMF actions before removal...
402026-08-25T08:32:06.971ZINFOcrucible-agent (dropshot): request completed latency_us = 16336 local_addr = [fd00:1122:3344:101::18]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::a]:60584 req_id = b943b4cd-7124-4444-9bd9-bf34384ef649 response_code = 204 uri = /crucible/0/regions/c72b0718-137f-45d2-8770-d7b44fcb5f78
412026-08-25T08:32:06.972ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-c72b0718-137f-45d2-8770-d7b44fcb5f78 (instance states: (Some(Online), None))
422026-08-25T08:32:06.975ZINFOcrucible-agent (dropshot): request completed latency_us = 43 local_addr = [fd00:1122:3344:101::18]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:60584 req_id = 5c18cffa-87b2-48b7-95db-4b687a4a8a7a response_code = 200 uri = /crucible/0/regions/c72b0718-137f-45d2-8770-d7b44fcb5f78
432026-08-25T08:32:06.975ZINFOcrucible-agent (worker): SMF ok!
442026-08-25T08:32:06.984ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_b6d94d04-a4a4-43fb-8af8-f3793c25fdf1/crucible/regions/c72b0718-137f-45d2-8770-d7b44fcb5f78" region = c72b0718-137f-45d2-8770-d7b44fcb5f78
452026-08-25T08:32:07.037ZINFOcrucible-agent (datafile): region c72b0718-137f-45d2-8770-d7b44fcb5f78 state: Tombstoned -> Destroyed
462026-08-25T08:32:07.040ZINFOcrucible-agent (dropshot): request completed latency_us = 57 local_addr = [fd00:1122:3344:101::18]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:60584 req_id = cf84abbb-c31d-49a5-9fdd-2442de3014ed response_code = 200 uri = /crucible/0/regions/c72b0718-137f-45d2-8770-d7b44fcb5f78