Max level shown:
1 [ Aug 26 00:00:01 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_8460b067-b4cd-406d-9992-30f178a3bf4d/crucible -l [fd00:1122:3344:101::14]:32345 -P 19000 -p downstairs -s snapshot"). ]
2 note: configured to log to "/dev/stdout"
32026-08-26T00:00:02.074ZINFOcrucible-agent: Crucible Version: Crucible Version: 0.0.1 Commit SHA: ad8a31742adc45e925e63443a5b43c8e30604022 Commit timestamp: 2026-07-28T19:41:59.000000000Z branch: main rustc: 1.90.0 stable x86_64-unknown-illumos Cargo: x86_64-unknown-illumos Debug: false Opt level: 3
42026-08-26T00:00:02.074ZINFOcrucible-agent: dataset: "oxp_8460b067-b4cd-406d-9992-30f178a3bf4d/crucible"
52026-08-26T00:00:02.074ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::14]:32345
62026-08-26T00:00:02.074ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
72026-08-26T00:00:02.097ZINFOcrucible-agent (datafile): Using conf_path:"/data/crucible.json"
82026-08-26T00:00:02.198ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::14]:32345
92026-08-26T00:01:21.792ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::14]:32345 remote_addr = [fd00:1122:3344:101::a]:33258
102026-08-26T00:01:21.827ZINFOcrucible-agent (datafile): region dacea423-c431-416e-9560-65c78472ed07 state: Requested
112026-08-26T00:01:21.832ZINFOcrucible-agent (worker): Region size:1073741824 reservation:1342177280 quota:3221225472
122026-08-26T00:01:21.837ZINFOcrucible-agent (dropshot): request completed latency_us = 16732 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:33258 req_id = c5503d77-20c1-445a-b828-c7564ca59cd5 response_code = 200 uri = /crucible/0/regions
132026-08-26T00:01:21.841ZINFOcrucible-agent (worker): zfs set reservation of 1342177280 for oxp_8460b067-b4cd-406d-9992-30f178a3bf4d/crucible/regions/dacea423-c431-416e-9560-65c78472ed07
142026-08-26T00:01:21.841ZINFOcrucible-agent (worker): zfs set quota of 3221225472 for oxp_8460b067-b4cd-406d-9992-30f178a3bf4d/crucible/regions/dacea423-c431-416e-9560-65c78472ed07
152026-08-26T00:01:21.918ZINFOcrucible-agent (worker): creating region Region { id: RegionId("dacea423-c431-416e-9560-65c78472ed07"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 16, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/dacea423-c431-416e-9560-65c78472ed07" region = dacea423-c431-416e-9560-65c78472ed07
162026-08-26T00:01:21.920ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "dacea423-c431-416e-9560-65c78472ed07" "--data" "/data/regions/dacea423-c431-416e-9560-65c78472ed07" "--block-size" "512" "--extent-size" "131072" "--extent-count" "16" "--encrypted" region = dacea423-c431-416e-9560-65c78472ed07
172026-08-26T00:01:22.108ZINFOcrucible-agent (dropshot): request completed latency_us = 62 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:33258 req_id = 8efec1ec-c875-4a04-ad89-306c47c57434 response_code = 200 uri = /crucible/0/regions
182026-08-26T00:01:22.135ZINFOcrucible-agent (worker): region files created ok region = dacea423-c431-416e-9560-65c78472ed07
192026-08-26T00:01:22.139ZINFOcrucible-agent (datafile): region dacea423-c431-416e-9560-65c78472ed07 state: Requested -> Created
202026-08-26T00:01:22.140ZINFOcrucible-agent (worker): applying SMF actions post create...
212026-08-26T00:01:22.142ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-dacea423-c431-416e-9560-65c78472ed07
222026-08-26T00:01:22.148ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-dacea423-c431-416e-9560-65c78472ed07
232026-08-26T00:01:22.160ZINFOcrucible-agent (worker): creating config property group
242026-08-26T00:01:22.162ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-dacea423-c431-416e-9560-65c78472ed07
252026-08-26T00:01:22.162ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/dacea423-c431-416e-9560-65c78472ed07
262026-08-26T00:01:22.162ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
272026-08-26T00:01:22.162ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::14
282026-08-26T00:01:22.162ZINFOcrucible-agent (worker): commit
292026-08-26T00:01:22.165ZINFOcrucible-agent (worker): ok!
302026-08-26T00:01:22.168ZINFOcrucible-agent (worker): SMF ok!
312026-08-26T00:01:22.597ZINFOcrucible-agent (dropshot): request completed latency_us = 81 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:33258 req_id = 94da755d-c135-4426-9500-2c5ca7281058 response_code = 200 uri = /crucible/0/regions
322026-08-26T00:01:22.955ZINFOcrucible-agent (dropshot): request completed latency_us = 72 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:33258 req_id = c037e808-b151-4773-b6ae-fdadbf29060c response_code = 200 uri = /crucible/0/regions/dacea423-c431-416e-9560-65c78472ed07
332026-08-26T00:01:22.958ZINFOcrucible-agent (datafile): path is "/data/regions/dacea423-c431-416e-9560-65c78472ed07"
342026-08-26T00:01:22.966ZINFOcrucible-agent (datafile): dataset is oxp_8460b067-b4cd-406d-9992-30f178a3bf4d/crucible/regions/dacea423-c431-416e-9560-65c78472ed07
352026-08-26T00:01:22.973ZINFOcrucible-agent (datafile): region dacea423-c431-416e-9560-65c78472ed07 state: Created -> Tombstoned
362026-08-26T00:01:22.974ZINFOcrucible-agent (worker): applying SMF actions before removal...
372026-08-26T00:01:22.974ZINFOcrucible-agent (dropshot): request completed latency_us = 15911 local_addr = [fd00:1122:3344:101::14]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::a]:33258 req_id = a846e5d7-bb0b-4ba7-af86-cb8224ce7582 response_code = 204 uri = /crucible/0/regions/dacea423-c431-416e-9560-65c78472ed07
382026-08-26T00:01:22.975ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-dacea423-c431-416e-9560-65c78472ed07 (instance states: (Some(Online), None))
392026-08-26T00:01:22.977ZINFOcrucible-agent (worker): SMF ok!
402026-08-26T00:01:22.978ZINFOcrucible-agent (dropshot): request completed latency_us = 45 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:33258 req_id = 46691aa7-3fde-455f-a3f5-a66032331cfa response_code = 200 uri = /crucible/0/regions/dacea423-c431-416e-9560-65c78472ed07
412026-08-26T00:01:22.986ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_8460b067-b4cd-406d-9992-30f178a3bf4d/crucible/regions/dacea423-c431-416e-9560-65c78472ed07" region = dacea423-c431-416e-9560-65c78472ed07
422026-08-26T00:01:23.040ZINFOcrucible-agent (datafile): region dacea423-c431-416e-9560-65c78472ed07 state: Tombstoned -> Destroyed
432026-08-26T00:01:23.082ZINFOcrucible-agent (dropshot): request completed latency_us = 66 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:33258 req_id = 7ff7ec44-3fb8-4b82-883c-55cc92777a4b response_code = 200 uri = /crucible/0/regions/dacea423-c431-416e-9560-65c78472ed07