Max level shown:
1 [ May 29 00:01:49 Enabled. ]
2 [ May 29 00:01:49 Rereading configuration. ]
3 [ May 29 00:01:53 Rereading configuration. ]
4 [ May 29 00:01:59 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_f1e16b9e-2fc7-44e4-b6e2-20e62b68ad2b/crucible -l [fd00:1122:3344:101::14]:32345 -P 19000 -p downstairs -s snapshot"). ]
5 note: configured to log to "/dev/stdout"
62026-05-29T00:01:59.985ZINFOcrucible-agent: Crucible Version: Crucible Version: 0.0.1 Commit SHA: bd9a0e2abe6b6b89aec8c85f4ee57474144ed150 Commit timestamp: 2026-05-14T15:48:00.000000000Z branch: main rustc: 1.90.0 stable x86_64-unknown-illumos Cargo: x86_64-unknown-illumos Debug: false Opt level: 3
72026-05-29T00:01:59.985ZINFOcrucible-agent: dataset: "oxp_f1e16b9e-2fc7-44e4-b6e2-20e62b68ad2b/crucible"
82026-05-29T00:01:59.985ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::14]:32345
92026-05-29T00:01:59.985ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
102026-05-29T00:01:59.996ZINFOcrucible-agent (datafile): Using conf_path:"/data/crucible.json"
112026-05-29T00:02:00.198ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::14]:32345
122026-05-29T00:14:18.430ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::14]:32345 remote_addr = [fd00:1122:3344:101::b]:35763
132026-05-29T00:14:18.474ZINFOcrucible-agent (datafile): region 008be7cb-3558-413b-94eb-007c382aca19 state: Requested
142026-05-29T00:14:18.479ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
152026-05-29T00:14:18.479ZINFOcrucible-agent (dropshot): request completed latency_us = 17049 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:35763 req_id = 10e2fe2c-858f-4f24-bdb7-c99f6b42868b response_code = 200 uri = /crucible/0/regions
162026-05-29T00:14:18.492ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_f1e16b9e-2fc7-44e4-b6e2-20e62b68ad2b/crucible/regions/008be7cb-3558-413b-94eb-007c382aca19
172026-05-29T00:14:18.492ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_f1e16b9e-2fc7-44e4-b6e2-20e62b68ad2b/crucible/regions/008be7cb-3558-413b-94eb-007c382aca19
182026-05-29T00:14:18.547ZINFOcrucible-agent (worker): creating region Region { id: RegionId("008be7cb-3558-413b-94eb-007c382aca19"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/008be7cb-3558-413b-94eb-007c382aca19" region = 008be7cb-3558-413b-94eb-007c382aca19
192026-05-29T00:14:18.549ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "008be7cb-3558-413b-94eb-007c382aca19" "--data" "/data/regions/008be7cb-3558-413b-94eb-007c382aca19" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 008be7cb-3558-413b-94eb-007c382aca19
202026-05-29T00:14:18.666ZINFOcrucible-agent (dropshot): request completed latency_us = 60 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:35763 req_id = f6e148ff-f673-4502-b2fa-6d832b6e8997 response_code = 200 uri = /crucible/0/regions
212026-05-29T00:14:18.906ZINFOcrucible-agent (worker): region files created ok region = 008be7cb-3558-413b-94eb-007c382aca19
222026-05-29T00:14:18.906ZINFOcrucible-agent (datafile): region 008be7cb-3558-413b-94eb-007c382aca19 state: Requested -> Created
232026-05-29T00:14:18.906ZINFOcrucible-agent (worker): applying SMF actions post create...
242026-05-29T00:14:18.909ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-008be7cb-3558-413b-94eb-007c382aca19
252026-05-29T00:14:18.920ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-008be7cb-3558-413b-94eb-007c382aca19
262026-05-29T00:14:18.942ZINFOcrucible-agent (worker): creating config property group
272026-05-29T00:14:18.945ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-008be7cb-3558-413b-94eb-007c382aca19
282026-05-29T00:14:18.946ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/008be7cb-3558-413b-94eb-007c382aca19
292026-05-29T00:14:18.946ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
302026-05-29T00:14:18.946ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::14
312026-05-29T00:14:18.946ZINFOcrucible-agent (worker): commit
322026-05-29T00:14:18.960ZINFOcrucible-agent (worker): ok!
332026-05-29T00:14:18.965ZINFOcrucible-agent (worker): SMF ok!
342026-05-29T00:14:19.372ZINFOcrucible-agent (dropshot): request completed latency_us = 72 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::b]:35763 req_id = 9c305d51-1ed8-4779-a4d1-507ae93e320d response_code = 200 uri = /crucible/0/regions
352026-05-29T00:14:44.856ZINFOcrucible-agent (dropshot): request completed latency_us = 55 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:35763 req_id = 81df5aae-c2b6-4a06-8f87-0e3770ae8c93 response_code = 200 uri = /crucible/0/regions/008be7cb-3558-413b-94eb-007c382aca19
362026-05-29T00:14:44.859ZINFOcrucible-agent (datafile): path is "/data/regions/008be7cb-3558-413b-94eb-007c382aca19"
372026-05-29T00:14:44.868ZINFOcrucible-agent (datafile): dataset is oxp_f1e16b9e-2fc7-44e4-b6e2-20e62b68ad2b/crucible/regions/008be7cb-3558-413b-94eb-007c382aca19
382026-05-29T00:14:44.874ZINFOcrucible-agent (datafile): region 008be7cb-3558-413b-94eb-007c382aca19 state: Created -> Tombstoned
392026-05-29T00:14:44.875ZINFOcrucible-agent (dropshot): request completed latency_us = 15636 local_addr = [fd00:1122:3344:101::14]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::b]:35763 req_id = a5600266-c10d-4520-8d1f-539bd0d82871 response_code = 204 uri = /crucible/0/regions/008be7cb-3558-413b-94eb-007c382aca19
402026-05-29T00:14:44.875ZINFOcrucible-agent (worker): applying SMF actions before removal...
412026-05-29T00:14:44.878ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-008be7cb-3558-413b-94eb-007c382aca19 (instance states: (Some(Online), None))
422026-05-29T00:14:44.879ZINFOcrucible-agent (dropshot): request completed latency_us = 33 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:35763 req_id = 3433c4a6-6b0b-4431-9cbe-9f802bd816ac response_code = 200 uri = /crucible/0/regions/008be7cb-3558-413b-94eb-007c382aca19
432026-05-29T00:14:44.889ZINFOcrucible-agent (worker): SMF ok!
442026-05-29T00:14:44.896ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_f1e16b9e-2fc7-44e4-b6e2-20e62b68ad2b/crucible/regions/008be7cb-3558-413b-94eb-007c382aca19" region = 008be7cb-3558-413b-94eb-007c382aca19
452026-05-29T00:14:44.949ZINFOcrucible-agent (datafile): region 008be7cb-3558-413b-94eb-007c382aca19 state: Tombstoned -> Destroyed
462026-05-29T00:14:44.959ZINFOcrucible-agent (dropshot): request completed latency_us = 48 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::b]:35763 req_id = 749a4af1-4365-4ed0-947a-ebfcaa52d872 response_code = 200 uri = /crucible/0/regions/008be7cb-3558-413b-94eb-007c382aca19