Max level shown:
1 [ Jul 8 18:43:18 Enabled. ]
2 [ Jul 8 18:43:18 Rereading configuration. ]
3 [ Jul 8 18:43:20 Rereading configuration. ]
4 [ Jul 8 18:43:23 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_d085361f-9502-4e3c-89c5-7ae06f22cd92/crucible -l [fd00:1122:3344:101::16]:32345 -P 19000 -p downstairs -s snapshot"). ]
5 note: configured to log to "/dev/stdout"
62026-07-08T18:43:23.953ZINFOcrucible-agent: Crucible Version: Crucible Version: 0.0.1 Commit SHA: 2bfe090eb5318ec8c467157018db2429d4df535b Commit timestamp: 2026-06-25T19:33:01.000000000Z branch: main rustc: 1.90.0 stable x86_64-unknown-illumos Cargo: x86_64-unknown-illumos Debug: false Opt level: 3
72026-07-08T18:43:23.953ZINFOcrucible-agent: dataset: "oxp_d085361f-9502-4e3c-89c5-7ae06f22cd92/crucible"
82026-07-08T18:43:23.953ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::16]:32345
92026-07-08T18:43:23.954ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
102026-07-08T18:43:23.973ZINFOcrucible-agent (datafile): Using conf_path:"/data/crucible.json"
112026-07-08T18:43:24.039ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::16]:32345
122026-07-08T18:44:46.121ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::16]:32345 remote_addr = [fd00:1122:3344:101::a]:34510
132026-07-08T18:44:46.162ZINFOcrucible-agent (datafile): region 9e0a773e-7020-4028-8c21-64573847b2fc state: Requested
142026-07-08T18:44:46.167ZINFOcrucible-agent (worker): Region size:1073741824 reservation:1342177280 quota:3221225472
152026-07-08T18:44:46.170ZINFOcrucible-agent (dropshot): request completed latency_us = 20777 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:34510 req_id = 06ae63e3-9db8-41c2-ad01-347596f8c618 response_code = 200 uri = /crucible/0/regions
162026-07-08T18:44:46.175ZINFOcrucible-agent (worker): zfs set reservation of 1342177280 for oxp_d085361f-9502-4e3c-89c5-7ae06f22cd92/crucible/regions/9e0a773e-7020-4028-8c21-64573847b2fc
172026-07-08T18:44:46.175ZINFOcrucible-agent (worker): zfs set quota of 3221225472 for oxp_d085361f-9502-4e3c-89c5-7ae06f22cd92/crucible/regions/9e0a773e-7020-4028-8c21-64573847b2fc
182026-07-08T18:44:46.230ZINFOcrucible-agent (worker): creating region Region { id: RegionId("9e0a773e-7020-4028-8c21-64573847b2fc"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 16, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/9e0a773e-7020-4028-8c21-64573847b2fc" region = 9e0a773e-7020-4028-8c21-64573847b2fc
192026-07-08T18:44:46.241ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "9e0a773e-7020-4028-8c21-64573847b2fc" "--data" "/data/regions/9e0a773e-7020-4028-8c21-64573847b2fc" "--block-size" "512" "--extent-size" "131072" "--extent-count" "16" "--encrypted" region = 9e0a773e-7020-4028-8c21-64573847b2fc
202026-07-08T18:44:46.419ZINFOcrucible-agent (dropshot): request completed latency_us = 71 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:34510 req_id = 8199567d-74f5-4986-bd51-fd4802ccab4d response_code = 200 uri = /crucible/0/regions
212026-07-08T18:44:46.541ZINFOcrucible-agent (worker): region files created ok region = 9e0a773e-7020-4028-8c21-64573847b2fc
222026-07-08T18:44:46.543ZINFOcrucible-agent (datafile): region 9e0a773e-7020-4028-8c21-64573847b2fc state: Requested -> Created
232026-07-08T18:44:46.544ZINFOcrucible-agent (worker): applying SMF actions post create...
242026-07-08T18:44:46.547ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-9e0a773e-7020-4028-8c21-64573847b2fc
252026-07-08T18:44:46.555ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-9e0a773e-7020-4028-8c21-64573847b2fc
262026-07-08T18:44:46.565ZINFOcrucible-agent (worker): creating config property group
272026-07-08T18:44:46.567ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-9e0a773e-7020-4028-8c21-64573847b2fc
282026-07-08T18:44:46.567ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/9e0a773e-7020-4028-8c21-64573847b2fc
292026-07-08T18:44:46.570ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
302026-07-08T18:44:46.570ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::16
312026-07-08T18:44:46.570ZINFOcrucible-agent (worker): commit
322026-07-08T18:44:46.577ZINFOcrucible-agent (worker): ok!
332026-07-08T18:44:46.580ZINFOcrucible-agent (worker): SMF ok!
342026-07-08T18:44:46.983ZINFOcrucible-agent (dropshot): request completed latency_us = 69 local_addr = [fd00:1122:3344:101::16]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:34510 req_id = b4d51c5e-bcfe-491e-a664-9e8c6ee6f80f response_code = 200 uri = /crucible/0/regions
352026-07-08T18:44:47.308ZINFOcrucible-agent (dropshot): request completed latency_us = 69 local_addr = [fd00:1122:3344:101::16]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:34510 req_id = 8ef2e931-a2a7-4291-9765-9208154d0f77 response_code = 200 uri = /crucible/0/regions/9e0a773e-7020-4028-8c21-64573847b2fc
362026-07-08T18:44:47.312ZINFOcrucible-agent (datafile): path is "/data/regions/9e0a773e-7020-4028-8c21-64573847b2fc"
372026-07-08T18:44:47.320ZINFOcrucible-agent (datafile): dataset is oxp_d085361f-9502-4e3c-89c5-7ae06f22cd92/crucible/regions/9e0a773e-7020-4028-8c21-64573847b2fc
382026-07-08T18:44:47.327ZINFOcrucible-agent (datafile): region 9e0a773e-7020-4028-8c21-64573847b2fc state: Created -> Tombstoned
392026-07-08T18:44:47.327ZINFOcrucible-agent (worker): applying SMF actions before removal...
402026-07-08T18:44:47.327ZINFOcrucible-agent (dropshot): request completed latency_us = 15129 local_addr = [fd00:1122:3344:101::16]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::a]:34510 req_id = 2a18ee0a-395a-46ad-b7fc-5b22d77ad512 response_code = 204 uri = /crucible/0/regions/9e0a773e-7020-4028-8c21-64573847b2fc
412026-07-08T18:44:47.328ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-9e0a773e-7020-4028-8c21-64573847b2fc (instance states: (Some(Online), None))
422026-07-08T18:44:47.331ZINFOcrucible-agent (dropshot): request completed latency_us = 54 local_addr = [fd00:1122:3344:101::16]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:34510 req_id = 06d66706-e982-4c25-815a-13b37146b9b0 response_code = 200 uri = /crucible/0/regions/9e0a773e-7020-4028-8c21-64573847b2fc
432026-07-08T18:44:47.331ZINFOcrucible-agent (worker): SMF ok!
442026-07-08T18:44:47.340ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_d085361f-9502-4e3c-89c5-7ae06f22cd92/crucible/regions/9e0a773e-7020-4028-8c21-64573847b2fc" region = 9e0a773e-7020-4028-8c21-64573847b2fc
452026-07-08T18:44:47.397ZINFOcrucible-agent (datafile): region 9e0a773e-7020-4028-8c21-64573847b2fc state: Tombstoned -> Destroyed
462026-07-08T18:44:47.426ZINFOcrucible-agent (dropshot): request completed latency_us = 53 local_addr = [fd00:1122:3344:101::16]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:34510 req_id = 8732d12a-c58e-4a8c-ae7b-fe5f2a1d4cdc response_code = 200 uri = /crucible/0/regions/9e0a773e-7020-4028-8c21-64573847b2fc