Max level shown:
1 [ Oct 30 18:15:19 Enabled. ]
2 [ Oct 30 18:15:19 Rereading configuration. ]
3 [ Oct 30 18:15:20 Rereading configuration. ]
4 [ Oct 30 18:15:23 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_744f438b-ba04-49c0-b5ed-77cf8a055253/crucible -l [fd00:1122:3344:101::14]:32345 -P 19000 -p downstairs -s snapshot"). ]
5 note: configured to log to "/dev/stdout"
62026-10-30T18:15:23.566ZINFOcrucible-agent: Crucible Version: Crucible Version: 0.0.1 Commit SHA: f85cf0dc3631e2f0c13384787efb0efc1b642162 Commit timestamp: 2026-10-10T00:38:51.000000000Z branch: main rustc: 1.90.0 stable x86_64-unknown-illumos Cargo: x86_64-unknown-illumos Debug: false Opt level: 3
72026-10-30T18:15:23.566ZINFOcrucible-agent: dataset: "oxp_744f438b-ba04-49c0-b5ed-77cf8a055253/crucible"
82026-10-30T18:15:23.566ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::14]:32345
92026-10-30T18:15:23.566ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
102026-10-30T18:15:23.587ZINFOcrucible-agent (datafile): Using conf_path:"/data/crucible.json"
112026-10-30T18:15:23.664ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::14]:32345
122026-10-30T18:27:00.786ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::14]:32345 remote_addr = [fd00:1122:3344:101::a]:42910
132026-10-30T18:27:00.834ZINFOcrucible-agent (datafile): region e793dba4-12a5-4c7e-a305-4a5f3cd91be1 state: Requested
142026-10-30T18:27:00.842ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
152026-10-30T18:27:00.846ZINFOcrucible-agent (dropshot): request completed latency_us = 22538 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:42910 req_id = 5c5a3e4b-f582-42b8-9a03-69a4276b6a13 response_code = 200 uri = /crucible/0/regions
162026-10-30T18:27:00.853ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_744f438b-ba04-49c0-b5ed-77cf8a055253/crucible/regions/e793dba4-12a5-4c7e-a305-4a5f3cd91be1
172026-10-30T18:27:00.853ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_744f438b-ba04-49c0-b5ed-77cf8a055253/crucible/regions/e793dba4-12a5-4c7e-a305-4a5f3cd91be1
182026-10-30T18:27:00.903ZINFOcrucible-agent (worker): creating region Region { id: RegionId("e793dba4-12a5-4c7e-a305-4a5f3cd91be1"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/e793dba4-12a5-4c7e-a305-4a5f3cd91be1" region = e793dba4-12a5-4c7e-a305-4a5f3cd91be1
192026-10-30T18:27:00.903ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "e793dba4-12a5-4c7e-a305-4a5f3cd91be1" "--data" "/data/regions/e793dba4-12a5-4c7e-a305-4a5f3cd91be1" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = e793dba4-12a5-4c7e-a305-4a5f3cd91be1
202026-10-30T18:27:01.041ZINFOcrucible-agent (dropshot): request completed latency_us = 79 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:42910 req_id = d507bc59-be73-4efc-9ba0-809d5ab8a5f8 response_code = 200 uri = /crucible/0/regions
212026-10-30T18:27:01.269ZINFOcrucible-agent (worker): region files created ok region = e793dba4-12a5-4c7e-a305-4a5f3cd91be1
222026-10-30T18:27:01.272ZINFOcrucible-agent (datafile): region e793dba4-12a5-4c7e-a305-4a5f3cd91be1 state: Requested -> Created
232026-10-30T18:27:01.273ZINFOcrucible-agent (worker): applying SMF actions post create...
242026-10-30T18:27:01.273ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-e793dba4-12a5-4c7e-a305-4a5f3cd91be1
252026-10-30T18:27:01.284ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-e793dba4-12a5-4c7e-a305-4a5f3cd91be1
262026-10-30T18:27:01.307ZINFOcrucible-agent (worker): creating config property group
272026-10-30T18:27:01.308ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-e793dba4-12a5-4c7e-a305-4a5f3cd91be1
282026-10-30T18:27:01.310ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/e793dba4-12a5-4c7e-a305-4a5f3cd91be1
292026-10-30T18:27:01.310ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
302026-10-30T18:27:01.310ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::14
312026-10-30T18:27:01.310ZINFOcrucible-agent (worker): commit
322026-10-30T18:27:01.313ZINFOcrucible-agent (worker): ok!
332026-10-30T18:27:01.317ZINFOcrucible-agent (worker): SMF ok!
342026-10-30T18:27:01.525ZINFOcrucible-agent (dropshot): request completed latency_us = 74 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:42910 req_id = a81d202f-aa13-45ae-a7b6-cdb6260f8387 response_code = 200 uri = /crucible/0/regions
352026-10-30T18:27:26.263ZINFOcrucible-agent (dropshot): request completed latency_us = 57 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:42910 req_id = 94c378bd-daba-4960-a9e8-37d562ad07d2 response_code = 200 uri = /crucible/0/regions/e793dba4-12a5-4c7e-a305-4a5f3cd91be1
362026-10-30T18:27:26.266ZINFOcrucible-agent (datafile): path is "/data/regions/e793dba4-12a5-4c7e-a305-4a5f3cd91be1"
372026-10-30T18:27:26.274ZINFOcrucible-agent (datafile): dataset is oxp_744f438b-ba04-49c0-b5ed-77cf8a055253/crucible/regions/e793dba4-12a5-4c7e-a305-4a5f3cd91be1
382026-10-30T18:27:26.279ZINFOcrucible-agent (datafile): region e793dba4-12a5-4c7e-a305-4a5f3cd91be1 state: Created -> Tombstoned
392026-10-30T18:27:26.280ZINFOcrucible-agent (worker): applying SMF actions before removal...
402026-10-30T18:27:26.280ZINFOcrucible-agent (dropshot): request completed latency_us = 13593 local_addr = [fd00:1122:3344:101::14]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::a]:42910 req_id = 01162ac3-eda0-403f-87b6-6dbc8cc4b72e response_code = 204 uri = /crucible/0/regions/e793dba4-12a5-4c7e-a305-4a5f3cd91be1
412026-10-30T18:27:26.281ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-e793dba4-12a5-4c7e-a305-4a5f3cd91be1 (instance states: (Some(Online), None))
422026-10-30T18:27:26.283ZINFOcrucible-agent (dropshot): request completed latency_us = 137 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:42910 req_id = d63b1471-d8f0-4a0a-97b1-23921af36949 response_code = 200 uri = /crucible/0/regions/e793dba4-12a5-4c7e-a305-4a5f3cd91be1
432026-10-30T18:27:26.283ZINFOcrucible-agent (worker): SMF ok!
442026-10-30T18:27:26.290ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_744f438b-ba04-49c0-b5ed-77cf8a055253/crucible/regions/e793dba4-12a5-4c7e-a305-4a5f3cd91be1" region = e793dba4-12a5-4c7e-a305-4a5f3cd91be1
452026-10-30T18:27:26.338ZINFOcrucible-agent (datafile): region e793dba4-12a5-4c7e-a305-4a5f3cd91be1 state: Tombstoned -> Destroyed
462026-10-30T18:27:26.375ZINFOcrucible-agent (dropshot): request completed latency_us = 52 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:42910 req_id = 78b3decb-0a5d-4e7c-ba6e-d23963472938 response_code = 200 uri = /crucible/0/regions/e793dba4-12a5-4c7e-a305-4a5f3cd91be1