Max level shown:
1 [ Aug 27 01:07:27 Enabled. ]
2 [ Aug 27 01:07:27 Rereading configuration. ]
3 [ Aug 27 01:07:31 Rereading configuration. ]
4 [ Aug 27 01:07:35 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_043a45fe-0e87-4312-9877-a5ae8fc7d496/crucible -l [fd00:1122:3344:101::12]:32345 -P 19000 -p downstairs -s snapshot"). ]
5 note: configured to log to "/dev/stdout"
62026-08-27T01:07:35.880ZINFOcrucible-agent: Crucible Version: Crucible Version: 0.0.1 Commit SHA: ad8a31742adc45e925e63443a5b43c8e30604022 Commit timestamp: 2026-07-28T19:41:59.000000000Z branch: main rustc: 1.90.0 stable x86_64-unknown-illumos Cargo: x86_64-unknown-illumos Debug: false Opt level: 3
72026-08-27T01:07:35.880ZINFOcrucible-agent: dataset: "oxp_043a45fe-0e87-4312-9877-a5ae8fc7d496/crucible"
82026-08-27T01:07:35.881ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::12]:32345
92026-08-27T01:07:35.881ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
102026-08-27T01:07:35.898ZINFOcrucible-agent (datafile): Using conf_path:"/data/crucible.json"
112026-08-27T01:07:35.965ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::12]:32345
122026-08-27T01:08:28.413ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::12]:32345 remote_addr = [fd00:1122:3344:101::c]:51767
132026-08-27T01:08:28.443ZINFOcrucible-agent (datafile): region e137ae0f-44fe-41e3-bbda-761e04423ffb state: Requested
142026-08-27T01:08:28.448ZINFOcrucible-agent (worker): Region size:1073741824 reservation:1342177280 quota:3221225472
152026-08-27T01:08:28.452ZINFOcrucible-agent (dropshot): request completed latency_us = 15579 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:51767 req_id = f10be5a0-c7db-4883-b0af-35bf572ec5a8 response_code = 200 uri = /crucible/0/regions
162026-08-27T01:08:28.458ZINFOcrucible-agent (worker): zfs set reservation of 1342177280 for oxp_043a45fe-0e87-4312-9877-a5ae8fc7d496/crucible/regions/e137ae0f-44fe-41e3-bbda-761e04423ffb
172026-08-27T01:08:28.458ZINFOcrucible-agent (worker): zfs set quota of 3221225472 for oxp_043a45fe-0e87-4312-9877-a5ae8fc7d496/crucible/regions/e137ae0f-44fe-41e3-bbda-761e04423ffb
182026-08-27T01:08:28.546ZINFOcrucible-agent (worker): creating region Region { id: RegionId("e137ae0f-44fe-41e3-bbda-761e04423ffb"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 16, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/e137ae0f-44fe-41e3-bbda-761e04423ffb" region = e137ae0f-44fe-41e3-bbda-761e04423ffb
192026-08-27T01:08:28.548ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "e137ae0f-44fe-41e3-bbda-761e04423ffb" "--data" "/data/regions/e137ae0f-44fe-41e3-bbda-761e04423ffb" "--block-size" "512" "--extent-size" "131072" "--extent-count" "16" "--encrypted" region = e137ae0f-44fe-41e3-bbda-761e04423ffb
202026-08-27T01:08:28.622ZINFOcrucible-agent (dropshot): request completed latency_us = 60 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:51767 req_id = 838b52c3-c8c7-48f5-b56b-6f1946427e8b response_code = 200 uri = /crucible/0/regions
212026-08-27T01:08:28.729ZINFOcrucible-agent (worker): region files created ok region = e137ae0f-44fe-41e3-bbda-761e04423ffb
222026-08-27T01:08:28.733ZINFOcrucible-agent (datafile): region e137ae0f-44fe-41e3-bbda-761e04423ffb state: Requested -> Created
232026-08-27T01:08:28.733ZINFOcrucible-agent (worker): applying SMF actions post create...
242026-08-27T01:08:28.735ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-e137ae0f-44fe-41e3-bbda-761e04423ffb
252026-08-27T01:08:28.746ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-e137ae0f-44fe-41e3-bbda-761e04423ffb
262026-08-27T01:08:28.758ZINFOcrucible-agent (worker): creating config property group
272026-08-27T01:08:28.761ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-e137ae0f-44fe-41e3-bbda-761e04423ffb
282026-08-27T01:08:28.762ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/e137ae0f-44fe-41e3-bbda-761e04423ffb
292026-08-27T01:08:28.762ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
302026-08-27T01:08:28.762ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::12
312026-08-27T01:08:28.762ZINFOcrucible-agent (worker): commit
322026-08-27T01:08:28.769ZINFOcrucible-agent (worker): ok!
332026-08-27T01:08:28.774ZINFOcrucible-agent (worker): SMF ok!
342026-08-27T01:08:29.199ZINFOcrucible-agent (dropshot): request completed latency_us = 62 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:51767 req_id = 4fb78384-1736-40fe-9702-5349600a172f response_code = 200 uri = /crucible/0/regions
352026-08-27T01:08:30.229ZINFOcrucible-agent (dropshot): request completed latency_us = 74 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:51767 req_id = 22545410-96c3-47a7-a5fd-6b46c2b34f58 response_code = 200 uri = /crucible/0/regions/e137ae0f-44fe-41e3-bbda-761e04423ffb
362026-08-27T01:08:30.234ZINFOcrucible-agent (datafile): path is "/data/regions/e137ae0f-44fe-41e3-bbda-761e04423ffb"
372026-08-27T01:08:30.242ZINFOcrucible-agent (datafile): dataset is oxp_043a45fe-0e87-4312-9877-a5ae8fc7d496/crucible/regions/e137ae0f-44fe-41e3-bbda-761e04423ffb
382026-08-27T01:08:30.250ZINFOcrucible-agent (datafile): region e137ae0f-44fe-41e3-bbda-761e04423ffb state: Created -> Tombstoned
392026-08-27T01:08:30.251ZINFOcrucible-agent (worker): applying SMF actions before removal...
402026-08-27T01:08:30.251ZINFOcrucible-agent (dropshot): request completed latency_us = 16877 local_addr = [fd00:1122:3344:101::12]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::c]:51767 req_id = 2cf16380-a756-4a00-9bf3-040d5a672a2f response_code = 204 uri = /crucible/0/regions/e137ae0f-44fe-41e3-bbda-761e04423ffb
412026-08-27T01:08:30.252ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-e137ae0f-44fe-41e3-bbda-761e04423ffb (instance states: (Some(Online), None))
422026-08-27T01:08:30.254ZINFOcrucible-agent (dropshot): request completed latency_us = 40 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:51767 req_id = 801a0df3-a5d9-4fd0-a243-815fea19dcd6 response_code = 200 uri = /crucible/0/regions/e137ae0f-44fe-41e3-bbda-761e04423ffb
432026-08-27T01:08:30.262ZINFOcrucible-agent (worker): SMF ok!
442026-08-27T01:08:30.272ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_043a45fe-0e87-4312-9877-a5ae8fc7d496/crucible/regions/e137ae0f-44fe-41e3-bbda-761e04423ffb" region = e137ae0f-44fe-41e3-bbda-761e04423ffb
452026-08-27T01:08:30.325ZINFOcrucible-agent (dropshot): request completed latency_us = 55 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:51767 req_id = f6b24107-1b78-4e4f-be89-b0c5ed39b43b response_code = 200 uri = /crucible/0/regions/e137ae0f-44fe-41e3-bbda-761e04423ffb
462026-08-27T01:08:30.377ZINFOcrucible-agent (datafile): region e137ae0f-44fe-41e3-bbda-761e04423ffb state: Tombstoned -> Destroyed
472026-08-27T01:08:30.483ZINFOcrucible-agent (dropshot): request completed latency_us = 53 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:51767 req_id = 28a4b3e1-2099-4821-80cf-ef0d5c66c842 response_code = 200 uri = /crucible/0/regions/e137ae0f-44fe-41e3-bbda-761e04423ffb