Max level shown:
1 [ Dec 20 04:54:07 Enabled. ]
2 [ Dec 20 04:54:07 Rereading configuration. ]
3 [ Dec 20 04:54:09 Rereading configuration. ]
4 [ Dec 20 04:54:14 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_3a5515a9-e40e-48af-88eb-4aade20355f4/crucible -l [fd00:1122:3344:101::12]:32345 -P 19000 -p downstairs -s snapshot"). ]
5 note: configured to log to "/dev/stdout"
62025-12-20T04:54:14.953ZINFOcrucible-agent: Crucible Version: Crucible Version: 0.0.1 Commit SHA: 7103cd3a3d7b0112d2949dd135db06fef0c156bb Commit timestamp: 2025-11-10T22:24:53.000000000Z branch: main rustc: 1.90.0 stable x86_64-unknown-illumos Cargo: x86_64-unknown-illumos Debug: false Opt level: 3
72025-12-20T04:54:14.953ZINFOcrucible-agent: dataset: "oxp_3a5515a9-e40e-48af-88eb-4aade20355f4/crucible"
82025-12-20T04:54:14.953ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::12]:32345
92025-12-20T04:54:14.953ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
102025-12-20T04:54:14.970ZINFOcrucible-agent (datafile): Using conf_path:"/data/crucible.json"
112025-12-20T04:54:15.186ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::12]:32345
122025-12-20T04:55:09.747ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::12]:32345 remote_addr = [fd00:1122:3344:101::c]:60106
132025-12-20T04:55:09.791ZINFOcrucible-agent (datafile): region 15a3b4f8-9647-4cce-9a4e-6c47bf8e4f1c state: Requested
142025-12-20T04:55:09.794ZINFOcrucible-agent (worker): Region size:1073741824 reservation:1342177280 quota:3221225472
152025-12-20T04:55:09.794ZINFOcrucible-agent (dropshot): request completed latency_us = 19720 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:60106 req_id = 43361ab5-9f0f-42f2-8363-18889bd07cf5 response_code = 200 uri = /crucible/0/regions
162025-12-20T04:55:09.804ZINFOcrucible-agent (worker): zfs set reservation of 1342177280 for oxp_3a5515a9-e40e-48af-88eb-4aade20355f4/crucible/regions/15a3b4f8-9647-4cce-9a4e-6c47bf8e4f1c
172025-12-20T04:55:09.804ZINFOcrucible-agent (worker): zfs set quota of 3221225472 for oxp_3a5515a9-e40e-48af-88eb-4aade20355f4/crucible/regions/15a3b4f8-9647-4cce-9a4e-6c47bf8e4f1c
182025-12-20T04:55:09.894ZINFOcrucible-agent (worker): creating region Region { id: RegionId("15a3b4f8-9647-4cce-9a4e-6c47bf8e4f1c"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 16, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/15a3b4f8-9647-4cce-9a4e-6c47bf8e4f1c" region = 15a3b4f8-9647-4cce-9a4e-6c47bf8e4f1c
192025-12-20T04:55:09.897ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "15a3b4f8-9647-4cce-9a4e-6c47bf8e4f1c" "--data" "/data/regions/15a3b4f8-9647-4cce-9a4e-6c47bf8e4f1c" "--block-size" "512" "--extent-size" "131072" "--extent-count" "16" "--encrypted" region = 15a3b4f8-9647-4cce-9a4e-6c47bf8e4f1c
202025-12-20T04:55:10.055ZINFOcrucible-agent (dropshot): request completed latency_us = 62 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:60106 req_id = 067a616a-f40f-4ebe-ad73-080c31e6b179 response_code = 200 uri = /crucible/0/regions
212025-12-20T04:55:10.352ZINFOcrucible-agent (dropshot): request completed latency_us = 62 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:60106 req_id = f7a1ac3a-3b48-4381-8fc2-88b5794a1349 response_code = 200 uri = /crucible/0/regions
222025-12-20T04:55:10.749ZINFOcrucible-agent (worker): region files created ok region = 15a3b4f8-9647-4cce-9a4e-6c47bf8e4f1c
232025-12-20T04:55:10.749ZINFOcrucible-agent (datafile): region 15a3b4f8-9647-4cce-9a4e-6c47bf8e4f1c state: Requested -> Created
242025-12-20T04:55:10.749ZINFOcrucible-agent (worker): applying SMF actions post create...
252025-12-20T04:55:10.750ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-15a3b4f8-9647-4cce-9a4e-6c47bf8e4f1c
262025-12-20T04:55:10.828ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-15a3b4f8-9647-4cce-9a4e-6c47bf8e4f1c
272025-12-20T04:55:10.967ZINFOcrucible-agent (worker): creating config property group
282025-12-20T04:55:10.993ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-15a3b4f8-9647-4cce-9a4e-6c47bf8e4f1c
292025-12-20T04:55:10.993ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/15a3b4f8-9647-4cce-9a4e-6c47bf8e4f1c
302025-12-20T04:55:10.993ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
312025-12-20T04:55:10.993ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::12
322025-12-20T04:55:10.993ZINFOcrucible-agent (worker): commit
332025-12-20T04:55:11.019ZINFOcrucible-agent (worker): ok!
342025-12-20T04:55:11.046ZINFOcrucible-agent (worker): SMF ok!
352025-12-20T04:55:11.839ZINFOcrucible-agent (dropshot): request completed latency_us = 97 local_addr = [fd00:1122:3344:101::12]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:60106 req_id = 4cc9cccb-f4f6-4813-a7ad-9776aededb02 response_code = 200 uri = /crucible/0/regions
362025-12-20T04:55:13.152ZINFOcrucible-agent (dropshot): request completed latency_us = 86 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:60106 req_id = e7f9b169-6c09-4a5b-8445-1a075fcf161c response_code = 200 uri = /crucible/0/regions/15a3b4f8-9647-4cce-9a4e-6c47bf8e4f1c
372025-12-20T04:55:13.155ZINFOcrucible-agent (datafile): path is "/data/regions/15a3b4f8-9647-4cce-9a4e-6c47bf8e4f1c"
382025-12-20T04:55:13.163ZINFOcrucible-agent (datafile): dataset is oxp_3a5515a9-e40e-48af-88eb-4aade20355f4/crucible/regions/15a3b4f8-9647-4cce-9a4e-6c47bf8e4f1c
392025-12-20T04:55:13.171ZINFOcrucible-agent (datafile): region 15a3b4f8-9647-4cce-9a4e-6c47bf8e4f1c state: Created -> Tombstoned
402025-12-20T04:55:13.171ZINFOcrucible-agent (dropshot): request completed latency_us = 15867 local_addr = [fd00:1122:3344:101::12]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::c]:60106 req_id = 22cbedbd-7e80-4ae5-beb4-59769163fd7e response_code = 204 uri = /crucible/0/regions/15a3b4f8-9647-4cce-9a4e-6c47bf8e4f1c
412025-12-20T04:55:13.171ZINFOcrucible-agent (worker): applying SMF actions before removal...
422025-12-20T04:55:13.172ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-15a3b4f8-9647-4cce-9a4e-6c47bf8e4f1c (instance states: (Some(Online), None))
432025-12-20T04:55:13.190ZINFOcrucible-agent (dropshot): request completed latency_us = 32 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:60106 req_id = fb2e4a6d-16e7-495a-b133-4bd1d92cdeb4 response_code = 200 uri = /crucible/0/regions/15a3b4f8-9647-4cce-9a4e-6c47bf8e4f1c
442025-12-20T04:55:13.202ZINFOcrucible-agent (worker): SMF ok!
452025-12-20T04:55:13.210ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_3a5515a9-e40e-48af-88eb-4aade20355f4/crucible/regions/15a3b4f8-9647-4cce-9a4e-6c47bf8e4f1c" region = 15a3b4f8-9647-4cce-9a4e-6c47bf8e4f1c
462025-12-20T04:55:13.337ZINFOcrucible-agent (dropshot): request completed latency_us = 59 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:60106 req_id = 885053f1-3550-464d-8841-61dec18386a3 response_code = 200 uri = /crucible/0/regions/15a3b4f8-9647-4cce-9a4e-6c47bf8e4f1c
472025-12-20T04:55:13.480ZINFOcrucible-agent (dropshot): request completed latency_us = 42 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:60106 req_id = 0fe0b568-1150-4639-b800-2a5b92a13a93 response_code = 200 uri = /crucible/0/regions/15a3b4f8-9647-4cce-9a4e-6c47bf8e4f1c
482025-12-20T04:55:13.640ZINFOcrucible-agent (datafile): region 15a3b4f8-9647-4cce-9a4e-6c47bf8e4f1c state: Tombstoned -> Destroyed
492025-12-20T04:55:13.640ZINFOcrucible-agent (dropshot): request completed latency_us = 42 local_addr = [fd00:1122:3344:101::12]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:60106 req_id = cdeac8c9-82b5-4554-b6b2-14f27ffc7e3a response_code = 200 uri = /crucible/0/regions/15a3b4f8-9647-4cce-9a4e-6c47bf8e4f1c