Max level shown:
1 [ Nov 8 00:00:04 Enabled. ]
2 [ Nov 8 00:00:04 Rereading configuration. ]
3 [ Nov 8 00:00:06 Rereading configuration. ]
4 [ Nov 8 00:00:11 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_87c8253b-21fd-4c31-a04f-ddb9e9627ecd/crucible -l [fd00:1122:3344:101::15]:32345 -P 19000 -p downstairs -s snapshot"). ]
5 note: configured to log to "/dev/stdout"
62025-11-08T00:00:11.301ZINFOcrucible-agent: Crucible Version: Crucible Version: 0.0.1 Commit SHA: 75ea3408643664877aa603ffc65996ed6dc34c0a Commit timestamp: 2025-10-24T15:21:57.000000000Z branch: main rustc: 1.90.0 stable x86_64-unknown-illumos Cargo: x86_64-unknown-illumos Debug: false Opt level: 3
72025-11-08T00:00:11.301ZINFOcrucible-agent: dataset: "oxp_87c8253b-21fd-4c31-a04f-ddb9e9627ecd/crucible"
82025-11-08T00:00:11.301ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::15]:32345
92025-11-08T00:00:11.301ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
102025-11-08T00:00:11.319ZINFOcrucible-agent (datafile): Using conf_path:"/data/crucible.json"
112025-11-08T00:00:11.444ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::15]:32345
122025-11-08T00:11:28.577ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::15]:32345 remote_addr = [fd00:1122:3344:101::c]:50592
132025-11-08T00:11:28.625ZINFOcrucible-agent (datafile): region 6f29a948-1536-4183-b6c7-e8a99c7daf90 state: Requested
142025-11-08T00:11:28.633ZINFOcrucible-agent (dropshot): request completed latency_us = 25382 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:50592 req_id = 314632bb-bd3d-4e80-b0ae-282af3f895d5 response_code = 200 uri = /crucible/0/regions
152025-11-08T00:11:28.633ZINFOcrucible-agent (worker): Region size:2147483648 reservation:2684354560 quota:6442450944
162025-11-08T00:11:28.645ZINFOcrucible-agent (worker): zfs set reservation of 2684354560 for oxp_87c8253b-21fd-4c31-a04f-ddb9e9627ecd/crucible/regions/6f29a948-1536-4183-b6c7-e8a99c7daf90
172025-11-08T00:11:28.645ZINFOcrucible-agent (worker): zfs set quota of 6442450944 for oxp_87c8253b-21fd-4c31-a04f-ddb9e9627ecd/crucible/regions/6f29a948-1536-4183-b6c7-e8a99c7daf90
182025-11-08T00:11:28.700ZINFOcrucible-agent (worker): creating region Region { id: RegionId("6f29a948-1536-4183-b6c7-e8a99c7daf90"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 32, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/6f29a948-1536-4183-b6c7-e8a99c7daf90" region = 6f29a948-1536-4183-b6c7-e8a99c7daf90
192025-11-08T00:11:28.702ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "6f29a948-1536-4183-b6c7-e8a99c7daf90" "--data" "/data/regions/6f29a948-1536-4183-b6c7-e8a99c7daf90" "--block-size" "512" "--extent-size" "131072" "--extent-count" "32" "--encrypted" region = 6f29a948-1536-4183-b6c7-e8a99c7daf90
202025-11-08T00:11:29.015ZINFOcrucible-agent (dropshot): request completed latency_us = 59 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:50592 req_id = bcdbeacf-43aa-48f9-b0b8-fb393e23bf35 response_code = 200 uri = /crucible/0/regions
212025-11-08T00:11:29.032ZINFOcrucible-agent (worker): region files created ok region = 6f29a948-1536-4183-b6c7-e8a99c7daf90
222025-11-08T00:11:29.032ZINFOcrucible-agent (datafile): region 6f29a948-1536-4183-b6c7-e8a99c7daf90 state: Requested -> Created
232025-11-08T00:11:29.032ZINFOcrucible-agent (worker): applying SMF actions post create...
242025-11-08T00:11:29.032ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-6f29a948-1536-4183-b6c7-e8a99c7daf90
252025-11-08T00:11:29.046ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-6f29a948-1536-4183-b6c7-e8a99c7daf90
262025-11-08T00:11:29.070ZINFOcrucible-agent (worker): creating config property group
272025-11-08T00:11:29.073ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-6f29a948-1536-4183-b6c7-e8a99c7daf90
282025-11-08T00:11:29.076ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/6f29a948-1536-4183-b6c7-e8a99c7daf90
292025-11-08T00:11:29.076ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
302025-11-08T00:11:29.076ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::15
312025-11-08T00:11:29.076ZINFOcrucible-agent (worker): commit
322025-11-08T00:11:29.080ZINFOcrucible-agent (worker): ok!
332025-11-08T00:11:29.085ZINFOcrucible-agent (worker): SMF ok!
342025-11-08T00:11:29.733ZINFOcrucible-agent (dropshot): request completed latency_us = 57 local_addr = [fd00:1122:3344:101::15]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:50592 req_id = 92251a1c-bea4-4ab5-b7c1-938ef57d3ab2 response_code = 200 uri = /crucible/0/regions
352025-11-08T00:11:54.504ZINFOcrucible-agent (dropshot): request completed latency_us = 137 local_addr = [fd00:1122:3344:101::15]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:50592 req_id = f29374c9-88db-4d08-9f3d-fa2ce7f8e9a8 response_code = 200 uri = /crucible/0/regions/6f29a948-1536-4183-b6c7-e8a99c7daf90
362025-11-08T00:11:54.508ZINFOcrucible-agent (datafile): path is "/data/regions/6f29a948-1536-4183-b6c7-e8a99c7daf90"
372025-11-08T00:11:54.518ZINFOcrucible-agent (datafile): dataset is oxp_87c8253b-21fd-4c31-a04f-ddb9e9627ecd/crucible/regions/6f29a948-1536-4183-b6c7-e8a99c7daf90
382025-11-08T00:11:54.525ZINFOcrucible-agent (datafile): region 6f29a948-1536-4183-b6c7-e8a99c7daf90 state: Created -> Tombstoned
392025-11-08T00:11:54.525ZINFOcrucible-agent (dropshot): request completed latency_us = 17125 local_addr = [fd00:1122:3344:101::15]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::c]:50592 req_id = 495c6c7d-b212-410e-a8f1-a6bdc850ee16 response_code = 204 uri = /crucible/0/regions/6f29a948-1536-4183-b6c7-e8a99c7daf90
402025-11-08T00:11:54.525ZINFOcrucible-agent (worker): applying SMF actions before removal...
412025-11-08T00:11:54.526ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-6f29a948-1536-4183-b6c7-e8a99c7daf90 (instance states: (Some(Online), None))
422025-11-08T00:11:54.528ZINFOcrucible-agent (dropshot): request completed latency_us = 29 local_addr = [fd00:1122:3344:101::15]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:50592 req_id = 21fb0454-0dfc-4e24-81c9-7c6a072b5185 response_code = 200 uri = /crucible/0/regions/6f29a948-1536-4183-b6c7-e8a99c7daf90
432025-11-08T00:11:54.538ZINFOcrucible-agent (worker): SMF ok!
442025-11-08T00:11:54.545ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_87c8253b-21fd-4c31-a04f-ddb9e9627ecd/crucible/regions/6f29a948-1536-4183-b6c7-e8a99c7daf90" region = 6f29a948-1536-4183-b6c7-e8a99c7daf90
452025-11-08T00:11:54.591ZINFOcrucible-agent (datafile): region 6f29a948-1536-4183-b6c7-e8a99c7daf90 state: Tombstoned -> Destroyed
462025-11-08T00:11:54.634ZINFOcrucible-agent (dropshot): request completed latency_us = 48 local_addr = [fd00:1122:3344:101::15]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:50592 req_id = 7dbd5848-5871-4389-b477-3e5c76e2855e response_code = 200 uri = /crucible/0/regions/6f29a948-1536-4183-b6c7-e8a99c7daf90