Max level shown:
1 [ Sep 3 04:03:44 Enabled. ]
2 [ Sep 3 04:03:44 Rereading configuration. ]
3 [ Sep 3 04:03:48 Rereading configuration. ]
4 [ Sep 3 04:03:59 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_004c9252-43df-49ba-bfce-5669a4d48238/crucible -l [fd00:1122:3344:101::17]:32345 -P 19000 -p downstairs -s snapshot"). ]
5 note: configured to log to "/dev/stdout"
62025-09-03T04:03:59.371ZINFOcrucible-agent: Crucible Version: Crucible Version: 0.0.1 Commit SHA: 779775d5130ff7a4836f52f48b7e64d1479ee104 Commit timestamp: 2025-08-09T00:27:59.000000000Z branch: main rustc: 1.86.0 stable x86_64-unknown-illumos Cargo: x86_64-unknown-illumos Debug: false Opt level: 3
72025-09-03T04:03:59.374ZINFOcrucible-agent: dataset: "oxp_004c9252-43df-49ba-bfce-5669a4d48238/crucible"
82025-09-03T04:03:59.374ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::17]:32345
92025-09-03T04:03:59.374ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
102025-09-03T04:03:59.390ZINFOcrucible-agent (datafile): Using conf_path:"/data/crucible.json"
112025-09-03T04:03:59.477ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::17]:32345
122025-09-03T04:04:32.967ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::17]:32345 remote_addr = [fd00:1122:3344:101::c]:51124
132025-09-03T04:04:33.015ZINFOcrucible-agent (datafile): region ba283ab6-6820-4ae6-8ac3-4396cd2d01af state: Requested
142025-09-03T04:04:33.022ZINFOcrucible-agent (dropshot): request completed latency_us = 26431 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:51124 req_id = 2365b0a2-b77a-4d3f-b487-e92ee77ad9ae response_code = 200 uri = /crucible/0/regions
152025-09-03T04:04:33.025ZINFOcrucible-agent (worker): Region size:1073741824 reservation:1342177280 quota:3221225472
162025-09-03T04:04:33.034ZINFOcrucible-agent (worker): zfs set reservation of 1342177280 for oxp_004c9252-43df-49ba-bfce-5669a4d48238/crucible/regions/ba283ab6-6820-4ae6-8ac3-4396cd2d01af
172025-09-03T04:04:33.034ZINFOcrucible-agent (worker): zfs set quota of 3221225472 for oxp_004c9252-43df-49ba-bfce-5669a4d48238/crucible/regions/ba283ab6-6820-4ae6-8ac3-4396cd2d01af
182025-09-03T04:04:33.098ZINFOcrucible-agent (worker): creating region Region { id: RegionId("ba283ab6-6820-4ae6-8ac3-4396cd2d01af"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 16, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/ba283ab6-6820-4ae6-8ac3-4396cd2d01af" region = ba283ab6-6820-4ae6-8ac3-4396cd2d01af
192025-09-03T04:04:33.100ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "ba283ab6-6820-4ae6-8ac3-4396cd2d01af" "--data" "/data/regions/ba283ab6-6820-4ae6-8ac3-4396cd2d01af" "--block-size" "512" "--extent-size" "131072" "--extent-count" "16" "--encrypted" region = ba283ab6-6820-4ae6-8ac3-4396cd2d01af
202025-09-03T04:04:33.276ZINFOcrucible-agent (dropshot): request completed latency_us = 73 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:51124 req_id = 1ff562e6-03d1-4f8e-80b8-cf63e54e6067 response_code = 200 uri = /crucible/0/regions
212025-09-03T04:04:33.393ZINFOcrucible-agent (worker): region files created ok region = ba283ab6-6820-4ae6-8ac3-4396cd2d01af
222025-09-03T04:04:33.393ZINFOcrucible-agent (datafile): region ba283ab6-6820-4ae6-8ac3-4396cd2d01af state: Requested -> Created
232025-09-03T04:04:33.393ZINFOcrucible-agent (worker): applying SMF actions post create...
242025-09-03T04:04:33.394ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-ba283ab6-6820-4ae6-8ac3-4396cd2d01af
252025-09-03T04:04:33.400ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-ba283ab6-6820-4ae6-8ac3-4396cd2d01af
262025-09-03T04:04:33.417ZINFOcrucible-agent (worker): creating config property group
272025-09-03T04:04:33.420ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-ba283ab6-6820-4ae6-8ac3-4396cd2d01af
282025-09-03T04:04:33.421ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/ba283ab6-6820-4ae6-8ac3-4396cd2d01af
292025-09-03T04:04:33.429ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
302025-09-03T04:04:33.430ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::17
312025-09-03T04:04:33.430ZINFOcrucible-agent (worker): commit
322025-09-03T04:04:33.438ZINFOcrucible-agent (worker): ok!
332025-09-03T04:04:33.443ZINFOcrucible-agent (worker): SMF ok!
342025-09-03T04:04:33.795ZINFOcrucible-agent (dropshot): request completed latency_us = 46 local_addr = [fd00:1122:3344:101::17]:32345 method = POST remote_addr = [fd00:1122:3344:101::c]:51124 req_id = a38a0724-a1ed-487a-ad37-6d9e5a873393 response_code = 200 uri = /crucible/0/regions
352025-09-03T04:04:34.291ZINFOcrucible-agent (dropshot): request completed latency_us = 63 local_addr = [fd00:1122:3344:101::17]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:51124 req_id = da1205cc-4408-4f5d-9850-ca0df5a04b09 response_code = 200 uri = /crucible/0/regions/ba283ab6-6820-4ae6-8ac3-4396cd2d01af
362025-09-03T04:04:34.295ZINFOcrucible-agent (datafile): path is "/data/regions/ba283ab6-6820-4ae6-8ac3-4396cd2d01af"
372025-09-03T04:04:34.306ZINFOcrucible-agent (datafile): dataset is oxp_004c9252-43df-49ba-bfce-5669a4d48238/crucible/regions/ba283ab6-6820-4ae6-8ac3-4396cd2d01af
382025-09-03T04:04:34.319ZINFOcrucible-agent (datafile): region ba283ab6-6820-4ae6-8ac3-4396cd2d01af state: Created -> Tombstoned
392025-09-03T04:04:34.319ZINFOcrucible-agent (worker): applying SMF actions before removal...
402025-09-03T04:04:34.319ZINFOcrucible-agent (dropshot): request completed latency_us = 24568 local_addr = [fd00:1122:3344:101::17]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::c]:51124 req_id = 5c214010-2f02-43cc-afc9-c8a63ce0b9ea response_code = 204 uri = /crucible/0/regions/ba283ab6-6820-4ae6-8ac3-4396cd2d01af
412025-09-03T04:04:34.320ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-ba283ab6-6820-4ae6-8ac3-4396cd2d01af (instance states: (Some(Online), None))
422025-09-03T04:04:34.324ZINFOcrucible-agent (dropshot): request completed latency_us = 27 local_addr = [fd00:1122:3344:101::17]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:51124 req_id = 7bdc65a0-f24f-4ded-aff6-e569056a4ad5 response_code = 200 uri = /crucible/0/regions/ba283ab6-6820-4ae6-8ac3-4396cd2d01af
432025-09-03T04:04:34.324ZINFOcrucible-agent (worker): SMF ok!
442025-09-03T04:04:34.336ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_004c9252-43df-49ba-bfce-5669a4d48238/crucible/regions/ba283ab6-6820-4ae6-8ac3-4396cd2d01af" region = ba283ab6-6820-4ae6-8ac3-4396cd2d01af
452025-09-03T04:04:34.412ZINFOcrucible-agent (datafile): region ba283ab6-6820-4ae6-8ac3-4396cd2d01af state: Tombstoned -> Destroyed
462025-09-03T04:04:34.456ZINFOcrucible-agent (dropshot): request completed latency_us = 53 local_addr = [fd00:1122:3344:101::17]:32345 method = GET remote_addr = [fd00:1122:3344:101::c]:51124 req_id = c839549b-1be3-4775-8204-fc5031ef71f6 response_code = 200 uri = /crucible/0/regions/ba283ab6-6820-4ae6-8ac3-4396cd2d01af