Max level shown:
1 [ Nov 11 21:11:15 Enabled. ]
2 [ Nov 11 21:11:15 Rereading configuration. ]
3 [ Nov 11 21:11:17 Rereading configuration. ]
4 [ Nov 11 21:11:28 Executing start method ("/opt/oxide/crucible/bin/crucible-agent run -D /opt/oxide/crucible/bin/crucible-downstairs --dataset oxp_35d049d9-4ff4-44fc-9cb6-664df6316670/crucible -l [fd00:1122:3344:101::14]:32345 -P 19000 -p downstairs -s snapshot"). ]
5 note: configured to log to "/dev/stdout"
62025-11-11T21:11:28.752ZINFOcrucible-agent: Crucible Version: Crucible Version: 0.0.1 Commit SHA: 75ea3408643664877aa603ffc65996ed6dc34c0a Commit timestamp: 2025-10-24T15:21:57.000000000Z branch: main rustc: 1.90.0 stable x86_64-unknown-illumos Cargo: x86_64-unknown-illumos Debug: false Opt level: 3
72025-11-11T21:11:28.753ZINFOcrucible-agent: dataset: "oxp_35d049d9-4ff4-44fc-9cb6-664df6316670/crucible"
82025-11-11T21:11:28.753ZINFOcrucible-agent: listen IP: [fd00:1122:3344:101::14]:32345
92025-11-11T21:11:28.753ZINFOcrucible-agent: SMF instance name downstairs_prefix: "downstairs"
102025-11-11T21:11:28.769ZINFOcrucible-agent (datafile): Using conf_path:"/data/crucible.json"
112025-11-11T21:11:28.870ZINFOcrucible-agent (dropshot): listening local_addr = [fd00:1122:3344:101::14]:32345
122025-11-11T21:12:26.421ZINFOcrucible-agent (dropshot): accepted connection local_addr = [fd00:1122:3344:101::14]:32345 remote_addr = [fd00:1122:3344:101::a]:41653
132025-11-11T21:12:26.451ZINFOcrucible-agent (datafile): region ec77182e-ef94-4925-bb64-44ae17a2a82f state: Requested
142025-11-11T21:12:26.457ZINFOcrucible-agent (worker): Region size:1073741824 reservation:1342177280 quota:3221225472
152025-11-11T21:12:26.457ZINFOcrucible-agent (dropshot): request completed latency_us = 16682 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:41653 req_id = 56eb62be-01da-4e68-aa52-b5904553ac6f response_code = 200 uri = /crucible/0/regions
162025-11-11T21:12:26.463ZINFOcrucible-agent (worker): zfs set reservation of 1342177280 for oxp_35d049d9-4ff4-44fc-9cb6-664df6316670/crucible/regions/ec77182e-ef94-4925-bb64-44ae17a2a82f
172025-11-11T21:12:26.463ZINFOcrucible-agent (worker): zfs set quota of 3221225472 for oxp_35d049d9-4ff4-44fc-9cb6-664df6316670/crucible/regions/ec77182e-ef94-4925-bb64-44ae17a2a82f
182025-11-11T21:12:26.546ZINFOcrucible-agent (worker): creating region Region { id: RegionId("ec77182e-ef94-4925-bb64-44ae17a2a82f"), state: Requested, block_size: 512, extent_size: 131072, extent_count: 16, encrypted: true, port_number: 19000, cert_pem: None, key_pem: None, root_pem: None, source: None, read_only: false } at "/data/regions/ec77182e-ef94-4925-bb64-44ae17a2a82f" region = ec77182e-ef94-4925-bb64-44ae17a2a82f
192025-11-11T21:12:26.548ZINFOcrucible-agent (worker): downstairs create with: env -i "/opt/oxide/crucible/bin/crucible-downstairs" "create" "--uuid" "ec77182e-ef94-4925-bb64-44ae17a2a82f" "--data" "/data/regions/ec77182e-ef94-4925-bb64-44ae17a2a82f" "--block-size" "512" "--extent-size" "131072" "--extent-count" "16" "--encrypted" region = ec77182e-ef94-4925-bb64-44ae17a2a82f
202025-11-11T21:12:26.669ZINFOcrucible-agent (dropshot): request completed latency_us = 85 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:41653 req_id = 0af85b92-b0eb-4729-8838-398a3e936695 response_code = 200 uri = /crucible/0/regions
212025-11-11T21:12:26.877ZINFOcrucible-agent (worker): region files created ok region = ec77182e-ef94-4925-bb64-44ae17a2a82f
222025-11-11T21:12:26.877ZINFOcrucible-agent (datafile): region ec77182e-ef94-4925-bb64-44ae17a2a82f state: Requested -> Created
232025-11-11T21:12:26.877ZINFOcrucible-agent (worker): applying SMF actions post create...
242025-11-11T21:12:26.878ZINFOcrucible-agent (worker): creating missing downstairs instance downstairs-ec77182e-ef94-4925-bb64-44ae17a2a82f
252025-11-11T21:12:26.885ZINFOcrucible-agent (worker): ok, have svc:/oxide/crucible/downstairs:downstairs-ec77182e-ef94-4925-bb64-44ae17a2a82f
262025-11-11T21:12:26.904ZINFOcrucible-agent (worker): creating config property group
272025-11-11T21:12:26.908ZINFOcrucible-agent (worker): reconfiguring svc:/oxide/crucible/downstairs:downstairs-ec77182e-ef94-4925-bb64-44ae17a2a82f
282025-11-11T21:12:26.909ZINFOcrucible-agent (worker): ensure directory SCF_TYPE_ASTRING /data/regions/ec77182e-ef94-4925-bb64-44ae17a2a82f
292025-11-11T21:12:26.909ZINFOcrucible-agent (worker): ensure port SCF_TYPE_COUNT 19000
302025-11-11T21:12:26.909ZINFOcrucible-agent (worker): ensure address SCF_TYPE_ASTRING fd00:1122:3344:101::14
312025-11-11T21:12:26.909ZINFOcrucible-agent (worker): commit
322025-11-11T21:12:26.912ZINFOcrucible-agent (worker): ok!
332025-11-11T21:12:26.916ZINFOcrucible-agent (worker): SMF ok!
342025-11-11T21:12:27.089ZINFOcrucible-agent (dropshot): request completed latency_us = 59 local_addr = [fd00:1122:3344:101::14]:32345 method = POST remote_addr = [fd00:1122:3344:101::a]:41653 req_id = 4e3a54b8-6510-4dc1-a37b-e6567a355b5a response_code = 200 uri = /crucible/0/regions
352025-11-11T21:12:28.161ZINFOcrucible-agent (dropshot): request completed latency_us = 97 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:41653 req_id = 155fec35-364b-4ec5-83c5-5c7bce67b818 response_code = 200 uri = /crucible/0/regions/ec77182e-ef94-4925-bb64-44ae17a2a82f
362025-11-11T21:12:28.167ZINFOcrucible-agent (datafile): path is "/data/regions/ec77182e-ef94-4925-bb64-44ae17a2a82f"
372025-11-11T21:12:28.175ZINFOcrucible-agent (datafile): dataset is oxp_35d049d9-4ff4-44fc-9cb6-664df6316670/crucible/regions/ec77182e-ef94-4925-bb64-44ae17a2a82f
382025-11-11T21:12:28.183ZINFOcrucible-agent (datafile): region ec77182e-ef94-4925-bb64-44ae17a2a82f state: Created -> Tombstoned
392025-11-11T21:12:28.183ZINFOcrucible-agent (worker): applying SMF actions before removal...
402025-11-11T21:12:28.183ZINFOcrucible-agent (dropshot): request completed latency_us = 16551 local_addr = [fd00:1122:3344:101::14]:32345 method = DELETE remote_addr = [fd00:1122:3344:101::a]:41653 req_id = 0650ac8d-7d06-484b-882b-a728831617af response_code = 204 uri = /crucible/0/regions/ec77182e-ef94-4925-bb64-44ae17a2a82f
412025-11-11T21:12:28.184ZINFOcrucible-agent (worker): disabling downstairs instance: downstairs-ec77182e-ef94-4925-bb64-44ae17a2a82f (instance states: (Some(Online), None))
422025-11-11T21:12:28.190ZINFOcrucible-agent (dropshot): request completed latency_us = 27 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:41653 req_id = 75896b54-a6c6-40c5-9f74-bf7db6d48ce4 response_code = 200 uri = /crucible/0/regions/ec77182e-ef94-4925-bb64-44ae17a2a82f
432025-11-11T21:12:28.193ZINFOcrucible-agent (worker): SMF ok!
442025-11-11T21:12:28.201ZINFOcrucible-agent (worker): deleting zfs dataset "oxp_35d049d9-4ff4-44fc-9cb6-664df6316670/crucible/regions/ec77182e-ef94-4925-bb64-44ae17a2a82f" region = ec77182e-ef94-4925-bb64-44ae17a2a82f
452025-11-11T21:12:28.273ZINFOcrucible-agent (dropshot): request completed latency_us = 43 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:41653 req_id = 2d9953eb-1008-4121-8419-e37118358cff response_code = 200 uri = /crucible/0/regions/ec77182e-ef94-4925-bb64-44ae17a2a82f
462025-11-11T21:12:28.285ZINFOcrucible-agent (datafile): region ec77182e-ef94-4925-bb64-44ae17a2a82f state: Tombstoned -> Destroyed
472025-11-11T21:12:28.371ZINFOcrucible-agent (dropshot): request completed latency_us = 31 local_addr = [fd00:1122:3344:101::14]:32345 method = GET remote_addr = [fd00:1122:3344:101::a]:41653 req_id = f1a81f7d-97f1-45cc-a2ed-dcd02aaa4392 response_code = 200 uri = /crucible/0/regions/ec77182e-ef94-4925-bb64-44ae17a2a82f