Max level shown:
12025-03-01T01:15:03.157ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = dc79dd8b-55e0-4135-aff2-e1e1bd787d61 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
22025-03-01T01:15:03.157ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = dc79dd8b-55e0-4135-aff2-e1e1bd787d61 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
32025-03-01T01:15:03.159ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2493 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = dc79dd8b-55e0-4135-aff2-e1e1bd787d61 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
42025-03-01T01:15:03.214ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 2 reason = Timeout
52025-03-01T01:15:03.214ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
62025-03-01T01:15:03.214ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 2 reason = Timeout
72025-03-01T01:15:03.214ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82025-03-01T01:15:03.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
92025-03-01T01:15:03.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
102025-03-01T01:15:03.217ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112025-03-01T01:15:03.220ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
122025-03-01T01:15:03.220ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
132025-03-01T01:15:03.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
142025-03-01T01:15:03.222ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
152025-03-01T01:15:03.223ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
162025-03-01T01:15:03.224ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
172025-03-01T01:15:03.226ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7, lookup_type: ById(8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7) } result = Ok(())
182025-03-01T01:15:03.226ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
192025-03-01T01:15:03.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
202025-03-01T01:15:03.243ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
212025-03-01T01:15:03.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
222025-03-01T01:15:03.246ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.520112ms iteration = 2 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
232025-03-01T01:15:03.310ZINFOnexus (BackgroundTasks): found new target blueprint (first find) background_task = blueprint_loader file = nexus/src/app/background/tasks/blueprint_load.rs:88 target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 time_created = 2025-03-01 01:14:50.436545 UTC
242025-03-01T01:15:03.310ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 95.972045ms iteration = 2 status = {"enabled":false,"status":"first target blueprint","target_id":"8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7","time_created":"2025-03-01T01:14:50.436545Z","time_found":"2025-03-01T01:15:03.310722325Z"}
252025-03-01T01:15:03.310ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 2 reason = Dependency
262025-03-01T01:15:03.310ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7
272025-03-01T01:15:03.310ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 6.95\u{b5}s iteration = 2 status = {"enabled":false,"target_id":"8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7"}
282025-03-01T01:15:03.310ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 2 reason = Dependency
292025-03-01T01:15:03.310ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
302025-03-01T01:15:03.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
312025-03-01T01:15:03.311ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
322025-03-01T01:15:03.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
332025-03-01T01:15:03.311ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
342025-03-01T01:15:03.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
352025-03-01T01:15:03.311ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
362025-03-01T01:15:03.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
372025-03-01T01:15:03.311ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
382025-03-01T01:15:03.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
392025-03-01T01:15:03.313ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
402025-03-01T01:15:03.316ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
412025-03-01T01:15:03.316ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
422025-03-01T01:15:03.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
432025-03-01T01:15:03.316ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
442025-03-01T01:15:03.318ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
452025-03-01T01:15:03.318ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
462025-03-01T01:15:03.318ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
472025-03-01T01:15:03.318ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
482025-03-01T01:15:03.319ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
492025-03-01T01:15:03.319ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
502025-03-01T01:15:03.320ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
512025-03-01T01:15:03.320ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
522025-03-01T01:15:03.321ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
532025-03-01T01:15:03.321ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
542025-03-01T01:15:03.321ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
552025-03-01T01:15:03.355ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::7]:32222/node/id
562025-03-01T01:15:03.389ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::4]:32222/node/id
572025-03-01T01:15:03.425ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::3]:32222/node/id
582025-03-01T01:15:03.425ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
592025-03-01T01:15:03.427ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
602025-03-01T01:15:03.427ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
612025-03-01T01:15:03.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
622025-03-01T01:15:03.459ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::6]:32222/node/id
632025-03-01T01:15:03.493ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::5]:32222/node/id
642025-03-01T01:15:04.180ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 044fff79-3dc2-4569-967e-54dc75636b6b roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
652025-03-01T01:15:04.181ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 044fff79-3dc2-4569-967e-54dc75636b6b resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
662025-03-01T01:15:04.184ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3944 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 044fff79-3dc2-4569-967e-54dc75636b6b response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
672025-03-01T01:15:04.227ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::3]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "dd5e4ea3-04cb-435b-a9f4-9594f094bc25", "content-length": "64", "date": "Sat, 01 Mar 2025 01:15:03 GMT"} })
682025-03-01T01:15:04.227ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
692025-03-01T01:15:04.228ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
702025-03-01T01:15:04.230ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
712025-03-01T01:15:04.231ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
722025-03-01T01:15:04.231ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
732025-03-01T01:15:04.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
742025-03-01T01:15:04.291ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::5]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "22349982-35e1-4cd5-899b-8bb5ac5c0ec7", "content-length": "64", "date": "Sat, 01 Mar 2025 01:15:04 GMT"} })
752025-03-01T01:15:04.291ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
762025-03-01T01:15:04.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
772025-03-01T01:15:04.294ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
782025-03-01T01:15:04.296ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
792025-03-01T01:15:04.296ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
802025-03-01T01:15:04.296ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
812025-03-01T01:15:04.330ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::7]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c4a0d4b3-69ac-412c-93d8-6a23c76cee17", "content-length": "64", "date": "Sat, 01 Mar 2025 01:15:04 GMT"} })
822025-03-01T01:15:04.330ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
832025-03-01T01:15:04.331ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
842025-03-01T01:15:04.333ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
852025-03-01T01:15:04.334ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
862025-03-01T01:15:04.334ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
872025-03-01T01:15:04.334ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
882025-03-01T01:15:04.386ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::4]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4726f899-1e5b-4a84-b6af-92def6058812", "content-length": "64", "date": "Sat, 01 Mar 2025 01:15:04 GMT"} })
892025-03-01T01:15:04.386ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
902025-03-01T01:15:04.386ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
912025-03-01T01:15:04.388ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
922025-03-01T01:15:04.389ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
932025-03-01T01:15:04.389ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
942025-03-01T01:15:04.389ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
952025-03-01T01:15:05.204ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 1c2a77bd-41a3-4225-9e90-aa6914e01785 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
962025-03-01T01:15:05.205ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 1c2a77bd-41a3-4225-9e90-aa6914e01785 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
972025-03-01T01:15:05.207ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2494 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 1c2a77bd-41a3-4225-9e90-aa6914e01785 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
982025-03-01T01:15:06.229ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 2eba0247-13f2-4742-b3b3-07750902ba73 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
992025-03-01T01:15:06.229ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 2eba0247-13f2-4742-b3b3-07750902ba73 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
1002025-03-01T01:15:06.232ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2499 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 2eba0247-13f2-4742-b3b3-07750902ba73 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
1012025-03-01T01:15:07.251ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 65c331b0-de84-438a-b43e-179b8db8123e roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
1022025-03-01T01:15:07.251ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 65c331b0-de84-438a-b43e-179b8db8123e resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
1032025-03-01T01:15:07.253ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2147 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 65c331b0-de84-438a-b43e-179b8db8123e response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
1042025-03-01T01:15:08.272ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = d8787ee3-00f9-4623-b1a3-8f0cc53e6ff3 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
1052025-03-01T01:15:08.273ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = d8787ee3-00f9-4623-b1a3-8f0cc53e6ff3 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
1062025-03-01T01:15:08.274ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1766 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = d8787ee3-00f9-4623-b1a3-8f0cc53e6ff3 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
1072025-03-01T01:15:09.294ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 5f95675c-7a98-41cc-9667-7aa88c8bbd6c roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
1082025-03-01T01:15:09.294ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 5f95675c-7a98-41cc-9667-7aa88c8bbd6c resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
1092025-03-01T01:15:09.296ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2427 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 5f95675c-7a98-41cc-9667-7aa88c8bbd6c response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
1102025-03-01T01:15:10.315ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 9eafae83-4f69-41e1-9bef-abe53d0d07cb roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
1112025-03-01T01:15:10.315ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 9eafae83-4f69-41e1-9bef-abe53d0d07cb resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
1122025-03-01T01:15:10.317ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2442 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 9eafae83-4f69-41e1-9bef-abe53d0d07cb response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
1132025-03-01T01:15:11.336ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = d64a6762-e0a7-4e01-b437-e5bbff6d1e5a roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
1142025-03-01T01:15:11.337ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = d64a6762-e0a7-4e01-b437-e5bbff6d1e5a resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
1152025-03-01T01:15:11.339ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2344 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = d64a6762-e0a7-4e01-b437-e5bbff6d1e5a response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
1162025-03-01T01:15:12.358ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 6e4d3562-dbbb-4289-ba57-71668e2d345d roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
1172025-03-01T01:15:12.358ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 6e4d3562-dbbb-4289-ba57-71668e2d345d resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
1182025-03-01T01:15:12.361ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2627 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 6e4d3562-dbbb-4289-ba57-71668e2d345d response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
1192025-03-01T01:15:13.214ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 3 reason = Timeout
1202025-03-01T01:15:13.214ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 3 reason = Timeout
1212025-03-01T01:15:13.214ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1222025-03-01T01:15:13.214ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
1232025-03-01T01:15:13.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1242025-03-01T01:15:13.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
1252025-03-01T01:15:13.215ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1262025-03-01T01:15:13.216ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
1272025-03-01T01:15:13.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
1282025-03-01T01:15:13.218ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
1292025-03-01T01:15:13.218ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1302025-03-01T01:15:13.218ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1312025-03-01T01:15:13.218ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.43131ms iteration = 3 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
1322025-03-01T01:15:13.220ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1332025-03-01T01:15:13.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1342025-03-01T01:15:13.221ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1352025-03-01T01:15:13.223ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7, lookup_type: ById(8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7) } result = Ok(())
1362025-03-01T01:15:13.223ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1372025-03-01T01:15:13.223ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1382025-03-01T01:15:13.240ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 original_time_created = 2025-03-01 01:14:50.436545 UTC target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 time_created = 2025-03-01 01:14:50.436545 UTC
1392025-03-01T01:15:13.240ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 26.02649ms iteration = 3 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7","time_created":"2025-03-01T01:14:50.436545Z"}
1402025-03-01T01:15:13.379ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = e1f2eea2-235e-44eb-8bf4-7d620f666bb7 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
1412025-03-01T01:15:13.380ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = e1f2eea2-235e-44eb-8bf4-7d620f666bb7 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
1422025-03-01T01:15:13.381ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2316 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = e1f2eea2-235e-44eb-8bf4-7d620f666bb7 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
1432025-03-01T01:15:14.402ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 19d0ec3f-e9d8-4682-82a6-658cd7fd0f21 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
1442025-03-01T01:15:14.402ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 19d0ec3f-e9d8-4682-82a6-658cd7fd0f21 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
1452025-03-01T01:15:14.404ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1903 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 19d0ec3f-e9d8-4682-82a6-658cd7fd0f21 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
1462025-03-01T01:15:15.423ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 08636e2f-36c1-4b5a-9711-45bff4e05306 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
1472025-03-01T01:15:15.424ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 08636e2f-36c1-4b5a-9711-45bff4e05306 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
1482025-03-01T01:15:15.425ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1955 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 08636e2f-36c1-4b5a-9711-45bff4e05306 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
1492025-03-01T01:15:16.446ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 07f3747e-e2c0-4fc3-a753-2cef75accd23 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
1502025-03-01T01:15:16.446ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 07f3747e-e2c0-4fc3-a753-2cef75accd23 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
1512025-03-01T01:15:16.447ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2020 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 07f3747e-e2c0-4fc3-a753-2cef75accd23 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
1522025-03-01T01:15:17.468ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 89a72abf-b2f0-47d6-ad33-7354fc4597c3 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
1532025-03-01T01:15:17.468ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 89a72abf-b2f0-47d6-ad33-7354fc4597c3 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
1542025-03-01T01:15:17.470ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2010 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 89a72abf-b2f0-47d6-ad33-7354fc4597c3 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
1552025-03-01T01:15:18.463ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Err(reqwest::Error { kind: Request, url: "http://[fd00:1122:3344:101::6]:32222/node/id", source: TimedOut })
1562025-03-01T01:15:18.473ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 15.162304716s iteration = 2 status = {"errors":[{"err":"failed to fetch node ID for zone 9d13cad0-d7a8-46c6-866f-68d0e123cf5a at http://[fd00:1122:3344:101::6]:32222: Communication Error: error sending request for url (http://[fd00:1122:3344:101::6]:32222/node/id): error sending request for url (http://[fd00:1122:3344:101::6]:32222/node/id): operation timed out","zone_id":"9d13cad0-d7a8-46c6-866f-68d0e123cf5a"}],"nsuccess":4}
1572025-03-01T01:15:18.489ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 512cbb57-b567-4fc9-b88f-e05e537df59b roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
1582025-03-01T01:15:18.490ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 512cbb57-b567-4fc9-b88f-e05e537df59b resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
1592025-03-01T01:15:18.491ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2114 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 512cbb57-b567-4fc9-b88f-e05e537df59b response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
1602025-03-01T01:15:19.510ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = b6ed7fce-86a9-4df3-be77-80aaab99d365 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
1612025-03-01T01:15:19.510ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = b6ed7fce-86a9-4df3-be77-80aaab99d365 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
1622025-03-01T01:15:19.512ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2308 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = b6ed7fce-86a9-4df3-be77-80aaab99d365 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
1632025-03-01T01:15:20.532ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 3457deff-7150-47dd-a97d-650c94df34cd roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
1642025-03-01T01:15:20.532ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 3457deff-7150-47dd-a97d-650c94df34cd resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
1652025-03-01T01:15:20.533ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1967 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 3457deff-7150-47dd-a97d-650c94df34cd response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
1662025-03-01T01:15:21.552ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 196a72e0-7ac9-4ea6-8585-beeb1981083b roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
1672025-03-01T01:15:21.552ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 196a72e0-7ac9-4ea6-8585-beeb1981083b resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
1682025-03-01T01:15:21.554ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1903 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 196a72e0-7ac9-4ea6-8585-beeb1981083b response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
1692025-03-01T01:15:22.572ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = b6451724-8c1e-43fb-9df7-79db1e3bea4c roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
1702025-03-01T01:15:22.573ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = b6451724-8c1e-43fb-9df7-79db1e3bea4c resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
1712025-03-01T01:15:22.574ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1569 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = b6451724-8c1e-43fb-9df7-79db1e3bea4c response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
1722025-03-01T01:15:23.214ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 2 reason = Timeout
1732025-03-01T01:15:23.214ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
1742025-03-01T01:15:23.214ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 2 reason = Timeout
1752025-03-01T01:15:23.214ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
1762025-03-01T01:15:23.214ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 4 reason = Timeout
1772025-03-01T01:15:23.214ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
1782025-03-01T01:15:23.214ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 2 reason = Timeout
1792025-03-01T01:15:23.214ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 2 reason = Timeout
1802025-03-01T01:15:23.214ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
1812025-03-01T01:15:23.214ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
1822025-03-01T01:15:23.214ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 3 reason = Timeout
1832025-03-01T01:15:23.214ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 2 reason = Timeout
1842025-03-01T01:15:23.214ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
1852025-03-01T01:15:23.214ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
1862025-03-01T01:15:23.214ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 2 reason = Timeout
1872025-03-01T01:15:23.214ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
1882025-03-01T01:15:23.214ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 2 reason = Timeout
1892025-03-01T01:15:23.214ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1902025-03-01T01:15:23.214ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 2 reason = Timeout
1912025-03-01T01:15:23.214ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 2 reason = Timeout
1922025-03-01T01:15:23.214ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
1932025-03-01T01:15:23.214ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
1942025-03-01T01:15:23.214ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 2 reason = Timeout
1952025-03-01T01:15:23.214ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
1962025-03-01T01:15:23.214ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 2 reason = Timeout
1972025-03-01T01:15:23.214ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 2 reason = Timeout
1982025-03-01T01:15:23.214ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
1992025-03-01T01:15:23.214ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
2002025-03-01T01:15:23.214ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 2 reason = Timeout
2012025-03-01T01:15:23.214ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 2 reason = Timeout
2022025-03-01T01:15:23.214ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
2032025-03-01T01:15:23.214ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
2042025-03-01T01:15:23.214ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 2 reason = Timeout
2052025-03-01T01:15:23.214ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
2062025-03-01T01:15:23.214ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2072025-03-01T01:15:23.214ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 4 reason = Timeout
2082025-03-01T01:15:23.214ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
2092025-03-01T01:15:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
2102025-03-01T01:15:23.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
2112025-03-01T01:15:23.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
2122025-03-01T01:15:23.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
2132025-03-01T01:15:23.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
2142025-03-01T01:15:23.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
2152025-03-01T01:15:23.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
2162025-03-01T01:15:23.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
2172025-03-01T01:15:23.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
2182025-03-01T01:15:23.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
2192025-03-01T01:15:23.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2202025-03-01T01:15:23.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
2212025-03-01T01:15:23.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
2222025-03-01T01:15:23.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
2232025-03-01T01:15:23.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
2242025-03-01T01:15:23.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2252025-03-01T01:15:23.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2262025-03-01T01:15:23.217ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2272025-03-01T01:15:23.218ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2282025-03-01T01:15:23.218ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.284567ms iteration = 2 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
2292025-03-01T01:15:23.219ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
2302025-03-01T01:15:23.219ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
2312025-03-01T01:15:23.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
2322025-03-01T01:15:23.220ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
2332025-03-01T01:15:23.220ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
2342025-03-01T01:15:23.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
2352025-03-01T01:15:23.224ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2362025-03-01T01:15:23.224ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2372025-03-01T01:15:23.224ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2382025-03-01T01:15:23.226ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
2392025-03-01T01:15:23.226ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
2402025-03-01T01:15:23.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
2412025-03-01T01:15:23.227ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
2422025-03-01T01:15:23.227ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2432025-03-01T01:15:23.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2442025-03-01T01:15:23.227ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
2452025-03-01T01:15:23.227ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
2462025-03-01T01:15:23.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
2472025-03-01T01:15:23.234ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 933, tv_nsec: 922082207 } })
2482025-03-01T01:15:23.235ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1154
2492025-03-01T01:15:23.237ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2502025-03-01T01:15:23.239ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
2512025-03-01T01:15:23.239ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2522025-03-01T01:15:23.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2532025-03-01T01:15:23.240ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2542025-03-01T01:15:23.242ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
2552025-03-01T01:15:23.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
2562025-03-01T01:15:23.243ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
2572025-03-01T01:15:23.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
2582025-03-01T01:15:23.243ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 933, tv_nsec: 931151602 } })
2592025-03-01T01:15:23.243ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
2602025-03-01T01:15:23.243ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2612025-03-01T01:15:23.243ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1154 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66
2622025-03-01T01:15:23.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2632025-03-01T01:15:23.246ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2642025-03-01T01:15:23.247ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
2652025-03-01T01:15:23.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
2662025-03-01T01:15:23.249ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7, lookup_type: ById(8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7) } result = Ok(())
2672025-03-01T01:15:23.249ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
2682025-03-01T01:15:23.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
2692025-03-01T01:15:23.262ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 47.64803ms iteration = 2 status = {"errors":[],"finish_invoked_ok":[]}
2702025-03-01T01:15:23.269ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 54.654573ms iteration = 2 status = {"errors":[],"garbage_collect_requested":[]}
2712025-03-01T01:15:23.272ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 original_time_created = 2025-03-01 01:14:50.436545 UTC target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 time_created = 2025-03-01 01:14:50.436545 UTC
2722025-03-01T01:15:23.272ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 57.784746ms iteration = 4 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7","time_created":"2025-03-01T01:14:50.436545Z"}
2732025-03-01T01:15:23.274ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
2742025-03-01T01:15:23.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
2752025-03-01T01:15:23.276ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2762025-03-01T01:15:23.278ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
2772025-03-01T01:15:23.278ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
2782025-03-01T01:15:23.278ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
2792025-03-01T01:15:23.280ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
2802025-03-01T01:15:23.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
2812025-03-01T01:15:23.281ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2822025-03-01T01:15:23.281ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
2832025-03-01T01:15:23.281ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
2842025-03-01T01:15:23.281ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
2852025-03-01T01:15:23.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
2862025-03-01T01:15:23.282ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 68.180039ms iteration = 4 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
2872025-03-01T01:15:23.283ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
2882025-03-01T01:15:23.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
2892025-03-01T01:15:23.284ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 70.112008ms iteration = 2 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
2902025-03-01T01:15:23.284ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
2912025-03-01T01:15:23.284ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2922025-03-01T01:15:23.284ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
2932025-03-01T01:15:23.284ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 70.558847ms iteration = 2 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
2942025-03-01T01:15:23.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2952025-03-01T01:15:23.286ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
2962025-03-01T01:15:23.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
2972025-03-01T01:15:23.286ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2982025-03-01T01:15:23.287ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2992025-03-01T01:15:23.295ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
3002025-03-01T01:15:23.295ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
3012025-03-01T01:15:23.296ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
3022025-03-01T01:15:23.296ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
3032025-03-01T01:15:23.298ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3042025-03-01T01:15:23.300ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
3052025-03-01T01:15:23.300ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
3062025-03-01T01:15:23.300ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
3072025-03-01T01:15:23.306ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
3082025-03-01T01:15:23.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
3092025-03-01T01:15:23.315ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 100.927326ms iteration = 2 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
3102025-03-01T01:15:23.316ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
3112025-03-01T01:15:23.316ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 102.002108ms iteration = 2 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
3122025-03-01T01:15:23.338ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
3132025-03-01T01:15:23.338ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
3142025-03-01T01:15:23.339ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1c91dbb3-71f8-4a01-82c9-95bdf1c00393", "content-length": "26", "date": "Sat, 01 Mar 2025 01:15:23 GMT"} })
3152025-03-01T01:15:23.339ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
3162025-03-01T01:15:23.340ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
3172025-03-01T01:15:23.342ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
3182025-03-01T01:15:23.342ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
3192025-03-01T01:15:23.342ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
3202025-03-01T01:15:23.343ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
3212025-03-01T01:15:23.347ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3222025-03-01T01:15:23.350ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
3232025-03-01T01:15:23.350ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
3242025-03-01T01:15:23.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
3252025-03-01T01:15:23.356ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 934, tv_nsec: 44454450 } })
3262025-03-01T01:15:23.357ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1154
3272025-03-01T01:15:23.363ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1162 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 zone_address = fd00:1122:3344:101::2
3282025-03-01T01:15:23.363ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
3292025-03-01T01:15:23.363ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2d471712-03cc-42f3-9951-ee18af246239", "content-length": "26", "date": "Sat, 01 Mar 2025 01:15:23 GMT"} })
3302025-03-01T01:15:23.363ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1167 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
3312025-03-01T01:15:23.365ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66
3322025-03-01T01:15:23.390ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3332025-03-01T01:15:23.392ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
3342025-03-01T01:15:23.392ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
3352025-03-01T01:15:23.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
3362025-03-01T01:15:23.425ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 211.018168ms iteration = 3 status = {"physical_disks_added":0}
3372025-03-01T01:15:23.428ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
3382025-03-01T01:15:23.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
3392025-03-01T01:15:23.434ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
3402025-03-01T01:15:23.434ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
3412025-03-01T01:15:23.438ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3422025-03-01T01:15:23.440ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 3471264f-127e-4a25-bc10-2e8249e8d70a, lookup_type: ById(3471264f-127e-4a25-bc10-2e8249e8d70a) } result = Ok(())
3432025-03-01T01:15:23.440ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
3442025-03-01T01:15:23.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
3452025-03-01T01:15:23.471ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 256.888293ms iteration = 2 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
3462025-03-01T01:15:23.481ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 266.593071ms iteration = 2 status = {}
3472025-03-01T01:15:23.484ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
3482025-03-01T01:15:23.484ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
3492025-03-01T01:15:23.484ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 270.244595ms iteration = 2 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
3502025-03-01T01:15:23.486ZINFOnexus (BackgroundTasks): VPC route manager sled 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
3512025-03-01T01:15:23.486ZDEBGnexus (BackgroundTasks): client request SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
3522025-03-01T01:15:23.518ZDEBGnexus (BackgroundTasks): client request SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
3532025-03-01T01:15:23.520ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
3542025-03-01T01:15:23.520ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
3552025-03-01T01:15:23.558ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
3562025-03-01T01:15:23.558ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
3572025-03-01T01:15:23.559ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8cb60822-0fe9-48d7-838c-5b090fe405ac", "content-length": "26", "date": "Sat, 01 Mar 2025 01:15:23 GMT"} })
3582025-03-01T01:15:23.559ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
3592025-03-01T01:15:23.559ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
3602025-03-01T01:15:23.607ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
3612025-03-01T01:15:23.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
3622025-03-01T01:15:23.610ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
3632025-03-01T01:15:23.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
3642025-03-01T01:15:23.619ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
3652025-03-01T01:15:23.619ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "1fb1f95e-ad21-462b-b1e1-c81e57e74a9c", "content-length": "1", "date": "Sat, 01 Mar 2025 01:15:23 GMT"} })
3662025-03-01T01:15:23.620ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
3672025-03-01T01:15:23.620ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
3682025-03-01T01:15:23.622ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 407.812088ms iteration = 2 status = null
3692025-03-01T01:15:23.653ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3702025-03-01T01:15:23.654ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3712025-03-01T01:15:23.765ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 7f9c3c14-58c5-473f-8692-6376be44401e, rack_id: 4854cb88-dfba-4609-8f9d-72aac08cef66, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(cb10d0c6-a704-4231-b148-4f9ae21a03f8) } rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 switch_location = Switch0
3722025-03-01T01:15:23.765ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3732025-03-01T01:15:23.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3742025-03-01T01:15:23.796ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
3752025-03-01T01:15:23.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
3762025-03-01T01:15:23.800ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
3772025-03-01T01:15:23.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
3782025-03-01T01:15:23.814ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 46461e0a-aec3-48cd-9e8a-4c87361eef24 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
3792025-03-01T01:15:23.815ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 46461e0a-aec3-48cd-9e8a-4c87361eef24 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
3802025-03-01T01:15:23.815ZDEBGnexus (BackgroundTasks): client response SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "7a90dd17-add3-4f8b-acb4-efd9b1a13205", "content-length": "372", "date": "Sat, 01 Mar 2025 01:15:23 GMT"} })
3812025-03-01T01:15:23.815ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
3822025-03-01T01:15:23.815ZDEBGnexus (BackgroundTasks): client response SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "c0d3fb41-8f81-4d6f-8842-6eec8f70e5c4", "content-length": "691", "date": "Sat, 01 Mar 2025 01:15:23 GMT"} })
3832025-03-01T01:15:23.815ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
3842025-03-01T01:15:23.815ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
3852025-03-01T01:15:23.815ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
3862025-03-01T01:15:23.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3872025-03-01T01:15:23.817ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2368 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 46461e0a-aec3-48cd-9e8a-4c87361eef24 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
3882025-03-01T01:15:23.817ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 602.683277ms iteration = 2 status = {}
3892025-03-01T01:15:23.842ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
3902025-03-01T01:15:23.842ZDEBGnexus (BackgroundTasks): client request SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
3912025-03-01T01:15:23.844ZDEBGnexus (BackgroundTasks): client response SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "ba2a5aaf-be94-46df-ac6e-416654d4b3b5", "date": "Sat, 01 Mar 2025 01:15:23 GMT"} })
3922025-03-01T01:15:23.844ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
3932025-03-01T01:15:23.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3942025-03-01T01:15:23.847ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
3952025-03-01T01:15:23.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3962025-03-01T01:15:23.851ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
3972025-03-01T01:15:23.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3982025-03-01T01:15:23.854ZINFOnexus (BackgroundTasks): VPC route manager sled 3471264f-127e-4a25-bc10-2e8249e8d70a push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
3992025-03-01T01:15:23.854ZDEBGnexus (BackgroundTasks): client request SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
4002025-03-01T01:15:23.863ZDEBGnexus (BackgroundTasks): client response SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "e8badff0-b62f-403d-a7e0-cf3a5e07ad3e", "date": "Sat, 01 Mar 2025 01:15:23 GMT"} })
4012025-03-01T01:15:23.865ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 650.822908ms iteration = 2 status = {}
4022025-03-01T01:15:23.936ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
4032025-03-01T01:15:23.936ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
4042025-03-01T01:15:23.939ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
4052025-03-01T01:15:23.939ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
4062025-03-01T01:15:24.069ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
4072025-03-01T01:15:24.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
4082025-03-01T01:15:24.071ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
4092025-03-01T01:15:24.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
4102025-03-01T01:15:24.221ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
4112025-03-01T01:15:24.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
4122025-03-01T01:15:24.223ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 934, tv_nsec: 911500352 } })
4132025-03-01T01:15:24.224ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = service_zone_nat_tracker file = nexus/src/app/mod.rs:1154
4142025-03-01T01:15:24.253ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = service_zone_nat_tracker file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
4152025-03-01T01:15:24.253ZDEBGnexus (MgsClient): client request background_task = service_zone_nat_tracker body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
4162025-03-01T01:15:24.253ZDEBGnexus (MgsClient): client response background_task = service_zone_nat_tracker result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6489f201-a35f-4ad7-bd06-a5fe7afdf914", "content-length": "26", "date": "Sat, 01 Mar 2025 01:15:24 GMT"} })
4172025-03-01T01:15:24.253ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = service_zone_nat_tracker file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
4182025-03-01T01:15:24.254ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = service_zone_nat_tracker file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
4192025-03-01T01:15:24.283ZDEBGnexus (DpdClient): client request background_task = service_zone_nat_tracker body = None method = POST uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger
4202025-03-01T01:15:24.283ZDEBGnexus (DpdClient): client response background_task = service_zone_nat_tracker result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger", status: 200, headers: {"content-type": "application/json", "x-request-id": "52a1588f-f3ec-4f95-8a36-3d4de5166a71", "content-length": "4", "date": "Sat, 01 Mar 2025 01:15:24 GMT"} })
4212025-03-01T01:15:24.284ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 1.069778691s iteration = 2 status = 5
4222025-03-01T01:15:24.518ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
4232025-03-01T01:15:24.518ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "de6bed51-eb4d-453a-9216-85d1e4e7c222", "content-length": "134", "date": "Sat, 01 Mar 2025 01:15:24 GMT"} })
4242025-03-01T01:15:24.520ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
4252025-03-01T01:15:24.520ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = cb10d0c6-a704-4231-b148-4f9ae21a03f8
4262025-03-01T01:15:24.520ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
4272025-03-01T01:15:24.520ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
4282025-03-01T01:15:24.520ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
4292025-03-01T01:15:24.520ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
4302025-03-01T01:15:24.520ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
4312025-03-01T01:15:24.520ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
4322025-03-01T01:15:24.523ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
4332025-03-01T01:15:24.523ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
4342025-03-01T01:15:24.523ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66
4352025-03-01T01:15:24.523ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4362025-03-01T01:15:24.523ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4372025-03-01T01:15:24.525ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
4382025-03-01T01:15:24.526ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "28b57d1d-3505-40a8-b729-ffda2cc83a7b", "content-length": "2", "date": "Sat, 01 Mar 2025 01:15:24 GMT"} })
4392025-03-01T01:15:24.526ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
4402025-03-01T01:15:24.526ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "b6ecddc1-19b5-44dc-b997-eb7173fe2a35", "content-length": "52", "date": "Sat, 01 Mar 2025 01:15:24 GMT"} })
4412025-03-01T01:15:24.526ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 switch_location = Switch0
4422025-03-01T01:15:24.526ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
4432025-03-01T01:15:24.623ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "1e2e4e70-f1de-49d3-9d96-d8fac4a43693", "date": "Sat, 01 Mar 2025 01:15:23 GMT"} })
4442025-03-01T01:15:24.623ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 switch = Switch0
4452025-03-01T01:15:24.623ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
4462025-03-01T01:15:24.624ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "9fcee01a-173f-46d3-84c9-4adc1855793a", "content-length": "682", "date": "Sat, 01 Mar 2025 01:15:23 GMT"} })
4472025-03-01T01:15:24.626ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4482025-03-01T01:15:24.626ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4492025-03-01T01:15:24.630ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4502025-03-01T01:15:24.630ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4512025-03-01T01:15:24.634ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4522025-03-01T01:15:24.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4532025-03-01T01:15:24.636ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4542025-03-01T01:15:24.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4552025-03-01T01:15:24.649ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 1.434786737s iteration = 2 status = {}
4562025-03-01T01:15:24.865ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 6f483277-f464-4945-97cb-22517cc0c661 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
4572025-03-01T01:15:24.866ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 6f483277-f464-4945-97cb-22517cc0c661 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
4582025-03-01T01:15:24.867ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1995 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 6f483277-f464-4945-97cb-22517cc0c661 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
4592025-03-01T01:15:25.888ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = d14db65d-844c-4d93-8053-c64e6d5a3ab5 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
4602025-03-01T01:15:25.889ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = d14db65d-844c-4d93-8053-c64e6d5a3ab5 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
4612025-03-01T01:15:25.890ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1741 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = d14db65d-844c-4d93-8053-c64e6d5a3ab5 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
4622025-03-01T01:15:26.911ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 429a4fba-18b6-4c50-b046-20ba19b87891 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
4632025-03-01T01:15:26.911ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 429a4fba-18b6-4c50-b046-20ba19b87891 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
4642025-03-01T01:15:26.913ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1990 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 429a4fba-18b6-4c50-b046-20ba19b87891 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
4652025-03-01T01:15:27.932ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = dce8888e-9681-40ea-9543-77627a8a7968 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
4662025-03-01T01:15:27.933ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = dce8888e-9681-40ea-9543-77627a8a7968 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
4672025-03-01T01:15:27.934ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2004 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = dce8888e-9681-40ea-9543-77627a8a7968 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
4682025-03-01T01:15:28.953ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 190ba97c-7d7a-4912-b019-673c78f9947d roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
4692025-03-01T01:15:28.954ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 190ba97c-7d7a-4912-b019-673c78f9947d resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
4702025-03-01T01:15:28.955ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1691 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 190ba97c-7d7a-4912-b019-673c78f9947d response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
4712025-03-01T01:15:29.976ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = eaa013d5-b099-4c46-97a8-b66464819144 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
4722025-03-01T01:15:29.976ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = eaa013d5-b099-4c46-97a8-b66464819144 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
4732025-03-01T01:15:29.978ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2206 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = eaa013d5-b099-4c46-97a8-b66464819144 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
4742025-03-01T01:15:30.999ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 728e03bb-603f-419c-a47e-18fce66b1ab8 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
4752025-03-01T01:15:30.999ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 728e03bb-603f-419c-a47e-18fce66b1ab8 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
4762025-03-01T01:15:31.001ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2261 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 728e03bb-603f-419c-a47e-18fce66b1ab8 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
4772025-03-01T01:15:32.020ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 7bec37b6-5d47-401c-9278-a8b2ab265686 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
4782025-03-01T01:15:32.021ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 7bec37b6-5d47-401c-9278-a8b2ab265686 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
4792025-03-01T01:15:32.022ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1982 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 7bec37b6-5d47-401c-9278-a8b2ab265686 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
4802025-03-01T01:15:33.042ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = f62fac7f-689c-4880-885f-a55a6edf9ed8 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
4812025-03-01T01:15:33.042ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = f62fac7f-689c-4880-885f-a55a6edf9ed8 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
4822025-03-01T01:15:33.044ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2157 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = f62fac7f-689c-4880-885f-a55a6edf9ed8 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
4832025-03-01T01:15:33.214ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 5 reason = Timeout
4842025-03-01T01:15:33.214ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 5 reason = Timeout
4852025-03-01T01:15:33.214ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4862025-03-01T01:15:33.214ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
4872025-03-01T01:15:33.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
4882025-03-01T01:15:33.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4892025-03-01T01:15:33.216ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4902025-03-01T01:15:33.218ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
4912025-03-01T01:15:33.219ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4922025-03-01T01:15:33.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4932025-03-01T01:15:33.221ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4942025-03-01T01:15:33.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4952025-03-01T01:15:33.223ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4962025-03-01T01:15:33.225ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7, lookup_type: ById(8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7) } result = Ok(())
4972025-03-01T01:15:33.225ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4982025-03-01T01:15:33.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4992025-03-01T01:15:33.242ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
5002025-03-01T01:15:33.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5012025-03-01T01:15:33.269ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 55.540732ms iteration = 5 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
5022025-03-01T01:15:33.281ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 original_time_created = 2025-03-01 01:14:50.436545 UTC target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 time_created = 2025-03-01 01:14:50.436545 UTC
5032025-03-01T01:15:33.281ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 67.713689ms iteration = 5 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7","time_created":"2025-03-01T01:14:50.436545Z"}
5042025-03-01T01:15:34.062ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c9699ef9-2a1b-483e-a98f-24b69935a42a roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
5052025-03-01T01:15:34.062ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c9699ef9-2a1b-483e-a98f-24b69935a42a resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
5062025-03-01T01:15:34.064ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2282 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c9699ef9-2a1b-483e-a98f-24b69935a42a response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
5072025-03-01T01:15:35.084ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 3c31fe57-a126-47f8-bb19-711ce5fc4843 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
5082025-03-01T01:15:35.084ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 3c31fe57-a126-47f8-bb19-711ce5fc4843 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
5092025-03-01T01:15:35.086ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2141 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 3c31fe57-a126-47f8-bb19-711ce5fc4843 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
5102025-03-01T01:15:36.105ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = ba0ccfe9-1ff6-4c12-bb7b-1f2cf82527a7 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
5112025-03-01T01:15:36.105ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = ba0ccfe9-1ff6-4c12-bb7b-1f2cf82527a7 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
5122025-03-01T01:15:36.107ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2309 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = ba0ccfe9-1ff6-4c12-bb7b-1f2cf82527a7 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
5132025-03-01T01:15:37.127ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 29fca0b6-3f99-4146-bd95-63595ce2af14 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
5142025-03-01T01:15:37.127ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 29fca0b6-3f99-4146-bd95-63595ce2af14 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
5152025-03-01T01:15:37.129ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2261 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 29fca0b6-3f99-4146-bd95-63595ce2af14 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
5162025-03-01T01:15:38.148ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 6def7d0d-1642-4d1e-abd5-a0cb9aceecdd roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
5172025-03-01T01:15:38.149ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 6def7d0d-1642-4d1e-abd5-a0cb9aceecdd resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
5182025-03-01T01:15:38.150ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1981 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 6def7d0d-1642-4d1e-abd5-a0cb9aceecdd response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
5192025-03-01T01:15:39.169ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 17281f4e-8e59-4e14-b2eb-9ea7af5f3f3b roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
5202025-03-01T01:15:39.170ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 17281f4e-8e59-4e14-b2eb-9ea7af5f3f3b resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
5212025-03-01T01:15:39.171ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2030 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 17281f4e-8e59-4e14-b2eb-9ea7af5f3f3b response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
5222025-03-01T01:15:40.191ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = f25a9ddc-cadc-42db-907c-8da6c11dab3a roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
5232025-03-01T01:15:40.191ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = f25a9ddc-cadc-42db-907c-8da6c11dab3a resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
5242025-03-01T01:15:40.193ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2199 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = f25a9ddc-cadc-42db-907c-8da6c11dab3a response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
5252025-03-01T01:15:41.212ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = e06a7b83-d1af-40fb-9931-95420a3f0473 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
5262025-03-01T01:15:41.212ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = e06a7b83-d1af-40fb-9931-95420a3f0473 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
5272025-03-01T01:15:41.215ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2591 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = e06a7b83-d1af-40fb-9931-95420a3f0473 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
5282025-03-01T01:15:42.234ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 440b8a23-1065-4351-9b57-b16df1a189dc roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
5292025-03-01T01:15:42.234ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 440b8a23-1065-4351-9b57-b16df1a189dc resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
5302025-03-01T01:15:42.236ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2353 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 440b8a23-1065-4351-9b57-b16df1a189dc response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
5312025-03-01T01:15:43.214ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 6 reason = Timeout
5322025-03-01T01:15:43.214ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 6 reason = Timeout
5332025-03-01T01:15:43.214ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5342025-03-01T01:15:43.214ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
5352025-03-01T01:15:43.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5362025-03-01T01:15:43.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5372025-03-01T01:15:43.216ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5382025-03-01T01:15:43.216ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
5392025-03-01T01:15:43.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5402025-03-01T01:15:43.218ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.702815ms iteration = 6 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
5412025-03-01T01:15:43.218ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
5422025-03-01T01:15:43.218ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5432025-03-01T01:15:43.218ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5442025-03-01T01:15:43.220ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5452025-03-01T01:15:43.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5462025-03-01T01:15:43.221ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5472025-03-01T01:15:43.224ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7, lookup_type: ById(8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7) } result = Ok(())
5482025-03-01T01:15:43.224ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5492025-03-01T01:15:43.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5502025-03-01T01:15:43.231ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 original_time_created = 2025-03-01 01:14:50.436545 UTC target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 time_created = 2025-03-01 01:14:50.436545 UTC
5512025-03-01T01:15:43.231ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 16.572577ms iteration = 6 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7","time_created":"2025-03-01T01:14:50.436545Z"}
5522025-03-01T01:15:43.255ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = d78e7c27-7930-4d20-8725-b231d8bb5fdd roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
5532025-03-01T01:15:43.255ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = d78e7c27-7930-4d20-8725-b231d8bb5fdd resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
5542025-03-01T01:15:43.256ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1525 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = d78e7c27-7930-4d20-8725-b231d8bb5fdd response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
5552025-03-01T01:15:44.276ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 1add95f0-b090-4fad-9b6c-61af038586a9 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
5562025-03-01T01:15:44.276ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 1add95f0-b090-4fad-9b6c-61af038586a9 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
5572025-03-01T01:15:44.278ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2293 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 1add95f0-b090-4fad-9b6c-61af038586a9 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
5582025-03-01T01:15:45.298ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 14346cad-5603-4589-99bf-67c3e5457f00 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
5592025-03-01T01:15:45.298ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 14346cad-5603-4589-99bf-67c3e5457f00 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
5602025-03-01T01:15:45.300ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2498 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 14346cad-5603-4589-99bf-67c3e5457f00 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
5612025-03-01T01:15:46.320ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 42a24bf9-0f11-4a4b-a0b6-c454c53741bb roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
5622025-03-01T01:15:46.321ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 42a24bf9-0f11-4a4b-a0b6-c454c53741bb resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
5632025-03-01T01:15:46.323ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2778 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 42a24bf9-0f11-4a4b-a0b6-c454c53741bb response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
5642025-03-01T01:15:47.341ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 37268337-5361-464a-b89f-af804619ff87 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
5652025-03-01T01:15:47.342ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 37268337-5361-464a-b89f-af804619ff87 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
5662025-03-01T01:15:47.343ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1802 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 37268337-5361-464a-b89f-af804619ff87 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
5672025-03-01T01:15:48.362ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = be7b187c-1d0a-401e-8f29-d1b4d99d2446 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
5682025-03-01T01:15:48.362ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = be7b187c-1d0a-401e-8f29-d1b4d99d2446 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
5692025-03-01T01:15:48.364ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2231 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = be7b187c-1d0a-401e-8f29-d1b4d99d2446 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
5702025-03-01T01:15:49.384ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 25083de8-a3fd-4035-b51f-92e6422aac23 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
5712025-03-01T01:15:49.385ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 25083de8-a3fd-4035-b51f-92e6422aac23 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
5722025-03-01T01:15:49.387ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2298 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 25083de8-a3fd-4035-b51f-92e6422aac23 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
5732025-03-01T01:15:50.405ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 40c4659b-2965-4536-a69e-4cd97ad5a2d6 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
5742025-03-01T01:15:50.405ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 40c4659b-2965-4536-a69e-4cd97ad5a2d6 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
5752025-03-01T01:15:50.407ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2121 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 40c4659b-2965-4536-a69e-4cd97ad5a2d6 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
5762025-03-01T01:15:51.426ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 14eb5096-33b2-46ae-baa0-587a68deb3c3 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
5772025-03-01T01:15:51.427ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 14eb5096-33b2-46ae-baa0-587a68deb3c3 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
5782025-03-01T01:15:51.429ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2162 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 14eb5096-33b2-46ae-baa0-587a68deb3c3 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
5792025-03-01T01:15:52.451ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 52ea3bc4-fd9a-447a-ab20-b3ff212520f2 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
5802025-03-01T01:15:52.452ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 52ea3bc4-fd9a-447a-ab20-b3ff212520f2 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
5812025-03-01T01:15:52.453ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1714 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 52ea3bc4-fd9a-447a-ab20-b3ff212520f2 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
5822025-03-01T01:15:53.214ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 3 reason = Timeout
5832025-03-01T01:15:53.214ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
5842025-03-01T01:15:53.214ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 7 reason = Timeout
5852025-03-01T01:15:53.214ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 3 reason = Timeout
5862025-03-01T01:15:53.214ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:69 reason = no config
5872025-03-01T01:15:53.214ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 3 reason = Timeout
5882025-03-01T01:15:53.214ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 12.921\u{b5}s iteration = 3 status = {"error":"no config"}
5892025-03-01T01:15:53.214ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5902025-03-01T01:15:53.214ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 3 reason = Timeout
5912025-03-01T01:15:53.214ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 2 reason = Timeout
5922025-03-01T01:15:53.214ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
5932025-03-01T01:15:53.214ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
5942025-03-01T01:15:53.214ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 2 reason = Timeout
5952025-03-01T01:15:53.214ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 2 reason = Timeout
5962025-03-01T01:15:53.214ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
5972025-03-01T01:15:53.214ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
5982025-03-01T01:15:53.214ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 2 reason = Timeout
5992025-03-01T01:15:53.214ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-03-01 01:05:53.214817322 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
6002025-03-01T01:15:53.214ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 3 reason = Timeout
6012025-03-01T01:15:53.214ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:69 reason = no config
6022025-03-01T01:15:53.214ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 11.131\u{b5}s iteration = 3 status = {"error":"no config"}
6032025-03-01T01:15:53.214ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
6042025-03-01T01:15:53.214ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 3 reason = Timeout
6052025-03-01T01:15:53.215ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
6062025-03-01T01:15:53.215ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 3 reason = Timeout
6072025-03-01T01:15:53.215ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
6082025-03-01T01:15:53.215ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 3 reason = Timeout
6092025-03-01T01:15:53.215ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
6102025-03-01T01:15:53.215ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
6112025-03-01T01:15:53.215ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 3 reason = Timeout
6122025-03-01T01:15:53.215ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
6132025-03-01T01:15:53.215ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 2 reason = Timeout
6142025-03-01T01:15:53.215ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
6152025-03-01T01:15:53.215ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
6162025-03-01T01:15:53.215ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 3 reason = Timeout
6172025-03-01T01:15:53.215ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 2 reason = Timeout
6182025-03-01T01:15:53.215ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
6192025-03-01T01:15:53.215ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
6202025-03-01T01:15:53.215ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
6212025-03-01T01:15:53.215ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 3 reason = Timeout
6222025-03-01T01:15:53.215ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
6232025-03-01T01:15:53.215ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 3 reason = Timeout
6242025-03-01T01:15:53.215ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
6252025-03-01T01:15:53.215ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 3 reason = Timeout
6262025-03-01T01:15:53.215ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 3 reason = Timeout
6272025-03-01T01:15:53.215ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
6282025-03-01T01:15:53.215ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7
6292025-03-01T01:15:53.215ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 3 reason = Timeout
6302025-03-01T01:15:53.215ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 15.491\u{b5}s iteration = 3 status = {"enabled":false,"target_id":"8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7"}
6312025-03-01T01:15:53.215ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
6322025-03-01T01:15:53.215ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 3 reason = Timeout
6332025-03-01T01:15:53.215ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 2 reason = Timeout
6342025-03-01T01:15:53.215ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
6352025-03-01T01:15:53.215ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 7 reason = Timeout
6362025-03-01T01:15:53.215ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
6372025-03-01T01:15:53.215ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 3 reason = Timeout
6382025-03-01T01:15:53.215ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
6392025-03-01T01:15:53.215ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 4 reason = Timeout
6402025-03-01T01:15:53.215ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
6412025-03-01T01:15:53.215ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 2 reason = Timeout
6422025-03-01T01:15:53.215ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
6432025-03-01T01:15:53.215ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
6442025-03-01T01:15:53.215ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 2 reason = Timeout
6452025-03-01T01:15:53.215ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 3 reason = Timeout
6462025-03-01T01:15:53.215ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
6472025-03-01T01:15:53.215ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
6482025-03-01T01:15:53.215ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 2 reason = Timeout
6492025-03-01T01:15:53.215ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
6502025-03-01T01:15:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6512025-03-01T01:15:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
6522025-03-01T01:15:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
6532025-03-01T01:15:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
6542025-03-01T01:15:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
6552025-03-01T01:15:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
6562025-03-01T01:15:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
6572025-03-01T01:15:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
6582025-03-01T01:15:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
6592025-03-01T01:15:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
6602025-03-01T01:15:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
6612025-03-01T01:15:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
6622025-03-01T01:15:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
6632025-03-01T01:15:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
6642025-03-01T01:15:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
6652025-03-01T01:15:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
6662025-03-01T01:15:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
6672025-03-01T01:15:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
6682025-03-01T01:15:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
6692025-03-01T01:15:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
6702025-03-01T01:15:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
6712025-03-01T01:15:53.215ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2e37f4af-57dc-468e-80e3-cf2aea2ffdc8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5f6eb3bd-0126-40e0-98ef-ee33df084158.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("5f6eb3bd-0126-40e0-98ef-ee33df084158.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 963, tv_nsec: 903247164 } })
6722025-03-01T01:15:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
6732025-03-01T01:15:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
6742025-03-01T01:15:53.215ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("3a9b8294-d9f3-4130-a669-e74c6f1f65a0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("450e8d93-9ed3-4721-9fe9-42521f60bc93.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a4f72c78-99c6-478d-b490-f7d8793d4173.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("a4f72c78-99c6-478d-b490-f7d8793d4173.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 963, tv_nsec: 903259994 } })
6752025-03-01T01:15:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
6762025-03-01T01:15:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
6772025-03-01T01:15:53.216ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
6782025-03-01T01:15:53.216ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.131073ms iteration = 2 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
6792025-03-01T01:15:53.216ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
6802025-03-01T01:15:53.216ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.381948ms iteration = 2 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
6812025-03-01T01:15:53.216ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
6822025-03-01T01:15:53.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
6832025-03-01T01:15:53.217ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6842025-03-01T01:15:53.218ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.387429ms iteration = 3 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
6852025-03-01T01:15:53.219ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 4.349808ms iteration = 2 status = {"errors":[],"found_port_ok":[]}
6862025-03-01T01:15:53.219ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
6872025-03-01T01:15:53.219ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6882025-03-01T01:15:53.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6892025-03-01T01:15:53.222ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6902025-03-01T01:15:53.224ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-03-01 01:05:53.214817322 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
6912025-03-01T01:15:53.224ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 9.368801ms iteration = 2 status = {"expiration":"2025-03-01T01:05:53.214817322Z","pruned":[]}
6922025-03-01T01:15:53.224ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
6932025-03-01T01:15:53.224ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
6942025-03-01T01:15:53.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
6952025-03-01T01:15:53.224ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
6962025-03-01T01:15:53.224ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
6972025-03-01T01:15:53.225ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 10.106506ms iteration = 2 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
6982025-03-01T01:15:53.225ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
6992025-03-01T01:15:53.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
7002025-03-01T01:15:53.227ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
7012025-03-01T01:15:53.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
7022025-03-01T01:15:53.227ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7032025-03-01T01:15:53.229ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
7042025-03-01T01:15:53.229ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
7052025-03-01T01:15:53.229ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
7062025-03-01T01:15:53.230ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 963, tv_nsec: 917918342 } })
7072025-03-01T01:15:53.230ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1154
7082025-03-01T01:15:53.240ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7092025-03-01T01:15:53.240ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7102025-03-01T01:15:53.240ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7112025-03-01T01:15:53.240ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 963, tv_nsec: 928589180 } })
7122025-03-01T01:15:53.241ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7132025-03-01T01:15:53.241ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1154
7142025-03-01T01:15:53.241ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7152025-03-01T01:15:53.241ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
7162025-03-01T01:15:53.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
7172025-03-01T01:15:53.243ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
7182025-03-01T01:15:53.243ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
7192025-03-01T01:15:53.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
7202025-03-01T01:15:53.244ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
7212025-03-01T01:15:53.244ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7222025-03-01T01:15:53.245ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
7232025-03-01T01:15:53.245ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
7242025-03-01T01:15:53.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7252025-03-01T01:15:53.245ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
7262025-03-01T01:15:53.245ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
7272025-03-01T01:15:53.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
7282025-03-01T01:15:53.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
7292025-03-01T01:15:53.246ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
7302025-03-01T01:15:53.249ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7312025-03-01T01:15:53.250ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 35.712378ms iteration = 7 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
7322025-03-01T01:15:53.251ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
7332025-03-01T01:15:53.251ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
7342025-03-01T01:15:53.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
7352025-03-01T01:15:53.258ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
7362025-03-01T01:15:53.258ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
7372025-03-01T01:15:53.258ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
7382025-03-01T01:15:53.259ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7392025-03-01T01:15:53.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
7402025-03-01T01:15:53.263ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
7412025-03-01T01:15:53.263ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
7422025-03-01T01:15:53.263ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
7432025-03-01T01:15:53.264ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
7442025-03-01T01:15:53.264ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
7452025-03-01T01:15:53.265ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
7462025-03-01T01:15:53.265ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 50.56743ms iteration = 3 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
7472025-03-01T01:15:53.265ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
7482025-03-01T01:15:53.265ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
7492025-03-01T01:15:53.265ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
7502025-03-01T01:15:53.265ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
7512025-03-01T01:15:53.266ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7522025-03-01T01:15:53.269ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
7532025-03-01T01:15:53.269ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
7542025-03-01T01:15:53.269ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
7552025-03-01T01:15:53.270ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
7562025-03-01T01:15:53.271ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
7572025-03-01T01:15:53.281ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7582025-03-01T01:15:53.282ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 67.628238ms iteration = 3 status = {"errors":[],"garbage_collect_requested":[]}
7592025-03-01T01:15:53.282ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
7602025-03-01T01:15:53.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
7612025-03-01T01:15:53.284ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
7622025-03-01T01:15:53.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
7632025-03-01T01:15:53.285ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
7642025-03-01T01:15:53.285ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
7652025-03-01T01:15:53.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
7662025-03-01T01:15:53.287ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 72.060778ms iteration = 3 status = {"errors":[],"finish_invoked_ok":[]}
7672025-03-01T01:15:53.287ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 72.509017ms iteration = 3 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
7682025-03-01T01:15:53.287ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 72.831344ms iteration = 3 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
7692025-03-01T01:15:53.288ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
7702025-03-01T01:15:53.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
7712025-03-01T01:15:53.291ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
7722025-03-01T01:15:53.291ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
7732025-03-01T01:15:53.291ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
7742025-03-01T01:15:53.291ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
7752025-03-01T01:15:53.292ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
7762025-03-01T01:15:53.293ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7772025-03-01T01:15:53.295ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7782025-03-01T01:15:53.296ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7792025-03-01T01:15:53.298ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
7802025-03-01T01:15:53.298ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
7812025-03-01T01:15:53.298ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
7822025-03-01T01:15:53.298ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
7832025-03-01T01:15:53.298ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
7842025-03-01T01:15:53.298ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
7852025-03-01T01:15:53.299ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
7862025-03-01T01:15:53.299ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
7872025-03-01T01:15:53.299ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
7882025-03-01T01:15:53.303ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
7892025-03-01T01:15:53.303ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 963, tv_nsec: 990703195 } })
7902025-03-01T01:15:53.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
7912025-03-01T01:15:53.303ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1154 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66
7922025-03-01T01:15:53.305ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7932025-03-01T01:15:53.307ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
7942025-03-01T01:15:53.307ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
7952025-03-01T01:15:53.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
7962025-03-01T01:15:53.312ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7972025-03-01T01:15:53.314ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7, lookup_type: ById(8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7) } result = Ok(())
7982025-03-01T01:15:53.314ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
7992025-03-01T01:15:53.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8002025-03-01T01:15:53.315ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
8012025-03-01T01:15:53.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
8022025-03-01T01:15:53.317ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
8032025-03-01T01:15:53.317ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
8042025-03-01T01:15:53.317ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 102.173971ms iteration = 3 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
8052025-03-01T01:15:53.317ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
8062025-03-01T01:15:53.318ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
8072025-03-01T01:15:53.321ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8082025-03-01T01:15:53.323ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
8092025-03-01T01:15:53.323ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
8102025-03-01T01:15:53.323ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
8112025-03-01T01:15:53.327ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
8122025-03-01T01:15:53.327ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
8132025-03-01T01:15:53.328ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 original_time_created = 2025-03-01 01:14:50.436545 UTC target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 time_created = 2025-03-01 01:14:50.436545 UTC
8142025-03-01T01:15:53.328ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 113.491572ms iteration = 7 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7","time_created":"2025-03-01T01:14:50.436545Z"}
8152025-03-01T01:15:53.330ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
8162025-03-01T01:15:53.330ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 115.397091ms iteration = 2 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
8172025-03-01T01:15:53.336ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
8182025-03-01T01:15:53.336ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 121.672279ms iteration = 3 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
8192025-03-01T01:15:53.336ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
8202025-03-01T01:15:53.336ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = cce65e3e-6c86-4cdd-98ad-9a38c98082e8 dns_zone_name = oxide.test found_so_far = 0 version = 2
8212025-03-01T01:15:53.337ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
8222025-03-01T01:15:53.337ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
8232025-03-01T01:15:53.338ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8242025-03-01T01:15:53.339ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 124.233861ms iteration = 4 status = {"physical_disks_added":0}
8252025-03-01T01:15:53.341ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
8262025-03-01T01:15:53.341ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
8272025-03-01T01:15:53.341ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
8282025-03-01T01:15:53.345ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
8292025-03-01T01:15:53.345ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
8302025-03-01T01:15:53.345ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 130.135341ms iteration = 2 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
8312025-03-01T01:15:53.353ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 138.93209ms iteration = 3 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
8322025-03-01T01:15:53.355ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
8332025-03-01T01:15:53.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
8342025-03-01T01:15:53.396ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
8352025-03-01T01:15:53.396ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
8362025-03-01T01:15:53.397ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "21792783-e55d-4802-8280-71a5878f9876", "content-length": "26", "date": "Sat, 01 Mar 2025 01:15:53 GMT"} })
8372025-03-01T01:15:53.397ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
8382025-03-01T01:15:53.399ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
8392025-03-01T01:15:53.401ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
8402025-03-01T01:15:53.401ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
8412025-03-01T01:15:53.402ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a786c6fb-5298-4b2d-b791-22f37d310925", "content-length": "26", "date": "Sat, 01 Mar 2025 01:15:53 GMT"} })
8422025-03-01T01:15:53.402ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
8432025-03-01T01:15:53.405ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
8442025-03-01T01:15:53.405ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
8452025-03-01T01:15:53.405ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
8462025-03-01T01:15:53.405ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
8472025-03-01T01:15:53.405ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
8482025-03-01T01:15:53.406ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
8492025-03-01T01:15:53.425ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1162 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 zone_address = fd00:1122:3344:101::2
8502025-03-01T01:15:53.426ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
8512025-03-01T01:15:53.426ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f8631ef9-fe22-4e61-a30a-7be4e71184aa", "content-length": "26", "date": "Sat, 01 Mar 2025 01:15:53 GMT"} })
8522025-03-01T01:15:53.426ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1167 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
8532025-03-01T01:15:53.428ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66
8542025-03-01T01:15:53.438ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (initial) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-03-01T01:14:49.537343Z, time_modified: 2025-03-01T01:14:49.537343Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 1682a303-6254-452b-b4cf-160ed9dc3fc9, db_silo: Silo { identity: SiloIdentity { id: 1682a303-6254-452b-b4cf-160ed9dc3fc9, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-03-01T01:14:54.631650Z, time_modified: 2025-03-01T01:14:54.631650Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "851c0b739689cfb98a2e401e6047fa98e9fcc283d9fc3f660bd69842a9c06be9" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 1682a303-6254-452b-b4cf-160ed9dc3fc9, db_silo: Silo { identity: SiloIdentity { id: 1682a303-6254-452b-b4cf-160ed9dc3fc9, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-03-01T01:14:54.631650Z, time_modified: 2025-03-01T01:14:54.631650Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "851c0b739689cfb98a2e401e6047fa98e9fcc283d9fc3f660bd69842a9c06be9" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:77
8552025-03-01T01:15:53.438ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 223.016523ms iteration = 2 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"1682a303-6254-452b-b4cf-160ed9dc3fc9","tls_certs":["851c0b739689cfb98a2e401e6047fa98e9fcc283d9fc3f660bd69842a9c06be9"]}},"default_endpoint":{"silo_id":"1682a303-6254-452b-b4cf-160ed9dc3fc9","tls_certs":["851c0b739689cfb98a2e401e6047fa98e9fcc283d9fc3f660bd69842a9c06be9"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
8562025-03-01T01:15:53.463ZINFOnexus (BackgroundTasks): VPC route manager sled 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
8572025-03-01T01:15:53.463ZDEBGnexus (BackgroundTasks): client request SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
8582025-03-01T01:15:53.463ZDEBGnexus (BackgroundTasks): client response SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "53126579-f43f-41f7-8cd8-2e695b1f2a0f", "content-length": "372", "date": "Sat, 01 Mar 2025 01:15:53 GMT"} })
8592025-03-01T01:15:53.463ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8602025-03-01T01:15:53.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8612025-03-01T01:15:53.466ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8622025-03-01T01:15:53.472ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
8632025-03-01T01:15:53.472ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
8642025-03-01T01:15:53.473ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
8652025-03-01T01:15:53.473ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 9dc8a7f2-74b6-4a77-8a3a-217087c6b730 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
8662025-03-01T01:15:53.474ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 9dc8a7f2-74b6-4a77-8a3a-217087c6b730 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
8672025-03-01T01:15:53.475ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1840 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 9dc8a7f2-74b6-4a77-8a3a-217087c6b730 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
8682025-03-01T01:15:53.478ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = cce65e3e-6c86-4cdd-98ad-9a38c98082e8 dns_zone_name = oxide.test found_so_far = 1 version = 2
8692025-03-01T01:15:53.478ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
8702025-03-01T01:15:53.478ZINFOnexus (BackgroundTasks): found latest generation (first find) background_task = dns_config_external dns_group = external file = nexus/src/app/background/tasks/dns_config.rs:87 generation = 2
8712025-03-01T01:15:53.478ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 263.777244ms iteration = 2 status = {"generation":2}
8722025-03-01T01:15:53.478ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 4 reason = Dependency
8732025-03-01T01:15:53.487ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = / versions = all
8742025-03-01T01:15:53.487ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /access versions = all
8752025-03-01T01:15:53.487ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /assets/{path} versions = all
8762025-03-01T01:15:53.487ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /device/auth versions = all
8772025-03-01T01:15:53.487ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /device/confirm versions = all
8782025-03-01T01:15:53.487ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /device/success versions = all
8792025-03-01T01:15:53.487ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /device/token versions = all
8802025-03-01T01:15:53.487ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /device/verify versions = all
8812025-03-01T01:15:53.487ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /experimental/v1/probes versions = all
8822025-03-01T01:15:53.487ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /experimental/v1/probes versions = all
8832025-03-01T01:15:53.487ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /experimental/v1/probes/{probe} versions = all
8842025-03-01T01:15:53.487ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /experimental/v1/probes/{probe} versions = all
8852025-03-01T01:15:53.487ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /experimental/v1/system/support-bundles versions = all
8862025-03-01T01:15:53.487ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /experimental/v1/system/support-bundles versions = all
8872025-03-01T01:15:53.487ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /experimental/v1/system/support-bundles/{support_bundle} versions = all
8882025-03-01T01:15:53.487ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /experimental/v1/system/support-bundles/{support_bundle} versions = all
8892025-03-01T01:15:53.487ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /experimental/v1/system/support-bundles/{support_bundle}/download versions = all
8902025-03-01T01:15:53.487ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = HEAD path = /experimental/v1/system/support-bundles/{support_bundle}/download versions = all
8912025-03-01T01:15:53.487ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /experimental/v1/system/support-bundles/{support_bundle}/download/{file} versions = all
8922025-03-01T01:15:53.487ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = HEAD path = /experimental/v1/system/support-bundles/{support_bundle}/download/{file} versions = all
8932025-03-01T01:15:53.487ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /experimental/v1/system/support-bundles/{support_bundle}/index versions = all
8942025-03-01T01:15:53.487ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /images versions = all
8952025-03-01T01:15:53.487ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /login versions = all
8962025-03-01T01:15:53.487ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /login/{silo_name}/local versions = all
8972025-03-01T01:15:53.487ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /login/{silo_name}/saml/{provider_name} versions = all
8982025-03-01T01:15:53.487ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /login/{silo_name}/saml/{provider_name} versions = all
8992025-03-01T01:15:53.487ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /login/{silo_name}/saml/{provider_name}/redirect versions = all
9002025-03-01T01:15:53.487ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /lookup/{path} versions = all
9012025-03-01T01:15:53.487ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /projects/{path} versions = all
9022025-03-01T01:15:53.487ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /projects-new versions = all
9032025-03-01T01:15:53.487ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /settings/{path} versions = all
9042025-03-01T01:15:53.487ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /system/{path} versions = all
9052025-03-01T01:15:53.487ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /utilization versions = all
9062025-03-01T01:15:53.487ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/certificates versions = all
9072025-03-01T01:15:53.487ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/certificates versions = all
9082025-03-01T01:15:53.487ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/certificates/{certificate} versions = all
9092025-03-01T01:15:53.487ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/certificates/{certificate} versions = all
9102025-03-01T01:15:53.487ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/disks versions = all
9112025-03-01T01:15:53.487ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/disks versions = all
9122025-03-01T01:15:53.487ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/disks/{disk} versions = all
9132025-03-01T01:15:53.487ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/disks/{disk} versions = all
9142025-03-01T01:15:53.487ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/disks/{disk}/bulk-write versions = all
9152025-03-01T01:15:53.487ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/disks/{disk}/bulk-write-start versions = all
9162025-03-01T01:15:53.487ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/disks/{disk}/bulk-write-stop versions = all
9172025-03-01T01:15:53.487ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/disks/{disk}/finalize versions = all
9182025-03-01T01:15:53.487ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/disks/{disk}/metrics/{metric} versions = all
9192025-03-01T01:15:53.487ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/floating-ips versions = all
9202025-03-01T01:15:53.487ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/floating-ips versions = all
9212025-03-01T01:15:53.487ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/floating-ips/{floating_ip} versions = all
9222025-03-01T01:15:53.487ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/floating-ips/{floating_ip} versions = all
9232025-03-01T01:15:53.487ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/floating-ips/{floating_ip} versions = all
9242025-03-01T01:15:53.487ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/floating-ips/{floating_ip}/attach versions = all
9252025-03-01T01:15:53.487ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/floating-ips/{floating_ip}/detach versions = all
9262025-03-01T01:15:53.487ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/groups versions = all
9272025-03-01T01:15:53.487ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/groups/{group_id} versions = all
9282025-03-01T01:15:53.487ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/images versions = all
9292025-03-01T01:15:53.487ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/images versions = all
9302025-03-01T01:15:53.487ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/images/{image} versions = all
9312025-03-01T01:15:53.487ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/images/{image} versions = all
9322025-03-01T01:15:53.487ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/images/{image}/demote versions = all
9332025-03-01T01:15:53.487ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/images/{image}/promote versions = all
9342025-03-01T01:15:53.487ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/instances versions = all
9352025-03-01T01:15:53.487ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/instances versions = all
9362025-03-01T01:15:53.487ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/instances/{instance} versions = all
9372025-03-01T01:15:53.487ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/instances/{instance} versions = all
9382025-03-01T01:15:53.487ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/instances/{instance} versions = all
9392025-03-01T01:15:53.487ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/instances/{instance}/disks versions = all
9402025-03-01T01:15:53.487ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/instances/{instance}/disks/attach versions = all
9412025-03-01T01:15:53.487ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/instances/{instance}/disks/detach versions = all
9422025-03-01T01:15:53.487ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/instances/{instance}/external-ips versions = all
9432025-03-01T01:15:53.487ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/instances/{instance}/external-ips/ephemeral versions = all
9442025-03-01T01:15:53.487ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/instances/{instance}/external-ips/ephemeral versions = all
9452025-03-01T01:15:53.487ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/instances/{instance}/reboot versions = all
9462025-03-01T01:15:53.487ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/instances/{instance}/serial-console versions = all
9472025-03-01T01:15:53.487ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/instances/{instance}/serial-console/stream versions = all
9482025-03-01T01:15:53.487ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/instances/{instance}/ssh-public-keys versions = all
9492025-03-01T01:15:53.487ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/instances/{instance}/start versions = all
9502025-03-01T01:15:53.487ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/instances/{instance}/stop versions = all
9512025-03-01T01:15:53.488ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/internet-gateway-ip-addresses versions = all
9522025-03-01T01:15:53.488ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/internet-gateway-ip-addresses versions = all
9532025-03-01T01:15:53.488ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/internet-gateway-ip-addresses/{address} versions = all
9542025-03-01T01:15:53.488ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/internet-gateway-ip-pools versions = all
9552025-03-01T01:15:53.488ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/internet-gateway-ip-pools versions = all
9562025-03-01T01:15:53.488ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/internet-gateway-ip-pools/{pool} versions = all
9572025-03-01T01:15:53.488ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/internet-gateways versions = all
9582025-03-01T01:15:53.488ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/internet-gateways versions = all
9592025-03-01T01:15:53.488ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/internet-gateways/{gateway} versions = all
9602025-03-01T01:15:53.488ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/internet-gateways/{gateway} versions = all
9612025-03-01T01:15:53.488ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/ip-pools versions = all
9622025-03-01T01:15:53.488ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/ip-pools/{pool} versions = all
9632025-03-01T01:15:53.488ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/login/{silo_name}/local versions = all
9642025-03-01T01:15:53.488ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/logout versions = all
9652025-03-01T01:15:53.488ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/me versions = all
9662025-03-01T01:15:53.488ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/me/groups versions = all
9672025-03-01T01:15:53.488ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/me/ssh-keys versions = all
9682025-03-01T01:15:53.488ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/me/ssh-keys versions = all
9692025-03-01T01:15:53.488ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/me/ssh-keys/{ssh_key} versions = all
9702025-03-01T01:15:53.488ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/me/ssh-keys/{ssh_key} versions = all
9712025-03-01T01:15:53.488ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/metrics/{metric_name} versions = all
9722025-03-01T01:15:53.488ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/network-interfaces versions = all
9732025-03-01T01:15:53.488ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/network-interfaces versions = all
9742025-03-01T01:15:53.488ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/network-interfaces/{interface} versions = all
9752025-03-01T01:15:53.488ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/network-interfaces/{interface} versions = all
9762025-03-01T01:15:53.488ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/network-interfaces/{interface} versions = all
9772025-03-01T01:15:53.488ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/ping versions = all
9782025-03-01T01:15:53.488ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/policy versions = all
9792025-03-01T01:15:53.488ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/policy versions = all
9802025-03-01T01:15:53.488ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/projects versions = all
9812025-03-01T01:15:53.488ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/projects versions = all
9822025-03-01T01:15:53.488ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/projects/{project} versions = all
9832025-03-01T01:15:53.488ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/projects/{project} versions = all
9842025-03-01T01:15:53.488ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/projects/{project} versions = all
9852025-03-01T01:15:53.488ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/projects/{project}/policy versions = all
9862025-03-01T01:15:53.488ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/projects/{project}/policy versions = all
9872025-03-01T01:15:53.488ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/snapshots versions = all
9882025-03-01T01:15:53.488ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/snapshots versions = all
9892025-03-01T01:15:53.488ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/snapshots/{snapshot} versions = all
9902025-03-01T01:15:53.488ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/snapshots/{snapshot} versions = all
9912025-03-01T01:15:53.488ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/disks versions = all
9922025-03-01T01:15:53.488ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/disks/{disk_id} versions = all
9932025-03-01T01:15:53.488ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/rack-switch-port/{rack_id}/{switch_location}/{port}/lldp/neighbors versions = all
9942025-03-01T01:15:53.488ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/racks versions = all
9952025-03-01T01:15:53.488ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/racks/{rack_id} versions = all
9962025-03-01T01:15:53.488ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/sleds versions = all
9972025-03-01T01:15:53.488ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/hardware/sleds versions = all
9982025-03-01T01:15:53.488ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/sleds/{sled_id} versions = all
9992025-03-01T01:15:53.488ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/sleds/{sled_id}/disks versions = all
10002025-03-01T01:15:53.488ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/sleds/{sled_id}/instances versions = all
10012025-03-01T01:15:53.488ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/hardware/sleds/{sled_id}/provision-policy versions = all
10022025-03-01T01:15:53.488ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/sleds-uninitialized versions = all
10032025-03-01T01:15:53.488ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/switch-port versions = all
10042025-03-01T01:15:53.488ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/switch-port/{port}/lldp/config versions = all
10052025-03-01T01:15:53.488ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/hardware/switch-port/{port}/lldp/config versions = all
10062025-03-01T01:15:53.488ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/hardware/switch-port/{port}/settings versions = all
10072025-03-01T01:15:53.488ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/hardware/switch-port/{port}/settings versions = all
10082025-03-01T01:15:53.488ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/switch-port/{port}/status versions = all
10092025-03-01T01:15:53.488ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/switches versions = all
10102025-03-01T01:15:53.488ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/switches/{switch_id} versions = all
10112025-03-01T01:15:53.488ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/identity-providers versions = all
10122025-03-01T01:15:53.488ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/identity-providers/local/users versions = all
10132025-03-01T01:15:53.488ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/identity-providers/local/users/{user_id} versions = all
10142025-03-01T01:15:53.488ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/identity-providers/local/users/{user_id}/set-password versions = all
10152025-03-01T01:15:53.488ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/identity-providers/saml versions = all
10162025-03-01T01:15:53.488ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/identity-providers/saml/{provider} versions = all
10172025-03-01T01:15:53.488ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/ip-pools versions = all
10182025-03-01T01:15:53.488ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/ip-pools versions = all
10192025-03-01T01:15:53.488ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/ip-pools/{pool} versions = all
10202025-03-01T01:15:53.488ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/ip-pools/{pool} versions = all
10212025-03-01T01:15:53.488ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/ip-pools/{pool} versions = all
10222025-03-01T01:15:53.488ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/ip-pools/{pool}/ranges versions = all
10232025-03-01T01:15:53.488ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/ip-pools/{pool}/ranges/add versions = all
10242025-03-01T01:15:53.488ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/ip-pools/{pool}/ranges/remove versions = all
10252025-03-01T01:15:53.488ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/ip-pools/{pool}/silos versions = all
10262025-03-01T01:15:53.488ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/ip-pools/{pool}/silos versions = all
10272025-03-01T01:15:53.488ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/ip-pools/{pool}/silos/{silo} versions = all
10282025-03-01T01:15:53.488ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/ip-pools/{pool}/silos/{silo} versions = all
10292025-03-01T01:15:53.488ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/ip-pools/{pool}/utilization versions = all
10302025-03-01T01:15:53.488ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/ip-pools-service versions = all
10312025-03-01T01:15:53.488ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/ip-pools-service/ranges versions = all
10322025-03-01T01:15:53.488ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/ip-pools-service/ranges/add versions = all
10332025-03-01T01:15:53.488ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/ip-pools-service/ranges/remove versions = all
10342025-03-01T01:15:53.488ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/metrics/{metric_name} versions = all
10352025-03-01T01:15:53.488ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/address-lot versions = all
10362025-03-01T01:15:53.488ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/networking/address-lot versions = all
10372025-03-01T01:15:53.488ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/networking/address-lot/{address_lot} versions = all
10382025-03-01T01:15:53.488ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/address-lot/{address_lot}/blocks versions = all
10392025-03-01T01:15:53.488ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/allow-list versions = all
10402025-03-01T01:15:53.488ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/networking/allow-list versions = all
10412025-03-01T01:15:53.488ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/networking/bfd-disable versions = all
10422025-03-01T01:15:53.488ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/networking/bfd-enable versions = all
10432025-03-01T01:15:53.488ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bfd-status versions = all
10442025-03-01T01:15:53.488ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/networking/bgp versions = all
10452025-03-01T01:15:53.488ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bgp versions = all
10462025-03-01T01:15:53.488ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/networking/bgp versions = all
10472025-03-01T01:15:53.488ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bgp-announce-set versions = all
10482025-03-01T01:15:53.488ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/networking/bgp-announce-set versions = all
10492025-03-01T01:15:53.488ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/networking/bgp-announce-set/{announce_set} versions = all
10502025-03-01T01:15:53.488ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bgp-announce-set/{announce_set}/announcement versions = all
10512025-03-01T01:15:53.488ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bgp-exported versions = all
10522025-03-01T01:15:53.488ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bgp-message-history versions = all
10532025-03-01T01:15:53.488ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bgp-routes-ipv4 versions = all
10542025-03-01T01:15:53.488ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bgp-status versions = all
10552025-03-01T01:15:53.488ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/loopback-address versions = all
10562025-03-01T01:15:53.488ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/networking/loopback-address versions = all
10572025-03-01T01:15:53.489ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/networking/loopback-address/{rack_id}/{switch_location}/{address}/{subnet_mask} versions = all
10582025-03-01T01:15:53.489ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/networking/switch-port-settings versions = all
10592025-03-01T01:15:53.489ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/switch-port-settings versions = all
10602025-03-01T01:15:53.489ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/networking/switch-port-settings versions = all
10612025-03-01T01:15:53.489ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/switch-port-settings/{port} versions = all
10622025-03-01T01:15:53.489ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/policy versions = all
10632025-03-01T01:15:53.489ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/policy versions = all
10642025-03-01T01:15:53.489ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/roles versions = all
10652025-03-01T01:15:53.489ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/roles/{role_name} versions = all
10662025-03-01T01:15:53.489ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/silo-quotas versions = all
10672025-03-01T01:15:53.489ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/silos versions = all
10682025-03-01T01:15:53.489ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/silos versions = all
10692025-03-01T01:15:53.489ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/silos/{silo} versions = all
10702025-03-01T01:15:53.489ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/silos/{silo} versions = all
10712025-03-01T01:15:53.489ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/silos/{silo}/ip-pools versions = all
10722025-03-01T01:15:53.489ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/silos/{silo}/policy versions = all
10732025-03-01T01:15:53.489ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/silos/{silo}/policy versions = all
10742025-03-01T01:15:53.489ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/silos/{silo}/quotas versions = all
10752025-03-01T01:15:53.489ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/silos/{silo}/quotas versions = all
10762025-03-01T01:15:53.489ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/timeseries/query versions = all
10772025-03-01T01:15:53.489ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/timeseries/schemas versions = all
10782025-03-01T01:15:53.489ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/update/repository versions = all
10792025-03-01T01:15:53.489ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/update/repository/{system_version} versions = all
10802025-03-01T01:15:53.489ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/users versions = all
10812025-03-01T01:15:53.489ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/users/{user_id} versions = all
10822025-03-01T01:15:53.489ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/users-builtin versions = all
10832025-03-01T01:15:53.489ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/users-builtin/{user} versions = all
10842025-03-01T01:15:53.489ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/utilization/silos versions = all
10852025-03-01T01:15:53.489ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/utilization/silos/{silo} versions = all
10862025-03-01T01:15:53.489ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/timeseries/query versions = all
10872025-03-01T01:15:53.489ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/users versions = all
10882025-03-01T01:15:53.489ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/utilization versions = all
10892025-03-01T01:15:53.489ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-firewall-rules versions = all
10902025-03-01T01:15:53.489ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/vpc-firewall-rules versions = all
10912025-03-01T01:15:53.489ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-router-routes versions = all
10922025-03-01T01:15:53.489ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/vpc-router-routes versions = all
10932025-03-01T01:15:53.489ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/vpc-router-routes/{route} versions = all
10942025-03-01T01:15:53.489ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-router-routes/{route} versions = all
10952025-03-01T01:15:53.489ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/vpc-router-routes/{route} versions = all
10962025-03-01T01:15:53.489ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-routers versions = all
10972025-03-01T01:15:53.489ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/vpc-routers versions = all
10982025-03-01T01:15:53.489ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/vpc-routers/{router} versions = all
10992025-03-01T01:15:53.489ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-routers/{router} versions = all
11002025-03-01T01:15:53.489ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/vpc-routers/{router} versions = all
11012025-03-01T01:15:53.489ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-subnets versions = all
11022025-03-01T01:15:53.489ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/vpc-subnets versions = all
11032025-03-01T01:15:53.489ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/vpc-subnets/{subnet} versions = all
11042025-03-01T01:15:53.489ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-subnets/{subnet} versions = all
11052025-03-01T01:15:53.489ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/vpc-subnets/{subnet} versions = all
11062025-03-01T01:15:53.489ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-subnets/{subnet}/network-interfaces versions = all
11072025-03-01T01:15:53.489ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpcs versions = all
11082025-03-01T01:15:53.489ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/vpcs versions = all
11092025-03-01T01:15:53.489ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/vpcs/{vpc} versions = all
11102025-03-01T01:15:53.489ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpcs/{vpc} versions = all
11112025-03-01T01:15:53.489ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/vpcs/{vpc} versions = all
11122025-03-01T01:15:53.489ZINFOnexus (dropshot_external): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:328 local_addr = 172.30.2.7:443
11132025-03-01T01:15:53.489ZDEBGnexus (dropshot_external): successfully registered DTrace USDT probes local_addr = 172.30.2.7:443
11142025-03-01T01:15:53.496ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = / versions = all
11152025-03-01T01:15:53.496ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /access versions = all
11162025-03-01T01:15:53.496ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /assets/{path} versions = all
11172025-03-01T01:15:53.496ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /device/auth versions = all
11182025-03-01T01:15:53.496ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /device/confirm versions = all
11192025-03-01T01:15:53.496ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /device/success versions = all
11202025-03-01T01:15:53.496ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /device/token versions = all
11212025-03-01T01:15:53.496ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /device/verify versions = all
11222025-03-01T01:15:53.496ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /experimental/v1/probes versions = all
11232025-03-01T01:15:53.496ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /experimental/v1/probes versions = all
11242025-03-01T01:15:53.496ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /experimental/v1/probes/{probe} versions = all
11252025-03-01T01:15:53.496ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /experimental/v1/probes/{probe} versions = all
11262025-03-01T01:15:53.496ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /experimental/v1/system/support-bundles versions = all
11272025-03-01T01:15:53.496ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /experimental/v1/system/support-bundles versions = all
11282025-03-01T01:15:53.496ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /experimental/v1/system/support-bundles/{support_bundle} versions = all
11292025-03-01T01:15:53.496ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /experimental/v1/system/support-bundles/{support_bundle} versions = all
11302025-03-01T01:15:53.496ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /experimental/v1/system/support-bundles/{support_bundle}/download versions = all
11312025-03-01T01:15:53.496ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = HEAD path = /experimental/v1/system/support-bundles/{support_bundle}/download versions = all
11322025-03-01T01:15:53.496ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /experimental/v1/system/support-bundles/{support_bundle}/download/{file} versions = all
11332025-03-01T01:15:53.496ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = HEAD path = /experimental/v1/system/support-bundles/{support_bundle}/download/{file} versions = all
11342025-03-01T01:15:53.496ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /experimental/v1/system/support-bundles/{support_bundle}/index versions = all
11352025-03-01T01:15:53.496ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /images versions = all
11362025-03-01T01:15:53.496ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /login versions = all
11372025-03-01T01:15:53.496ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /login/{silo_name}/local versions = all
11382025-03-01T01:15:53.496ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /login/{silo_name}/saml/{provider_name} versions = all
11392025-03-01T01:15:53.496ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /login/{silo_name}/saml/{provider_name} versions = all
11402025-03-01T01:15:53.496ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /login/{silo_name}/saml/{provider_name}/redirect versions = all
11412025-03-01T01:15:53.496ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /lookup/{path} versions = all
11422025-03-01T01:15:53.497ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /projects/{path} versions = all
11432025-03-01T01:15:53.497ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /projects-new versions = all
11442025-03-01T01:15:53.497ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /settings/{path} versions = all
11452025-03-01T01:15:53.497ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /system/{path} versions = all
11462025-03-01T01:15:53.497ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /utilization versions = all
11472025-03-01T01:15:53.497ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/certificates versions = all
11482025-03-01T01:15:53.497ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/certificates versions = all
11492025-03-01T01:15:53.497ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/certificates/{certificate} versions = all
11502025-03-01T01:15:53.497ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/certificates/{certificate} versions = all
11512025-03-01T01:15:53.497ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/disks versions = all
11522025-03-01T01:15:53.497ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/disks versions = all
11532025-03-01T01:15:53.497ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/disks/{disk} versions = all
11542025-03-01T01:15:53.497ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/disks/{disk} versions = all
11552025-03-01T01:15:53.497ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/disks/{disk}/bulk-write versions = all
11562025-03-01T01:15:53.497ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/disks/{disk}/bulk-write-start versions = all
11572025-03-01T01:15:53.497ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/disks/{disk}/bulk-write-stop versions = all
11582025-03-01T01:15:53.497ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/disks/{disk}/finalize versions = all
11592025-03-01T01:15:53.497ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/disks/{disk}/metrics/{metric} versions = all
11602025-03-01T01:15:53.497ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/floating-ips versions = all
11612025-03-01T01:15:53.497ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/floating-ips versions = all
11622025-03-01T01:15:53.497ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/floating-ips/{floating_ip} versions = all
11632025-03-01T01:15:53.497ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/floating-ips/{floating_ip} versions = all
11642025-03-01T01:15:53.497ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/floating-ips/{floating_ip} versions = all
11652025-03-01T01:15:53.497ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/floating-ips/{floating_ip}/attach versions = all
11662025-03-01T01:15:53.497ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/floating-ips/{floating_ip}/detach versions = all
11672025-03-01T01:15:53.497ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/groups versions = all
11682025-03-01T01:15:53.497ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/groups/{group_id} versions = all
11692025-03-01T01:15:53.497ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/images versions = all
11702025-03-01T01:15:53.497ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/images versions = all
11712025-03-01T01:15:53.497ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/images/{image} versions = all
11722025-03-01T01:15:53.497ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/images/{image} versions = all
11732025-03-01T01:15:53.497ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/images/{image}/demote versions = all
11742025-03-01T01:15:53.497ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/images/{image}/promote versions = all
11752025-03-01T01:15:53.497ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/instances versions = all
11762025-03-01T01:15:53.497ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/instances versions = all
11772025-03-01T01:15:53.497ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/instances/{instance} versions = all
11782025-03-01T01:15:53.497ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/instances/{instance} versions = all
11792025-03-01T01:15:53.497ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/instances/{instance} versions = all
11802025-03-01T01:15:53.497ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/instances/{instance}/disks versions = all
11812025-03-01T01:15:53.497ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/instances/{instance}/disks/attach versions = all
11822025-03-01T01:15:53.497ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/instances/{instance}/disks/detach versions = all
11832025-03-01T01:15:53.497ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/instances/{instance}/external-ips versions = all
11842025-03-01T01:15:53.497ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/instances/{instance}/external-ips/ephemeral versions = all
11852025-03-01T01:15:53.497ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/instances/{instance}/external-ips/ephemeral versions = all
11862025-03-01T01:15:53.497ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/instances/{instance}/reboot versions = all
11872025-03-01T01:15:53.497ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/instances/{instance}/serial-console versions = all
11882025-03-01T01:15:53.497ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/instances/{instance}/serial-console/stream versions = all
11892025-03-01T01:15:53.497ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/instances/{instance}/ssh-public-keys versions = all
11902025-03-01T01:15:53.497ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/instances/{instance}/start versions = all
11912025-03-01T01:15:53.497ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/instances/{instance}/stop versions = all
11922025-03-01T01:15:53.497ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/internet-gateway-ip-addresses versions = all
11932025-03-01T01:15:53.497ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/internet-gateway-ip-addresses versions = all
11942025-03-01T01:15:53.497ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/internet-gateway-ip-addresses/{address} versions = all
11952025-03-01T01:15:53.497ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/internet-gateway-ip-pools versions = all
11962025-03-01T01:15:53.497ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/internet-gateway-ip-pools versions = all
11972025-03-01T01:15:53.497ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/internet-gateway-ip-pools/{pool} versions = all
11982025-03-01T01:15:53.497ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/internet-gateways versions = all
11992025-03-01T01:15:53.497ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/internet-gateways versions = all
12002025-03-01T01:15:53.497ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/internet-gateways/{gateway} versions = all
12012025-03-01T01:15:53.497ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/internet-gateways/{gateway} versions = all
12022025-03-01T01:15:53.497ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/ip-pools versions = all
12032025-03-01T01:15:53.497ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/ip-pools/{pool} versions = all
12042025-03-01T01:15:53.497ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/login/{silo_name}/local versions = all
12052025-03-01T01:15:53.497ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/logout versions = all
12062025-03-01T01:15:53.497ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/me versions = all
12072025-03-01T01:15:53.497ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/me/groups versions = all
12082025-03-01T01:15:53.497ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/me/ssh-keys versions = all
12092025-03-01T01:15:53.497ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/me/ssh-keys versions = all
12102025-03-01T01:15:53.497ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/me/ssh-keys/{ssh_key} versions = all
12112025-03-01T01:15:53.497ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/me/ssh-keys/{ssh_key} versions = all
12122025-03-01T01:15:53.497ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/metrics/{metric_name} versions = all
12132025-03-01T01:15:53.497ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/network-interfaces versions = all
12142025-03-01T01:15:53.497ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/network-interfaces versions = all
12152025-03-01T01:15:53.497ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/network-interfaces/{interface} versions = all
12162025-03-01T01:15:53.497ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/network-interfaces/{interface} versions = all
12172025-03-01T01:15:53.497ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/network-interfaces/{interface} versions = all
12182025-03-01T01:15:53.497ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/ping versions = all
12192025-03-01T01:15:53.497ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/policy versions = all
12202025-03-01T01:15:53.497ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/policy versions = all
12212025-03-01T01:15:53.497ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/projects versions = all
12222025-03-01T01:15:53.497ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/projects versions = all
12232025-03-01T01:15:53.497ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/projects/{project} versions = all
12242025-03-01T01:15:53.497ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/projects/{project} versions = all
12252025-03-01T01:15:53.497ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/projects/{project} versions = all
12262025-03-01T01:15:53.497ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/projects/{project}/policy versions = all
12272025-03-01T01:15:53.497ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/projects/{project}/policy versions = all
12282025-03-01T01:15:53.497ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/snapshots versions = all
12292025-03-01T01:15:53.497ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/snapshots versions = all
12302025-03-01T01:15:53.497ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/snapshots/{snapshot} versions = all
12312025-03-01T01:15:53.497ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/snapshots/{snapshot} versions = all
12322025-03-01T01:15:53.497ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/disks versions = all
12332025-03-01T01:15:53.497ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/disks/{disk_id} versions = all
12342025-03-01T01:15:53.497ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/rack-switch-port/{rack_id}/{switch_location}/{port}/lldp/neighbors versions = all
12352025-03-01T01:15:53.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/racks versions = all
12362025-03-01T01:15:53.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/racks/{rack_id} versions = all
12372025-03-01T01:15:53.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/sleds versions = all
12382025-03-01T01:15:53.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/hardware/sleds versions = all
12392025-03-01T01:15:53.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/sleds/{sled_id} versions = all
12402025-03-01T01:15:53.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/sleds/{sled_id}/disks versions = all
12412025-03-01T01:15:53.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/sleds/{sled_id}/instances versions = all
12422025-03-01T01:15:53.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/hardware/sleds/{sled_id}/provision-policy versions = all
12432025-03-01T01:15:53.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/sleds-uninitialized versions = all
12442025-03-01T01:15:53.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/switch-port versions = all
12452025-03-01T01:15:53.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/switch-port/{port}/lldp/config versions = all
12462025-03-01T01:15:53.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/hardware/switch-port/{port}/lldp/config versions = all
12472025-03-01T01:15:53.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/hardware/switch-port/{port}/settings versions = all
12482025-03-01T01:15:53.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/hardware/switch-port/{port}/settings versions = all
12492025-03-01T01:15:53.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/switch-port/{port}/status versions = all
12502025-03-01T01:15:53.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/switches versions = all
12512025-03-01T01:15:53.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/switches/{switch_id} versions = all
12522025-03-01T01:15:53.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/identity-providers versions = all
12532025-03-01T01:15:53.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/identity-providers/local/users versions = all
12542025-03-01T01:15:53.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/identity-providers/local/users/{user_id} versions = all
12552025-03-01T01:15:53.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/identity-providers/local/users/{user_id}/set-password versions = all
12562025-03-01T01:15:53.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/identity-providers/saml versions = all
12572025-03-01T01:15:53.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/identity-providers/saml/{provider} versions = all
12582025-03-01T01:15:53.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/ip-pools versions = all
12592025-03-01T01:15:53.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/ip-pools versions = all
12602025-03-01T01:15:53.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/ip-pools/{pool} versions = all
12612025-03-01T01:15:53.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/ip-pools/{pool} versions = all
12622025-03-01T01:15:53.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/ip-pools/{pool} versions = all
12632025-03-01T01:15:53.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/ip-pools/{pool}/ranges versions = all
12642025-03-01T01:15:53.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/ip-pools/{pool}/ranges/add versions = all
12652025-03-01T01:15:53.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/ip-pools/{pool}/ranges/remove versions = all
12662025-03-01T01:15:53.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/ip-pools/{pool}/silos versions = all
12672025-03-01T01:15:53.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/ip-pools/{pool}/silos versions = all
12682025-03-01T01:15:53.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/ip-pools/{pool}/silos/{silo} versions = all
12692025-03-01T01:15:53.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/ip-pools/{pool}/silos/{silo} versions = all
12702025-03-01T01:15:53.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/ip-pools/{pool}/utilization versions = all
12712025-03-01T01:15:53.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/ip-pools-service versions = all
12722025-03-01T01:15:53.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/ip-pools-service/ranges versions = all
12732025-03-01T01:15:53.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/ip-pools-service/ranges/add versions = all
12742025-03-01T01:15:53.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/ip-pools-service/ranges/remove versions = all
12752025-03-01T01:15:53.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/metrics/{metric_name} versions = all
12762025-03-01T01:15:53.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/address-lot versions = all
12772025-03-01T01:15:53.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/networking/address-lot versions = all
12782025-03-01T01:15:53.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/networking/address-lot/{address_lot} versions = all
12792025-03-01T01:15:53.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/address-lot/{address_lot}/blocks versions = all
12802025-03-01T01:15:53.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/allow-list versions = all
12812025-03-01T01:15:53.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/networking/allow-list versions = all
12822025-03-01T01:15:53.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/networking/bfd-disable versions = all
12832025-03-01T01:15:53.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/networking/bfd-enable versions = all
12842025-03-01T01:15:53.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bfd-status versions = all
12852025-03-01T01:15:53.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/networking/bgp versions = all
12862025-03-01T01:15:53.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bgp versions = all
12872025-03-01T01:15:53.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/networking/bgp versions = all
12882025-03-01T01:15:53.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bgp-announce-set versions = all
12892025-03-01T01:15:53.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/networking/bgp-announce-set versions = all
12902025-03-01T01:15:53.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/networking/bgp-announce-set/{announce_set} versions = all
12912025-03-01T01:15:53.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bgp-announce-set/{announce_set}/announcement versions = all
12922025-03-01T01:15:53.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bgp-exported versions = all
12932025-03-01T01:15:53.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bgp-message-history versions = all
12942025-03-01T01:15:53.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bgp-routes-ipv4 versions = all
12952025-03-01T01:15:53.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bgp-status versions = all
12962025-03-01T01:15:53.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/loopback-address versions = all
12972025-03-01T01:15:53.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/networking/loopback-address versions = all
12982025-03-01T01:15:53.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/networking/loopback-address/{rack_id}/{switch_location}/{address}/{subnet_mask} versions = all
12992025-03-01T01:15:53.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/networking/switch-port-settings versions = all
13002025-03-01T01:15:53.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/switch-port-settings versions = all
13012025-03-01T01:15:53.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/networking/switch-port-settings versions = all
13022025-03-01T01:15:53.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/switch-port-settings/{port} versions = all
13032025-03-01T01:15:53.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/policy versions = all
13042025-03-01T01:15:53.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/policy versions = all
13052025-03-01T01:15:53.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/roles versions = all
13062025-03-01T01:15:53.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/roles/{role_name} versions = all
13072025-03-01T01:15:53.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/silo-quotas versions = all
13082025-03-01T01:15:53.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/silos versions = all
13092025-03-01T01:15:53.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/silos versions = all
13102025-03-01T01:15:53.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/silos/{silo} versions = all
13112025-03-01T01:15:53.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/silos/{silo} versions = all
13122025-03-01T01:15:53.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/silos/{silo}/ip-pools versions = all
13132025-03-01T01:15:53.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/silos/{silo}/policy versions = all
13142025-03-01T01:15:53.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/silos/{silo}/policy versions = all
13152025-03-01T01:15:53.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/silos/{silo}/quotas versions = all
13162025-03-01T01:15:53.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/silos/{silo}/quotas versions = all
13172025-03-01T01:15:53.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/timeseries/query versions = all
13182025-03-01T01:15:53.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/timeseries/schemas versions = all
13192025-03-01T01:15:53.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/update/repository versions = all
13202025-03-01T01:15:53.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/update/repository/{system_version} versions = all
13212025-03-01T01:15:53.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/users versions = all
13222025-03-01T01:15:53.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/users/{user_id} versions = all
13232025-03-01T01:15:53.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/users-builtin versions = all
13242025-03-01T01:15:53.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/users-builtin/{user} versions = all
13252025-03-01T01:15:53.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/utilization/silos versions = all
13262025-03-01T01:15:53.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/utilization/silos/{silo} versions = all
13272025-03-01T01:15:53.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/timeseries/query versions = all
13282025-03-01T01:15:53.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/users versions = all
13292025-03-01T01:15:53.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/utilization versions = all
13302025-03-01T01:15:53.498ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-firewall-rules versions = all
13312025-03-01T01:15:53.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/vpc-firewall-rules versions = all
13322025-03-01T01:15:53.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-router-routes versions = all
13332025-03-01T01:15:53.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/vpc-router-routes versions = all
13342025-03-01T01:15:53.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/vpc-router-routes/{route} versions = all
13352025-03-01T01:15:53.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-router-routes/{route} versions = all
13362025-03-01T01:15:53.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/vpc-router-routes/{route} versions = all
13372025-03-01T01:15:53.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-routers versions = all
13382025-03-01T01:15:53.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/vpc-routers versions = all
13392025-03-01T01:15:53.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/vpc-routers/{router} versions = all
13402025-03-01T01:15:53.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-routers/{router} versions = all
13412025-03-01T01:15:53.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/vpc-routers/{router} versions = all
13422025-03-01T01:15:53.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-subnets versions = all
13432025-03-01T01:15:53.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/vpc-subnets versions = all
13442025-03-01T01:15:53.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/vpc-subnets/{subnet} versions = all
13452025-03-01T01:15:53.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-subnets/{subnet} versions = all
13462025-03-01T01:15:53.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/vpc-subnets/{subnet} versions = all
13472025-03-01T01:15:53.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-subnets/{subnet}/network-interfaces versions = all
13482025-03-01T01:15:53.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpcs versions = all
13492025-03-01T01:15:53.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/vpcs versions = all
13502025-03-01T01:15:53.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/vpcs/{vpc} versions = all
13512025-03-01T01:15:53.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpcs/{vpc} versions = all
13522025-03-01T01:15:53.499ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/vpcs/{vpc} versions = all
13532025-03-01T01:15:53.499ZINFOnexus (dropshot_external_techport): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:328 local_addr = [fd00:1122:3344:101::c]:12228
13542025-03-01T01:15:53.499ZDEBGnexus (dropshot_external_techport): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::c]:12228
13552025-03-01T01:15:53.503ZDEBGnexus (nexus-producer-server): registered DTrace probes
13562025-03-01T01:15:53.506ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
13572025-03-01T01:15:53.506ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 0a9e4b5c-53a1-4f0a-8849-98a8b1852af3 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
13582025-03-01T01:15:53.506ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
13592025-03-01T01:15:53.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
13602025-03-01T01:15:53.507ZDEBGnexus (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::c]:34357 method = GET path = /{producer_id} versions = all
13612025-03-01T01:15:53.507ZINFOnexus (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:328 local_addr = [fd00:1122:3344:101::c]:34357
13622025-03-01T01:15:53.507ZDEBGnexus (dropshot): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::c]:34357
13632025-03-01T01:15:53.507ZDEBGnexus (nexus-producer-server): Requested any available port, Dropshot server has been bound to [fd00:1122:3344:101::c]:34357
13642025-03-01T01:15:53.507ZDEBGnexus (nexus-producer-server): Nexus IP provided explicitly, will use it addr = [fd00:1122:3344:101::c]:12221
13652025-03-01T01:15:53.507ZDEBGnexus (nexus-producer-server): starting producer registration task
13662025-03-01T01:15:53.508ZINFOnexus (nexus-producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::c]:34357 file = oximeter/producer/src/lib.rs:279 interval = 10s producer_id = 67b03f4e-4cbd-4843-9cd9-647f610abcfc
13672025-03-01T01:15:53.508ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
13682025-03-01T01:15:53.508ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
13692025-03-01T01:15:53.510ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13702025-03-01T01:15:53.510ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
13712025-03-01T01:15:53.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
13722025-03-01T01:15:53.513ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13732025-03-01T01:15:53.515ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
13742025-03-01T01:15:53.515ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
13752025-03-01T01:15:53.515ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
13762025-03-01T01:15:53.515ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
13772025-03-01T01:15:53.515ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
13782025-03-01T01:15:53.515ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
13792025-03-01T01:15:53.516ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13802025-03-01T01:15:53.518ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 303.416821ms iteration = 3 status = {}
13812025-03-01T01:15:53.519ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 0a9e4b5c-53a1-4f0a-8849-98a8b1852af3 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
13822025-03-01T01:15:53.519ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
13832025-03-01T01:15:53.519ZINFOnexus (BackgroundTasks): found latest generation (first find) background_task = dns_config_internal dns_group = internal file = nexus/src/app/background/tasks/dns_config.rs:87 generation = 1
13842025-03-01T01:15:53.519ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 304.275719ms iteration = 2 status = {"generation":1}
13852025-03-01T01:15:53.519ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 4 reason = Dependency
13862025-03-01T01:15:53.519ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
13872025-03-01T01:15:53.519ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
13882025-03-01T01:15:53.519ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
13892025-03-01T01:15:53.537ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
13902025-03-01T01:15:53.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
13912025-03-01T01:15:53.539ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
13922025-03-01T01:15:53.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
13932025-03-01T01:15:53.541ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13942025-03-01T01:15:53.543ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 3471264f-127e-4a25-bc10-2e8249e8d70a, lookup_type: ById(3471264f-127e-4a25-bc10-2e8249e8d70a) } result = Ok(())
13952025-03-01T01:15:53.543ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
13962025-03-01T01:15:53.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
13972025-03-01T01:15:53.545ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 330.910571ms iteration = 3 status = 0
13982025-03-01T01:15:53.548ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
13992025-03-01T01:15:53.548ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "5009ef65-8cf9-4dd9-a785-e5097ee43136", "content-length": "2", "date": "Sat, 01 Mar 2025 01:15:52 GMT"} })
14002025-03-01T01:15:53.549ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
14012025-03-01T01:15:53.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
14022025-03-01T01:15:53.554ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 339.689429ms iteration = 3 status = null
14032025-03-01T01:15:53.581ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
14042025-03-01T01:15:53.581ZDEBGnexus (BackgroundTasks): client request SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
14052025-03-01T01:15:53.582ZDEBGnexus (BackgroundTasks): client response SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "95e171e6-34de-4e34-938c-cb95a584655d", "date": "Sat, 01 Mar 2025 01:15:53 GMT"} })
14062025-03-01T01:15:53.582ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14072025-03-01T01:15:53.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14082025-03-01T01:15:53.584ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14092025-03-01T01:15:53.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14102025-03-01T01:15:53.587ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14112025-03-01T01:15:53.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14122025-03-01T01:15:53.590ZINFOnexus (BackgroundTasks): VPC route manager sled 3471264f-127e-4a25-bc10-2e8249e8d70a push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
14132025-03-01T01:15:53.590ZDEBGnexus (BackgroundTasks): client request SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
14142025-03-01T01:15:53.591ZDEBGnexus (BackgroundTasks): client response SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "8a04fc3c-d59e-45d0-9bdf-2bf19befc05a", "date": "Sat, 01 Mar 2025 01:15:53 GMT"} })
14152025-03-01T01:15:53.592ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 377.478659ms iteration = 3 status = {}
14162025-03-01T01:15:53.661ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
14172025-03-01T01:15:53.674ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
14182025-03-01T01:15:53.674ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:42761
14192025-03-01T01:15:53.688ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:42761 req_id = 08d9b8db-23f9-46f2-b5fe-1bd9035fa6a7 roles = RoleSet { roles: {} } uri = /metrics/producers
14202025-03-01T01:15:53.688ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:42761 req_id = 08d9b8db-23f9-46f2-b5fe-1bd9035fa6a7 resource = Database result = Ok(()) uri = /metrics/producers
14212025-03-01T01:15:53.731ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
14222025-03-01T01:15:53.755ZDEBGnexus (BackgroundTasks): client request SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
14232025-03-01T01:15:53.756ZDEBGnexus (BackgroundTasks): client response SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "793e4547-f555-403b-bba1-ce07a829e9f9", "content-length": "691", "date": "Sat, 01 Mar 2025 01:15:53 GMT"} })
14242025-03-01T01:15:53.756ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
14252025-03-01T01:15:53.756ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
14262025-03-01T01:15:53.756ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
14272025-03-01T01:15:53.756ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 542.104943ms iteration = 3 status = {}
14282025-03-01T01:15:53.783ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
14292025-03-01T01:15:53.839ZINFOnexus: assigned collector to new producer collector_id = d77aa5d6-e6f9-4845-b1d4-57f91a3621e6 file = nexus/src/app/oximeter.rs:76 producer_id = 67b03f4e-4cbd-4843-9cd9-647f610abcfc
14302025-03-01T01:15:53.839ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 165425 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:42761 req_id = 08d9b8db-23f9-46f2-b5fe-1bd9035fa6a7 response_code = 201 uri = /metrics/producers
14312025-03-01T01:15:53.839ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "08d9b8db-23f9-46f2-b5fe-1bd9035fa6a7", "content-length": "41", "date": "Sat, 01 Mar 2025 01:15:53 GMT"} })
14322025-03-01T01:15:53.843ZDEBGnexus (producer-registration-task): registered with nexus successfully
14332025-03-01T01:15:53.843ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
14342025-03-01T01:15:53.886ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
14352025-03-01T01:15:53.886ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "1141945b-b358-44ea-84c4-22199be5b11d", "date": "Sat, 01 Mar 2025 01:15:53 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
14362025-03-01T01:15:53.886ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
14372025-03-01T01:15:53.887ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "318fd668-90b5-41d6-bb94-7c4960cdcdb1", "date": "Sat, 01 Mar 2025 01:15:53 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
14382025-03-01T01:15:53.887ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
14392025-03-01T01:15:53.888ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "f8ecbcd2-94b7-4b95-89d2-48c7ff48d84e", "date": "Sat, 01 Mar 2025 01:15:53 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
14402025-03-01T01:15:53.888ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
14412025-03-01T01:15:53.890ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
14422025-03-01T01:15:53.890ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 371.355695ms iteration = 4 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
14432025-03-01T01:15:53.917ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
14442025-03-01T01:15:53.917ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "83af7495-9105-45e7-bcc2-7990b5c098af", "date": "Sat, 01 Mar 2025 01:15:53 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
14452025-03-01T01:15:53.917ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
14462025-03-01T01:15:53.918ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "f3f2540b-bd1e-4d11-a9b8-985b2a6a5656", "date": "Sat, 01 Mar 2025 01:15:53 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
14472025-03-01T01:15:53.918ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
14482025-03-01T01:15:53.920ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
14492025-03-01T01:15:53.920ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 441.836471ms iteration = 4 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
14502025-03-01T01:15:53.934ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14512025-03-01T01:15:53.935ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14522025-03-01T01:15:53.937ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 7f9c3c14-58c5-473f-8692-6376be44401e, rack_id: 4854cb88-dfba-4609-8f9d-72aac08cef66, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(cb10d0c6-a704-4231-b148-4f9ae21a03f8) } rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 switch_location = Switch0
14532025-03-01T01:15:53.937ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14542025-03-01T01:15:53.937ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14552025-03-01T01:15:54.045ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
14562025-03-01T01:15:54.045ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "008a9e6a-3d57-4b8c-bedb-85904c9d2875", "content-length": "134", "date": "Sat, 01 Mar 2025 01:15:53 GMT"} })
14572025-03-01T01:15:54.045ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
14582025-03-01T01:15:54.045ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = cb10d0c6-a704-4231-b148-4f9ae21a03f8
14592025-03-01T01:15:54.045ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
14602025-03-01T01:15:54.045ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
14612025-03-01T01:15:54.045ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
14622025-03-01T01:15:54.045ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
14632025-03-01T01:15:54.045ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
14642025-03-01T01:15:54.045ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
14652025-03-01T01:15:54.046ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
14662025-03-01T01:15:54.046ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
14672025-03-01T01:15:54.046ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66
14682025-03-01T01:15:54.046ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14692025-03-01T01:15:54.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14702025-03-01T01:15:54.048ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
14712025-03-01T01:15:54.048ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "e97fffc4-6e32-47c8-aada-319994fa02f4", "content-length": "2", "date": "Sat, 01 Mar 2025 01:15:53 GMT"} })
14722025-03-01T01:15:54.048ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
14732025-03-01T01:15:54.048ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "1af89e62-64d4-41fd-b637-2974288f21d1", "content-length": "52", "date": "Sat, 01 Mar 2025 01:15:53 GMT"} })
14742025-03-01T01:15:54.048ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 switch_location = Switch0
14752025-03-01T01:15:54.048ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
14762025-03-01T01:15:54.144ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "e11a72c3-65b2-49da-bed4-8fa4afaadd76", "date": "Sat, 01 Mar 2025 01:15:53 GMT"} })
14772025-03-01T01:15:54.144ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 switch = Switch0
14782025-03-01T01:15:54.144ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
14792025-03-01T01:15:54.144ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "6f0da201-3861-455d-8667-cd279152200d", "content-length": "682", "date": "Sat, 01 Mar 2025 01:15:53 GMT"} })
14802025-03-01T01:15:54.144ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14812025-03-01T01:15:54.144ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14822025-03-01T01:15:54.262ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14832025-03-01T01:15:54.263ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14842025-03-01T01:15:54.266ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14852025-03-01T01:15:54.266ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14862025-03-01T01:15:54.268ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14872025-03-01T01:15:54.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14882025-03-01T01:15:54.275ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 1.060656685s iteration = 3 status = {}
14892025-03-01T01:15:54.500ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 653a9759-090b-480f-9030-e519b066dcc9 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
14902025-03-01T01:15:54.500ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 653a9759-090b-480f-9030-e519b066dcc9 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
14912025-03-01T01:15:54.501ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1675 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 653a9759-090b-480f-9030-e519b066dcc9 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
14922025-03-01T01:15:55.521ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = ef1aa7ac-72a2-45e0-a837-8ac485575173 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
14932025-03-01T01:15:55.521ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = ef1aa7ac-72a2-45e0-a837-8ac485575173 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
14942025-03-01T01:15:55.523ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1993 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = ef1aa7ac-72a2-45e0-a837-8ac485575173 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
14952025-03-01T01:15:56.542ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = d40a0e75-98db-4463-b1bc-4cfe6f05145f roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
14962025-03-01T01:15:56.543ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = d40a0e75-98db-4463-b1bc-4cfe6f05145f resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
14972025-03-01T01:15:56.544ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1685 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = d40a0e75-98db-4463-b1bc-4cfe6f05145f response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
14982025-03-01T01:15:57.564ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 7d560601-be04-436c-883a-fae0567d5946 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
14992025-03-01T01:15:57.564ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 7d560601-be04-436c-883a-fae0567d5946 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
15002025-03-01T01:15:57.566ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2482 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 7d560601-be04-436c-883a-fae0567d5946 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
15012025-03-01T01:15:58.587ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 38578731-2028-40d4-8a4b-2e91dc305b11 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
15022025-03-01T01:15:58.587ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 38578731-2028-40d4-8a4b-2e91dc305b11 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
15032025-03-01T01:15:58.589ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2148 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 38578731-2028-40d4-8a4b-2e91dc305b11 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
15042025-03-01T01:15:59.609ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 3a015ae0-0839-4de5-92f4-a258bcf543d2 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
15052025-03-01T01:15:59.610ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 3a015ae0-0839-4de5-92f4-a258bcf543d2 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
15062025-03-01T01:15:59.611ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1629 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 3a015ae0-0839-4de5-92f4-a258bcf543d2 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
15072025-03-01T01:16:00.631ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 55eb620e-35e6-412b-b487-81971312c6e4 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
15082025-03-01T01:16:00.631ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 55eb620e-35e6-412b-b487-81971312c6e4 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
15092025-03-01T01:16:00.633ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2148 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 55eb620e-35e6-412b-b487-81971312c6e4 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
15102025-03-01T01:16:01.652ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 050dba38-1e3c-4c21-9a57-94c7f6f52c02 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
15112025-03-01T01:16:01.653ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 050dba38-1e3c-4c21-9a57-94c7f6f52c02 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
15122025-03-01T01:16:01.655ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2473 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 050dba38-1e3c-4c21-9a57-94c7f6f52c02 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
15132025-03-01T01:16:02.674ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 61e1a5cf-72af-4de6-aa81-6e5b0c528e68 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
15142025-03-01T01:16:02.674ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 61e1a5cf-72af-4de6-aa81-6e5b0c528e68 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
15152025-03-01T01:16:02.676ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1957 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 61e1a5cf-72af-4de6-aa81-6e5b0c528e68 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
15162025-03-01T01:16:03.214ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 8 reason = Timeout
15172025-03-01T01:16:03.214ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 8 reason = Timeout
15182025-03-01T01:16:03.214ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
15192025-03-01T01:16:03.214ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15202025-03-01T01:16:03.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
15212025-03-01T01:16:03.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15222025-03-01T01:16:03.216ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15232025-03-01T01:16:03.217ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
15242025-03-01T01:16:03.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
15252025-03-01T01:16:03.219ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.45432ms iteration = 8 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
15262025-03-01T01:16:03.219ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
15272025-03-01T01:16:03.219ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15282025-03-01T01:16:03.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15292025-03-01T01:16:03.221ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15302025-03-01T01:16:03.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15312025-03-01T01:16:03.223ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15322025-03-01T01:16:03.225ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7, lookup_type: ById(8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7) } result = Ok(())
15332025-03-01T01:16:03.225ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15342025-03-01T01:16:03.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15352025-03-01T01:16:03.234ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 original_time_created = 2025-03-01 01:14:50.436545 UTC target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 time_created = 2025-03-01 01:14:50.436545 UTC
15362025-03-01T01:16:03.234ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.697722ms iteration = 8 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7","time_created":"2025-03-01T01:14:50.436545Z"}
15372025-03-01T01:16:03.695ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 6f4c0233-45d5-4cbb-85bc-a4080607bda1 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
15382025-03-01T01:16:03.695ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 6f4c0233-45d5-4cbb-85bc-a4080607bda1 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
15392025-03-01T01:16:03.697ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1786 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 6f4c0233-45d5-4cbb-85bc-a4080607bda1 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
15402025-03-01T01:16:04.717ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 053e14bc-758b-4e6b-a23b-c24ab4b2fd4b roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
15412025-03-01T01:16:04.717ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 053e14bc-758b-4e6b-a23b-c24ab4b2fd4b resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
15422025-03-01T01:16:04.827ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 109975 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 053e14bc-758b-4e6b-a23b-c24ab4b2fd4b response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
15432025-03-01T01:16:05.848ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 3653fae0-211a-4491-a5aa-b6d2ad497e6e roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
15442025-03-01T01:16:05.848ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 3653fae0-211a-4491-a5aa-b6d2ad497e6e resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
15452025-03-01T01:16:05.942ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 94490 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 3653fae0-211a-4491-a5aa-b6d2ad497e6e response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
15462025-03-01T01:16:06.963ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 49c75fc8-bc7d-423a-aba0-761fded1cfeb roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
15472025-03-01T01:16:06.963ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 49c75fc8-bc7d-423a-aba0-761fded1cfeb resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
15482025-03-01T01:16:07.060ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 97339 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 49c75fc8-bc7d-423a-aba0-761fded1cfeb response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
15492025-03-01T01:16:08.079ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c0916699-e97d-4728-a5cb-6628c6f2a283 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
15502025-03-01T01:16:08.079ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c0916699-e97d-4728-a5cb-6628c6f2a283 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
15512025-03-01T01:16:08.192ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 112935 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c0916699-e97d-4728-a5cb-6628c6f2a283 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
15522025-03-01T01:16:09.210ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = f72fb65a-cebb-4c19-8d28-ed0e6764d7d3 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
15532025-03-01T01:16:09.211ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = f72fb65a-cebb-4c19-8d28-ed0e6764d7d3 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
15542025-03-01T01:16:09.212ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2091 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = f72fb65a-cebb-4c19-8d28-ed0e6764d7d3 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
15552025-03-01T01:16:10.231ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 75ab0702-8f91-4e8a-9405-6255cd8aa0b8 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
15562025-03-01T01:16:10.231ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 75ab0702-8f91-4e8a-9405-6255cd8aa0b8 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
15572025-03-01T01:16:10.233ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2011 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 75ab0702-8f91-4e8a-9405-6255cd8aa0b8 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
15582025-03-01T01:16:11.255ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 644f9d7a-b391-4b3a-97e4-439b3950fc03 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
15592025-03-01T01:16:11.255ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 644f9d7a-b391-4b3a-97e4-439b3950fc03 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
15602025-03-01T01:16:11.257ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2182 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 644f9d7a-b391-4b3a-97e4-439b3950fc03 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
15612025-03-01T01:16:12.276ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 5ed474ff-4639-4ad9-81a4-71e582510c03 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
15622025-03-01T01:16:12.276ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 5ed474ff-4639-4ad9-81a4-71e582510c03 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
15632025-03-01T01:16:12.278ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2318 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 5ed474ff-4639-4ad9-81a4-71e582510c03 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
15642025-03-01T01:16:13.214ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 9 reason = Timeout
15652025-03-01T01:16:13.214ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15662025-03-01T01:16:13.214ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 9 reason = Timeout
15672025-03-01T01:16:13.214ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
15682025-03-01T01:16:13.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15692025-03-01T01:16:13.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
15702025-03-01T01:16:13.217ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15712025-03-01T01:16:13.217ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
15722025-03-01T01:16:13.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
15732025-03-01T01:16:13.219ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.392359ms iteration = 9 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
15742025-03-01T01:16:13.219ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
15752025-03-01T01:16:13.219ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15762025-03-01T01:16:13.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15772025-03-01T01:16:13.221ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15782025-03-01T01:16:13.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15792025-03-01T01:16:13.223ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15802025-03-01T01:16:13.225ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7, lookup_type: ById(8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7) } result = Ok(())
15812025-03-01T01:16:13.225ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15822025-03-01T01:16:13.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15832025-03-01T01:16:13.298ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = f81ffd43-8ce7-4b5d-bca0-20921f522e38 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
15842025-03-01T01:16:13.298ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = f81ffd43-8ce7-4b5d-bca0-20921f522e38 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
15852025-03-01T01:16:13.300ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2098 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = f81ffd43-8ce7-4b5d-bca0-20921f522e38 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
15862025-03-01T01:16:13.323ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 original_time_created = 2025-03-01 01:14:50.436545 UTC target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 time_created = 2025-03-01 01:14:50.436545 UTC
15872025-03-01T01:16:13.323ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 109.131393ms iteration = 9 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7","time_created":"2025-03-01T01:14:50.436545Z"}
15882025-03-01T01:16:14.319ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 17bb9109-dfe8-4758-a7ea-5e235dba0ea8 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
15892025-03-01T01:16:14.319ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 17bb9109-dfe8-4758-a7ea-5e235dba0ea8 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
15902025-03-01T01:16:14.321ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2076 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 17bb9109-dfe8-4758-a7ea-5e235dba0ea8 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
15912025-03-01T01:16:15.341ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 6a001c89-9229-4c8b-9409-fc07d993437e roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
15922025-03-01T01:16:15.341ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 6a001c89-9229-4c8b-9409-fc07d993437e resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
15932025-03-01T01:16:15.343ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2300 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 6a001c89-9229-4c8b-9409-fc07d993437e response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
15942025-03-01T01:16:16.363ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c466c688-3d35-4f1c-b50a-eae49747106b roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
15952025-03-01T01:16:16.363ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c466c688-3d35-4f1c-b50a-eae49747106b resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
15962025-03-01T01:16:16.365ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2068 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c466c688-3d35-4f1c-b50a-eae49747106b response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
15972025-03-01T01:16:17.384ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 58876e35-9035-49c0-b5f8-64878e6c8121 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
15982025-03-01T01:16:17.385ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 58876e35-9035-49c0-b5f8-64878e6c8121 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
15992025-03-01T01:16:17.387ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2614 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 58876e35-9035-49c0-b5f8-64878e6c8121 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
16002025-03-01T01:16:17.414ZINFOnexus (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::c]:34357 remote_addr = [fd00:1122:3344:101::d]:45347
16012025-03-01T01:16:17.422ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 6954 local_addr = [fd00:1122:3344:101::c]:34357 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = 71bb8768-010c-4941-96cd-c4d367499e66 response_code = 200 uri = /67b03f4e-4cbd-4843-9cd9-647f610abcfc
16022025-03-01T01:16:18.407ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 9418e5d7-44bc-4250-ba1e-d8e431f95e7d roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
16032025-03-01T01:16:18.407ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 9418e5d7-44bc-4250-ba1e-d8e431f95e7d resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
16042025-03-01T01:16:18.409ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2135 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 9418e5d7-44bc-4250-ba1e-d8e431f95e7d response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
16052025-03-01T01:16:19.430ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 51e25423-ac3b-43c1-b162-8b798482a9e8 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
16062025-03-01T01:16:19.430ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 51e25423-ac3b-43c1-b162-8b798482a9e8 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
16072025-03-01T01:16:19.431ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1755 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 51e25423-ac3b-43c1-b162-8b798482a9e8 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
16082025-03-01T01:16:20.451ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 84b01754-9ea9-4920-b144-084e807f96f3 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
16092025-03-01T01:16:20.451ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 84b01754-9ea9-4920-b144-084e807f96f3 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
16102025-03-01T01:16:20.453ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2330 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 84b01754-9ea9-4920-b144-084e807f96f3 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
16112025-03-01T01:16:21.473ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = b75bdb4f-bdd4-45c3-87be-cbe5aef09922 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
16122025-03-01T01:16:21.474ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = b75bdb4f-bdd4-45c3-87be-cbe5aef09922 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
16132025-03-01T01:16:21.475ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2183 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = b75bdb4f-bdd4-45c3-87be-cbe5aef09922 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
16142025-03-01T01:16:22.407ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::d]:61177
16152025-03-01T01:16:22.409ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61177 req_id = b902e24b-06a0-4d17-afe2-449074c9ad31 roles = RoleSet { roles: {} } uri = /metrics/collectors/d77aa5d6-e6f9-4845-b1d4-57f91a3621e6/producers?sort_by=id_ascending
16162025-03-01T01:16:22.410ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61177 req_id = b902e24b-06a0-4d17-afe2-449074c9ad31 resource = Database result = Ok(()) uri = /metrics/collectors/d77aa5d6-e6f9-4845-b1d4-57f91a3621e6/producers?sort_by=id_ascending
16172025-03-01T01:16:22.413ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 5367 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61177 req_id = b902e24b-06a0-4d17-afe2-449074c9ad31 response_code = 200 uri = /metrics/collectors/d77aa5d6-e6f9-4845-b1d4-57f91a3621e6/producers?sort_by=id_ascending
16182025-03-01T01:16:22.413ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61177 req_id = 379e2b4c-f0be-41dd-971a-a95974564c8f roles = RoleSet { roles: {} } uri = /metrics/collectors/d77aa5d6-e6f9-4845-b1d4-57f91a3621e6/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYmI0ODUwMS0zYzRlLTRkNDQtODgyMy1mOTc1ZTg2OTFmZmYifX0%3D
16192025-03-01T01:16:22.413ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61177 req_id = 379e2b4c-f0be-41dd-971a-a95974564c8f resource = Database result = Ok(()) uri = /metrics/collectors/d77aa5d6-e6f9-4845-b1d4-57f91a3621e6/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYmI0ODUwMS0zYzRlLTRkNDQtODgyMy1mOTc1ZTg2OTFmZmYifX0%3D
16202025-03-01T01:16:22.417ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 4326 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61177 req_id = 379e2b4c-f0be-41dd-971a-a95974564c8f response_code = 200 uri = /metrics/collectors/d77aa5d6-e6f9-4845-b1d4-57f91a3621e6/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYmI0ODUwMS0zYzRlLTRkNDQtODgyMy1mOTc1ZTg2OTFmZmYifX0%3D
16212025-03-01T01:16:22.495ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 67616f6e-143e-48d9-86bb-5884a9983c13 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
16222025-03-01T01:16:22.495ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 67616f6e-143e-48d9-86bb-5884a9983c13 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
16232025-03-01T01:16:22.496ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1800 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 67616f6e-143e-48d9-86bb-5884a9983c13 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
16242025-03-01T01:16:23.214ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 4 reason = Timeout
16252025-03-01T01:16:23.214ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 4 reason = Timeout
16262025-03-01T01:16:23.214ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16272025-03-01T01:16:23.214ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
16282025-03-01T01:16:23.214ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 10 reason = Timeout
16292025-03-01T01:16:23.214ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
16302025-03-01T01:16:23.214ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 4 reason = Timeout
16312025-03-01T01:16:23.214ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16322025-03-01T01:16:23.214ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
16332025-03-01T01:16:23.214ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 4 reason = Timeout
16342025-03-01T01:16:23.214ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
16352025-03-01T01:16:23.214ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 4 reason = Timeout
16362025-03-01T01:16:23.214ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 4 reason = Timeout
16372025-03-01T01:16:23.214ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
16382025-03-01T01:16:23.214ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
16392025-03-01T01:16:23.214ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 4 reason = Timeout
16402025-03-01T01:16:23.214ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 4 reason = Timeout
16412025-03-01T01:16:23.214ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
16422025-03-01T01:16:23.214ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 4 reason = Timeout
16432025-03-01T01:16:23.214ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 5 reason = Timeout
16442025-03-01T01:16:23.214ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
16452025-03-01T01:16:23.214ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 4 reason = Timeout
16462025-03-01T01:16:23.214ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16472025-03-01T01:16:23.214ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
16482025-03-01T01:16:23.214ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
16492025-03-01T01:16:23.214ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 4 reason = Timeout
16502025-03-01T01:16:23.214ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
16512025-03-01T01:16:23.214ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 10 reason = Timeout
16522025-03-01T01:16:23.214ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 4 reason = Timeout
16532025-03-01T01:16:23.214ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
16542025-03-01T01:16:23.214ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 4 reason = Timeout
16552025-03-01T01:16:23.214ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
16562025-03-01T01:16:23.214ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
16572025-03-01T01:16:23.214ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 4 reason = Timeout
16582025-03-01T01:16:23.214ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 4 reason = Timeout
16592025-03-01T01:16:23.214ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
16602025-03-01T01:16:23.214ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
16612025-03-01T01:16:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16622025-03-01T01:16:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
16632025-03-01T01:16:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
16642025-03-01T01:16:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
16652025-03-01T01:16:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16662025-03-01T01:16:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
16672025-03-01T01:16:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
16682025-03-01T01:16:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
16692025-03-01T01:16:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16702025-03-01T01:16:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
16712025-03-01T01:16:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
16722025-03-01T01:16:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
16732025-03-01T01:16:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
16742025-03-01T01:16:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
16752025-03-01T01:16:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
16762025-03-01T01:16:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
16772025-03-01T01:16:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
16782025-03-01T01:16:23.216ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16792025-03-01T01:16:23.218ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 993, tv_nsec: 905817596 } })
16802025-03-01T01:16:23.218ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.019782ms iteration = 4 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
16812025-03-01T01:16:23.218ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 4.085043ms iteration = 4 status = {"errors":[],"garbage_collect_requested":[]}
16822025-03-01T01:16:23.218ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1154
16832025-03-01T01:16:23.218ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
16842025-03-01T01:16:23.218ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16852025-03-01T01:16:23.218ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16862025-03-01T01:16:23.218ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16872025-03-01T01:16:23.221ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
16882025-03-01T01:16:23.221ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16892025-03-01T01:16:23.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16902025-03-01T01:16:23.221ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16912025-03-01T01:16:23.223ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
16922025-03-01T01:16:23.223ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16932025-03-01T01:16:23.224ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
16942025-03-01T01:16:23.224ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
16952025-03-01T01:16:23.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16962025-03-01T01:16:23.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
16972025-03-01T01:16:23.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
16982025-03-01T01:16:23.226ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16992025-03-01T01:16:23.226ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17002025-03-01T01:16:23.226ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17012025-03-01T01:16:23.229ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 993, tv_nsec: 917546735 } })
17022025-03-01T01:16:23.229ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
17032025-03-01T01:16:23.229ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
17042025-03-01T01:16:23.230ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
17052025-03-01T01:16:23.230ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
17062025-03-01T01:16:23.230ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
17072025-03-01T01:16:23.230ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
17082025-03-01T01:16:23.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
17092025-03-01T01:16:23.230ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1154
17102025-03-01T01:16:23.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
17112025-03-01T01:16:23.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
17122025-03-01T01:16:23.230ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 993, tv_nsec: 918531935 } })
17132025-03-01T01:16:23.231ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1154 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66
17142025-03-01T01:16:23.232ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17152025-03-01T01:16:23.232ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17162025-03-01T01:16:23.232ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17172025-03-01T01:16:23.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17182025-03-01T01:16:23.234ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
17192025-03-01T01:16:23.234ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17202025-03-01T01:16:23.235ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
17212025-03-01T01:16:23.235ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
17222025-03-01T01:16:23.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17232025-03-01T01:16:23.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
17242025-03-01T01:16:23.237ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
17252025-03-01T01:16:23.238ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17262025-03-01T01:16:23.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
17272025-03-01T01:16:23.238ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
17282025-03-01T01:16:23.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
17292025-03-01T01:16:23.238ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
17302025-03-01T01:16:23.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
17312025-03-01T01:16:23.240ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7, lookup_type: ById(8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7) } result = Ok(())
17322025-03-01T01:16:23.240ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17332025-03-01T01:16:23.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17342025-03-01T01:16:23.261ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
17352025-03-01T01:16:23.261ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
17362025-03-01T01:16:23.261ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
17372025-03-01T01:16:23.261ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
17382025-03-01T01:16:23.269ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 55.755716ms iteration = 4 status = {"errors":[],"finish_invoked_ok":[]}
17392025-03-01T01:16:23.270ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
17402025-03-01T01:16:23.271ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
17412025-03-01T01:16:23.273ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
17422025-03-01T01:16:23.273ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
17432025-03-01T01:16:23.274ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 59.92004ms iteration = 4 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
17442025-03-01T01:16:23.274ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 59.931491ms iteration = 10 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
17452025-03-01T01:16:23.300ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
17462025-03-01T01:16:23.300ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 86.201436ms iteration = 4 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
17472025-03-01T01:16:23.304ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
17482025-03-01T01:16:23.304ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
17492025-03-01T01:16:23.304ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3345f629-f360-43c5-931a-56f81668c88d", "content-length": "26", "date": "Sat, 01 Mar 2025 01:16:23 GMT"} })
17502025-03-01T01:16:23.304ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
17512025-03-01T01:16:23.306ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
17522025-03-01T01:16:23.338ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
17532025-03-01T01:16:23.338ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
17542025-03-01T01:16:23.338ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4480a07c-285a-4501-a9bd-ee448feadfb5", "content-length": "26", "date": "Sat, 01 Mar 2025 01:16:23 GMT"} })
17552025-03-01T01:16:23.338ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
17562025-03-01T01:16:23.340ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
17572025-03-01T01:16:23.350ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1162 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 zone_address = fd00:1122:3344:101::2
17582025-03-01T01:16:23.350ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
17592025-03-01T01:16:23.350ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "dabc6b6f-908f-4568-8f34-ef6cc93f3656", "content-length": "26", "date": "Sat, 01 Mar 2025 01:16:23 GMT"} })
17602025-03-01T01:16:23.350ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1167 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
17612025-03-01T01:16:23.352ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66
17622025-03-01T01:16:23.356ZINFOnexus (BackgroundTasks): VPC route manager sled 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
17632025-03-01T01:16:23.356ZDEBGnexus (BackgroundTasks): client request SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
17642025-03-01T01:16:23.356ZDEBGnexus (BackgroundTasks): client response SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "59604417-43a0-44ec-b14c-2fba9ed4106e", "content-length": "372", "date": "Sat, 01 Mar 2025 01:16:22 GMT"} })
17652025-03-01T01:16:23.356ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17662025-03-01T01:16:23.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17672025-03-01T01:16:23.357ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17682025-03-01T01:16:23.359ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
17692025-03-01T01:16:23.359ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
17702025-03-01T01:16:23.360ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
17712025-03-01T01:16:23.361ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17722025-03-01T01:16:23.365ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
17732025-03-01T01:16:23.365ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
17742025-03-01T01:16:23.365ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
17752025-03-01T01:16:23.379ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
17762025-03-01T01:16:23.380ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
17772025-03-01T01:16:23.381ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
17782025-03-01T01:16:23.381ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
17792025-03-01T01:16:23.383ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 169.646786ms iteration = 4 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
17802025-03-01T01:16:23.399ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 185.54ms iteration = 4 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
17812025-03-01T01:16:23.402ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 188.794756ms iteration = 4 status = {}
17822025-03-01T01:16:23.403ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
17832025-03-01T01:16:23.403ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
17842025-03-01T01:16:23.403ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
17852025-03-01T01:16:23.404ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
17862025-03-01T01:16:23.404ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
17872025-03-01T01:16:23.404ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 189.801526ms iteration = 4 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
17882025-03-01T01:16:23.427ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
17892025-03-01T01:16:23.427ZDEBGnexus (BackgroundTasks): client request SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
17902025-03-01T01:16:23.431ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
17912025-03-01T01:16:23.431ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "d6c02f82-55df-4d54-891b-1e2a2ead4528", "content-length": "2", "date": "Sat, 01 Mar 2025 01:16:22 GMT"} })
17922025-03-01T01:16:23.433ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
17932025-03-01T01:16:23.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
17942025-03-01T01:16:23.438ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 224.122826ms iteration = 4 status = null
17952025-03-01T01:16:23.440ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
17962025-03-01T01:16:23.440ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
17972025-03-01T01:16:23.440ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 226.064325ms iteration = 4 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
17982025-03-01T01:16:23.473ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
17992025-03-01T01:16:23.473ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
18002025-03-01T01:16:23.476ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
18012025-03-01T01:16:23.477ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
18022025-03-01T01:16:23.478ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18032025-03-01T01:16:23.479ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 265.57667ms iteration = 5 status = {"physical_disks_added":0}
18042025-03-01T01:16:23.480ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 3471264f-127e-4a25-bc10-2e8249e8d70a, lookup_type: ById(3471264f-127e-4a25-bc10-2e8249e8d70a) } result = Ok(())
18052025-03-01T01:16:23.480ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
18062025-03-01T01:16:23.481ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
18072025-03-01T01:16:23.482ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 268.666872ms iteration = 4 status = 0
18082025-03-01T01:16:23.494ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18092025-03-01T01:16:23.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18102025-03-01T01:16:23.496ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 7f9c3c14-58c5-473f-8692-6376be44401e, rack_id: 4854cb88-dfba-4609-8f9d-72aac08cef66, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(cb10d0c6-a704-4231-b148-4f9ae21a03f8) } rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 switch_location = Switch0
18112025-03-01T01:16:23.496ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18122025-03-01T01:16:23.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18132025-03-01T01:16:23.519ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = eb29403c-f66e-4bf5-abe7-c85213232830 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
18142025-03-01T01:16:23.519ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = eb29403c-f66e-4bf5-abe7-c85213232830 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
18152025-03-01T01:16:23.519ZDEBGnexus (BackgroundTasks): client response SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "e32c0b4e-556f-457d-bff4-64d0f8731341", "date": "Sat, 01 Mar 2025 01:16:23 GMT"} })
18162025-03-01T01:16:23.519ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18172025-03-01T01:16:23.520ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18182025-03-01T01:16:23.521ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18192025-03-01T01:16:23.521ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2409 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = eb29403c-f66e-4bf5-abe7-c85213232830 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
18202025-03-01T01:16:23.522ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18212025-03-01T01:16:23.525ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18222025-03-01T01:16:23.525ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18232025-03-01T01:16:23.528ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
18242025-03-01T01:16:23.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
18252025-03-01T01:16:23.529ZINFOnexus (BackgroundTasks): VPC route manager sled 3471264f-127e-4a25-bc10-2e8249e8d70a push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
18262025-03-01T01:16:23.529ZDEBGnexus (BackgroundTasks): client request SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
18272025-03-01T01:16:23.530ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18282025-03-01T01:16:23.530ZDEBGnexus (BackgroundTasks): client response SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "ac9a5bcf-218f-4ffd-a4f5-22f5ab9c3617", "date": "Sat, 01 Mar 2025 01:16:23 GMT"} })
18292025-03-01T01:16:23.531ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
18302025-03-01T01:16:23.531ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
18312025-03-01T01:16:23.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
18322025-03-01T01:16:23.532ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 318.11168ms iteration = 4 status = {}
18332025-03-01T01:16:23.533ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18342025-03-01T01:16:23.534ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
18352025-03-01T01:16:23.534ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
18362025-03-01T01:16:23.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
18372025-03-01T01:16:23.566ZDEBGnexus (BackgroundTasks): client request SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
18382025-03-01T01:16:23.567ZDEBGnexus (BackgroundTasks): client response SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "7fc69a29-0691-4327-a9e1-1f00afcd9a4c", "content-length": "691", "date": "Sat, 01 Mar 2025 01:16:23 GMT"} })
18392025-03-01T01:16:23.567ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
18402025-03-01T01:16:23.567ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
18412025-03-01T01:16:23.567ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
18422025-03-01T01:16:23.567ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 353.577882ms iteration = 4 status = {}
18432025-03-01T01:16:23.581ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 original_time_created = 2025-03-01 01:14:50.436545 UTC target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 time_created = 2025-03-01 01:14:50.436545 UTC
18442025-03-01T01:16:23.581ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 367.656359ms iteration = 10 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7","time_created":"2025-03-01T01:14:50.436545Z"}
18452025-03-01T01:16:23.609ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
18462025-03-01T01:16:23.610ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "51fa4c1a-0969-4a79-bd55-713866801307", "content-length": "134", "date": "Sat, 01 Mar 2025 01:16:22 GMT"} })
18472025-03-01T01:16:23.610ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
18482025-03-01T01:16:23.610ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = cb10d0c6-a704-4231-b148-4f9ae21a03f8
18492025-03-01T01:16:23.610ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
18502025-03-01T01:16:23.610ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
18512025-03-01T01:16:23.610ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
18522025-03-01T01:16:23.610ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
18532025-03-01T01:16:23.610ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
18542025-03-01T01:16:23.610ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
18552025-03-01T01:16:23.610ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
18562025-03-01T01:16:23.610ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
18572025-03-01T01:16:23.610ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66
18582025-03-01T01:16:23.610ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18592025-03-01T01:16:23.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18602025-03-01T01:16:23.616ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
18612025-03-01T01:16:23.616ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "f87d30a7-1432-4c87-8deb-b4cf678952fb", "content-length": "2", "date": "Sat, 01 Mar 2025 01:16:22 GMT"} })
18622025-03-01T01:16:23.616ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
18632025-03-01T01:16:23.616ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "56bfc1cc-7162-4fa7-90ef-e67055005d50", "content-length": "52", "date": "Sat, 01 Mar 2025 01:16:22 GMT"} })
18642025-03-01T01:16:23.616ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 switch_location = Switch0
18652025-03-01T01:16:23.616ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
18662025-03-01T01:16:23.721ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "090dd0cb-cc14-451d-a526-73087491700b", "date": "Sat, 01 Mar 2025 01:16:23 GMT"} })
18672025-03-01T01:16:23.721ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 switch = Switch0
18682025-03-01T01:16:23.721ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
18692025-03-01T01:16:23.721ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "ab27432e-3c5b-4234-8afc-fd13a65b81f1", "content-length": "682", "date": "Sat, 01 Mar 2025 01:16:23 GMT"} })
18702025-03-01T01:16:23.721ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18712025-03-01T01:16:23.721ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18722025-03-01T01:16:23.724ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18732025-03-01T01:16:23.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18742025-03-01T01:16:23.833ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18752025-03-01T01:16:23.833ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18762025-03-01T01:16:23.836ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18772025-03-01T01:16:23.836ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18782025-03-01T01:16:23.844ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 630.632966ms iteration = 4 status = {}
18792025-03-01T01:16:24.540ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = da5f26cf-5a93-44d5-9854-a01a2be99219 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
18802025-03-01T01:16:24.540ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = da5f26cf-5a93-44d5-9854-a01a2be99219 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
18812025-03-01T01:16:24.542ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1995 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = da5f26cf-5a93-44d5-9854-a01a2be99219 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
18822025-03-01T01:16:25.562ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = da4b5ec7-b71a-4d9e-afb1-c6d4a7dad83f roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
18832025-03-01T01:16:25.563ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = da4b5ec7-b71a-4d9e-afb1-c6d4a7dad83f resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
18842025-03-01T01:16:25.564ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2144 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = da4b5ec7-b71a-4d9e-afb1-c6d4a7dad83f response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
18852025-03-01T01:16:26.585ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = a3cc1d87-788e-4a83-9668-eb0495f02433 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
18862025-03-01T01:16:26.585ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = a3cc1d87-788e-4a83-9668-eb0495f02433 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
18872025-03-01T01:16:26.588ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3331 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = a3cc1d87-788e-4a83-9668-eb0495f02433 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
18882025-03-01T01:16:27.415ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 489 local_addr = [fd00:1122:3344:101::c]:34357 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = 872605be-d154-4d9c-80be-ad5c047b5591 response_code = 200 uri = /67b03f4e-4cbd-4843-9cd9-647f610abcfc
18892025-03-01T01:16:27.607ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 71047851-40a0-4beb-b2a1-276030129acb roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
18902025-03-01T01:16:27.607ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 71047851-40a0-4beb-b2a1-276030129acb resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
18912025-03-01T01:16:27.610ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2832 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 71047851-40a0-4beb-b2a1-276030129acb response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
18922025-03-01T01:16:28.630ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = d524515f-5332-43a2-a4b4-442f267cf21d roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
18932025-03-01T01:16:28.630ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = d524515f-5332-43a2-a4b4-442f267cf21d resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
18942025-03-01T01:16:28.632ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2353 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = d524515f-5332-43a2-a4b4-442f267cf21d response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
18952025-03-01T01:16:29.651ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 461d837a-ba31-4544-96b7-3dece9202a38 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
18962025-03-01T01:16:29.651ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 461d837a-ba31-4544-96b7-3dece9202a38 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
18972025-03-01T01:16:29.652ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1782 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 461d837a-ba31-4544-96b7-3dece9202a38 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
18982025-03-01T01:16:30.671ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = d0c0d17e-ff46-40ca-91c7-60b5dc3af851 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
18992025-03-01T01:16:30.672ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = d0c0d17e-ff46-40ca-91c7-60b5dc3af851 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
19002025-03-01T01:16:30.673ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1968 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = d0c0d17e-ff46-40ca-91c7-60b5dc3af851 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
19012025-03-01T01:16:31.692ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 686454aa-74f1-41d5-892b-87bf85353745 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
19022025-03-01T01:16:31.692ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 686454aa-74f1-41d5-892b-87bf85353745 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
19032025-03-01T01:16:31.694ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1884 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 686454aa-74f1-41d5-892b-87bf85353745 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
19042025-03-01T01:16:32.713ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 9b10771c-bc6c-4562-8845-736155ab9b3b roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
19052025-03-01T01:16:32.713ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 9b10771c-bc6c-4562-8845-736155ab9b3b resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
19062025-03-01T01:16:32.715ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2455 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 9b10771c-bc6c-4562-8845-736155ab9b3b response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
19072025-03-01T01:16:33.214ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 11 reason = Timeout
19082025-03-01T01:16:33.214ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 11 reason = Timeout
19092025-03-01T01:16:33.214ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
19102025-03-01T01:16:33.215ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19112025-03-01T01:16:33.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
19122025-03-01T01:16:33.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19132025-03-01T01:16:33.216ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
19142025-03-01T01:16:33.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
19152025-03-01T01:16:33.217ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19162025-03-01T01:16:33.218ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.884769ms iteration = 11 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
19172025-03-01T01:16:33.220ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
19182025-03-01T01:16:33.220ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19192025-03-01T01:16:33.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19202025-03-01T01:16:33.222ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19212025-03-01T01:16:33.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19222025-03-01T01:16:33.224ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19232025-03-01T01:16:33.226ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7, lookup_type: ById(8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7) } result = Ok(())
19242025-03-01T01:16:33.226ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19252025-03-01T01:16:33.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19262025-03-01T01:16:33.234ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 original_time_created = 2025-03-01 01:14:50.436545 UTC target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 time_created = 2025-03-01 01:14:50.436545 UTC
19272025-03-01T01:16:33.234ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.281823ms iteration = 11 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7","time_created":"2025-03-01T01:14:50.436545Z"}
19282025-03-01T01:16:33.734ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = bd204706-0681-4b97-8406-119e6b2aa74d roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
19292025-03-01T01:16:33.735ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = bd204706-0681-4b97-8406-119e6b2aa74d resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
19302025-03-01T01:16:33.736ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1932 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = bd204706-0681-4b97-8406-119e6b2aa74d response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
19312025-03-01T01:16:34.757ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 628c2f12-943a-427c-b487-acc5405b7e66 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
19322025-03-01T01:16:34.758ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 628c2f12-943a-427c-b487-acc5405b7e66 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
19332025-03-01T01:16:34.760ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2519 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 628c2f12-943a-427c-b487-acc5405b7e66 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
19342025-03-01T01:16:35.782ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = fb9a5375-a496-45dd-8dc4-b2970dad42b9 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
19352025-03-01T01:16:35.782ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = fb9a5375-a496-45dd-8dc4-b2970dad42b9 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
19362025-03-01T01:16:35.784ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2266 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = fb9a5375-a496-45dd-8dc4-b2970dad42b9 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
19372025-03-01T01:16:36.803ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = e94288c8-4515-42e0-8202-9732a6eb360d roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
19382025-03-01T01:16:36.803ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = e94288c8-4515-42e0-8202-9732a6eb360d resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
19392025-03-01T01:16:36.805ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2162 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = e94288c8-4515-42e0-8202-9732a6eb360d response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
19402025-03-01T01:16:37.414ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 346 local_addr = [fd00:1122:3344:101::c]:34357 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = 36df3d88-1c82-487f-9df7-7a0ca20f6402 response_code = 200 uri = /67b03f4e-4cbd-4843-9cd9-647f610abcfc
19412025-03-01T01:16:37.826ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 0008f42c-088f-40f2-a8e2-09442aa6b56d roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
19422025-03-01T01:16:37.826ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 0008f42c-088f-40f2-a8e2-09442aa6b56d resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
19432025-03-01T01:16:37.828ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2736 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 0008f42c-088f-40f2-a8e2-09442aa6b56d response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
19442025-03-01T01:16:38.847ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 9a08864d-8836-48ca-9128-8759b0af729b roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
19452025-03-01T01:16:38.847ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 9a08864d-8836-48ca-9128-8759b0af729b resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
19462025-03-01T01:16:38.849ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2160 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 9a08864d-8836-48ca-9128-8759b0af729b response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
19472025-03-01T01:16:39.870ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c7eb76fe-b562-4805-9421-4f945d2b3d2f roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
19482025-03-01T01:16:39.870ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c7eb76fe-b562-4805-9421-4f945d2b3d2f resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
19492025-03-01T01:16:39.872ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2087 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c7eb76fe-b562-4805-9421-4f945d2b3d2f response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
19502025-03-01T01:16:40.893ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 4f47fec3-2265-48b5-be22-67dbe2502dbc roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
19512025-03-01T01:16:40.893ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 4f47fec3-2265-48b5-be22-67dbe2502dbc resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
19522025-03-01T01:16:40.895ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2426 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 4f47fec3-2265-48b5-be22-67dbe2502dbc response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
19532025-03-01T01:16:41.917ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 1a0f6e6d-d77d-462f-a18e-e3e08edae56f roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
19542025-03-01T01:16:41.917ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 1a0f6e6d-d77d-462f-a18e-e3e08edae56f resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
19552025-03-01T01:16:41.919ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2182 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 1a0f6e6d-d77d-462f-a18e-e3e08edae56f response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
19562025-03-01T01:16:42.938ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 3b7c262b-bc65-46d0-80de-86d11f11eb5b roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
19572025-03-01T01:16:42.938ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 3b7c262b-bc65-46d0-80de-86d11f11eb5b resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
19582025-03-01T01:16:42.941ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2512 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 3b7c262b-bc65-46d0-80de-86d11f11eb5b response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
19592025-03-01T01:16:43.214ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 12 reason = Timeout
19602025-03-01T01:16:43.214ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 12 reason = Timeout
19612025-03-01T01:16:43.214ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19622025-03-01T01:16:43.214ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
19632025-03-01T01:16:43.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
19642025-03-01T01:16:43.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19652025-03-01T01:16:43.216ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
19662025-03-01T01:16:43.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
19672025-03-01T01:16:43.217ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19682025-03-01T01:16:43.218ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.284437ms iteration = 12 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
19692025-03-01T01:16:43.219ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
19702025-03-01T01:16:43.219ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19712025-03-01T01:16:43.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19722025-03-01T01:16:43.221ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19732025-03-01T01:16:43.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19742025-03-01T01:16:43.222ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19752025-03-01T01:16:43.225ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7, lookup_type: ById(8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7) } result = Ok(())
19762025-03-01T01:16:43.225ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19772025-03-01T01:16:43.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19782025-03-01T01:16:43.236ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 original_time_created = 2025-03-01 01:14:50.436545 UTC target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 time_created = 2025-03-01 01:14:50.436545 UTC
19792025-03-01T01:16:43.236ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.358506ms iteration = 12 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7","time_created":"2025-03-01T01:14:50.436545Z"}
19802025-03-01T01:16:43.963ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 96647b8e-1ffc-435c-8657-b957e0fa41fe roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
19812025-03-01T01:16:43.963ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 96647b8e-1ffc-435c-8657-b957e0fa41fe resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
19822025-03-01T01:16:43.965ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2107 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 96647b8e-1ffc-435c-8657-b957e0fa41fe response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
19832025-03-01T01:16:44.987ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 5656ad8f-96b8-4854-bad5-122f74542c8a roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
19842025-03-01T01:16:44.987ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 5656ad8f-96b8-4854-bad5-122f74542c8a resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
19852025-03-01T01:16:44.989ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2581 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 5656ad8f-96b8-4854-bad5-122f74542c8a response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
19862025-03-01T01:16:46.011ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c23856ca-ff38-4725-bebe-153a4a1607ad roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
19872025-03-01T01:16:46.012ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c23856ca-ff38-4725-bebe-153a4a1607ad resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
19882025-03-01T01:16:46.014ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2435 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c23856ca-ff38-4725-bebe-153a4a1607ad response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
19892025-03-01T01:16:47.033ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 1194e99f-f32e-4374-afe8-31d62023f5be roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
19902025-03-01T01:16:47.034ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 1194e99f-f32e-4374-afe8-31d62023f5be resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
19912025-03-01T01:16:47.035ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2066 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 1194e99f-f32e-4374-afe8-31d62023f5be response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
19922025-03-01T01:16:47.414ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 317 local_addr = [fd00:1122:3344:101::c]:34357 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = 81372d93-471a-4498-b4cb-cc591536665e response_code = 200 uri = /67b03f4e-4cbd-4843-9cd9-647f610abcfc
19932025-03-01T01:16:48.056ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = a6954213-6f23-46e6-9893-70b214051555 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
19942025-03-01T01:16:48.056ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = a6954213-6f23-46e6-9893-70b214051555 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
19952025-03-01T01:16:48.058ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2435 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = a6954213-6f23-46e6-9893-70b214051555 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
19962025-03-01T01:16:49.078ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 43b42eb8-cf84-47dd-8ef2-bb6870049f39 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
19972025-03-01T01:16:49.078ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 43b42eb8-cf84-47dd-8ef2-bb6870049f39 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
19982025-03-01T01:16:49.080ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2703 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 43b42eb8-cf84-47dd-8ef2-bb6870049f39 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
19992025-03-01T01:16:50.099ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = ae60bf4c-b05f-46af-ad59-ad3ba7025e5e roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
20002025-03-01T01:16:50.100ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = ae60bf4c-b05f-46af-ad59-ad3ba7025e5e resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
20012025-03-01T01:16:50.102ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2542 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = ae60bf4c-b05f-46af-ad59-ad3ba7025e5e response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
20022025-03-01T01:16:51.123ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 1cd836d1-d9fe-409e-8778-89ff100d2252 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
20032025-03-01T01:16:51.123ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 1cd836d1-d9fe-409e-8778-89ff100d2252 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
20042025-03-01T01:16:51.125ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2056 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 1cd836d1-d9fe-409e-8778-89ff100d2252 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
20052025-03-01T01:16:52.145ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = acef7f56-04cd-4642-9747-9d28e7c24fde roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
20062025-03-01T01:16:52.146ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = acef7f56-04cd-4642-9747-9d28e7c24fde resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
20072025-03-01T01:16:52.147ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2220 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = acef7f56-04cd-4642-9747-9d28e7c24fde response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
20082025-03-01T01:16:52.407ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61177 req_id = 5b2cf4d7-7f77-4ec1-83d6-6feabb62cd35 roles = RoleSet { roles: {} } uri = /metrics/collectors/d77aa5d6-e6f9-4845-b1d4-57f91a3621e6/producers?sort_by=id_ascending
20092025-03-01T01:16:52.407ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61177 req_id = 5b2cf4d7-7f77-4ec1-83d6-6feabb62cd35 resource = Database result = Ok(()) uri = /metrics/collectors/d77aa5d6-e6f9-4845-b1d4-57f91a3621e6/producers?sort_by=id_ascending
20102025-03-01T01:16:52.410ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2845 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61177 req_id = 5b2cf4d7-7f77-4ec1-83d6-6feabb62cd35 response_code = 200 uri = /metrics/collectors/d77aa5d6-e6f9-4845-b1d4-57f91a3621e6/producers?sort_by=id_ascending
20112025-03-01T01:16:52.410ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61177 req_id = f9286c1e-bd74-4e5e-8612-5f1c8f98dbb7 roles = RoleSet { roles: {} } uri = /metrics/collectors/d77aa5d6-e6f9-4845-b1d4-57f91a3621e6/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYmI0ODUwMS0zYzRlLTRkNDQtODgyMy1mOTc1ZTg2OTFmZmYifX0%3D
20122025-03-01T01:16:52.410ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61177 req_id = f9286c1e-bd74-4e5e-8612-5f1c8f98dbb7 resource = Database result = Ok(()) uri = /metrics/collectors/d77aa5d6-e6f9-4845-b1d4-57f91a3621e6/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYmI0ODUwMS0zYzRlLTRkNDQtODgyMy1mOTc1ZTg2OTFmZmYifX0%3D
20132025-03-01T01:16:52.412ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2546 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61177 req_id = f9286c1e-bd74-4e5e-8612-5f1c8f98dbb7 response_code = 200 uri = /metrics/collectors/d77aa5d6-e6f9-4845-b1d4-57f91a3621e6/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYmI0ODUwMS0zYzRlLTRkNDQtODgyMy1mOTc1ZTg2OTFmZmYifX0%3D
20142025-03-01T01:16:53.166ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 61b67f73-4827-4f7e-b01f-e04a14216531 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
20152025-03-01T01:16:53.166ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 61b67f73-4827-4f7e-b01f-e04a14216531 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
20162025-03-01T01:16:53.168ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2366 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 61b67f73-4827-4f7e-b01f-e04a14216531 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
20172025-03-01T01:16:53.215ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 5 reason = Timeout
20182025-03-01T01:16:53.215ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 5 reason = Timeout
20192025-03-01T01:16:53.215ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 4 reason = Timeout
20202025-03-01T01:16:53.215ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
20212025-03-01T01:16:53.215ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7
20222025-03-01T01:16:53.215ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 11.04\u{b5}s iteration = 4 status = {"enabled":false,"target_id":"8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7"}
20232025-03-01T01:16:53.215ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 13 reason = Timeout
20242025-03-01T01:16:53.215ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20252025-03-01T01:16:53.215ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 5 reason = Timeout
20262025-03-01T01:16:53.215ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
20272025-03-01T01:16:53.215ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20282025-03-01T01:16:53.215ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 5 reason = Timeout
20292025-03-01T01:16:53.215ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 5 reason = Timeout
20302025-03-01T01:16:53.215ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
20312025-03-01T01:16:53.215ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 3 reason = Timeout
20322025-03-01T01:16:53.215ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20332025-03-01T01:16:53.215ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 3 reason = Timeout
20342025-03-01T01:16:53.215ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 3 reason = Timeout
20352025-03-01T01:16:53.215ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
20362025-03-01T01:16:53.215ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 3 reason = Timeout
20372025-03-01T01:16:53.215ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-03-01 01:06:53.215192137 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
20382025-03-01T01:16:53.215ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
20392025-03-01T01:16:53.215ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 5 reason = Timeout
20402025-03-01T01:16:53.215ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
20412025-03-01T01:16:53.215ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
20422025-03-01T01:16:53.215ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 5 reason = Timeout
20432025-03-01T01:16:53.215ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 5 reason = Timeout
20442025-03-01T01:16:53.215ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
20452025-03-01T01:16:53.215ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 3 reason = Timeout
20462025-03-01T01:16:53.215ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
20472025-03-01T01:16:53.215ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
20482025-03-01T01:16:53.215ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
20492025-03-01T01:16:53.215ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 5 reason = Timeout
20502025-03-01T01:16:53.215ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
20512025-03-01T01:16:53.215ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 5 reason = Timeout
20522025-03-01T01:16:53.215ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 5 reason = Timeout
20532025-03-01T01:16:53.215ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
20542025-03-01T01:16:53.215ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 3 reason = Timeout
20552025-03-01T01:16:53.215ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 3 reason = Timeout
20562025-03-01T01:16:53.215ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
20572025-03-01T01:16:53.215ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
20582025-03-01T01:16:53.215ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 5 reason = Timeout
20592025-03-01T01:16:53.215ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 6 reason = Timeout
20602025-03-01T01:16:53.215ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 5 reason = Timeout
20612025-03-01T01:16:53.215ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
20622025-03-01T01:16:53.215ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
20632025-03-01T01:16:53.215ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 5 reason = Timeout
20642025-03-01T01:16:53.215ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
20652025-03-01T01:16:53.215ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 13 reason = Timeout
20662025-03-01T01:16:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20672025-03-01T01:16:53.215ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
20682025-03-01T01:16:53.215ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 5 reason = Timeout
20692025-03-01T01:16:53.215ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
20702025-03-01T01:16:53.215ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 5 reason = Timeout
20712025-03-01T01:16:53.215ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 3 reason = Timeout
20722025-03-01T01:16:53.215ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
20732025-03-01T01:16:53.215ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
20742025-03-01T01:16:53.215ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 3 reason = Timeout
20752025-03-01T01:16:53.215ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
20762025-03-01T01:16:53.215ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
20772025-03-01T01:16:53.215ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 3 reason = Timeout
20782025-03-01T01:16:53.215ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
20792025-03-01T01:16:53.215ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
20802025-03-01T01:16:53.215ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 5 reason = Timeout
20812025-03-01T01:16:53.215ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
20822025-03-01T01:16:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
20832025-03-01T01:16:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20842025-03-01T01:16:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20852025-03-01T01:16:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
20862025-03-01T01:16:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
20872025-03-01T01:16:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
20882025-03-01T01:16:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
20892025-03-01T01:16:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
20902025-03-01T01:16:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
20912025-03-01T01:16:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
20922025-03-01T01:16:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
20932025-03-01T01:16:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
20942025-03-01T01:16:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
20952025-03-01T01:16:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
20962025-03-01T01:16:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
20972025-03-01T01:16:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
20982025-03-01T01:16:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
20992025-03-01T01:16:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
21002025-03-01T01:16:53.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
21012025-03-01T01:16:53.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
21022025-03-01T01:16:53.216ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("3a9b8294-d9f3-4130-a669-e74c6f1f65a0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("450e8d93-9ed3-4721-9fe9-42521f60bc93.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a4f72c78-99c6-478d-b490-f7d8793d4173.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("a4f72c78-99c6-478d-b490-f7d8793d4173.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1023, tv_nsec: 903491608 } })
21032025-03-01T01:16:53.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
21042025-03-01T01:16:53.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
21052025-03-01T01:16:53.216ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2e37f4af-57dc-468e-80e3-cf2aea2ffdc8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5f6eb3bd-0126-40e0-98ef-ee33df084158.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("5f6eb3bd-0126-40e0-98ef-ee33df084158.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1023, tv_nsec: 903574560 } })
21062025-03-01T01:16:53.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
21072025-03-01T01:16:53.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
21082025-03-01T01:16:53.216ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
21092025-03-01T01:16:53.216ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.45851ms iteration = 3 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
21102025-03-01T01:16:53.216ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
21112025-03-01T01:16:53.216ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.500921ms iteration = 3 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
21122025-03-01T01:16:53.217ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21132025-03-01T01:16:53.219ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21142025-03-01T01:16:53.219ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1023, tv_nsec: 907069931 } })
21152025-03-01T01:16:53.219ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.353298ms iteration = 5 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
21162025-03-01T01:16:53.219ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21172025-03-01T01:16:53.219ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1154
21182025-03-01T01:16:53.221ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
21192025-03-01T01:16:53.221ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21202025-03-01T01:16:53.221ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
21212025-03-01T01:16:53.221ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
21222025-03-01T01:16:53.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21232025-03-01T01:16:53.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
21242025-03-01T01:16:53.222ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
21252025-03-01T01:16:53.222ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
21262025-03-01T01:16:53.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
21272025-03-01T01:16:53.223ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21282025-03-01T01:16:53.223ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
21292025-03-01T01:16:53.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
21302025-03-01T01:16:53.224ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-03-01 01:06:53.215192137 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
21312025-03-01T01:16:53.224ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 9.039674ms iteration = 3 status = {"expiration":"2025-03-01T01:06:53.215192137Z","pruned":[]}
21322025-03-01T01:16:53.224ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1023, tv_nsec: 912178805 } })
21332025-03-01T01:16:53.224ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
21342025-03-01T01:16:53.224ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1154
21352025-03-01T01:16:53.224ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
21362025-03-01T01:16:53.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
21372025-03-01T01:16:53.225ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
21382025-03-01T01:16:53.225ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
21392025-03-01T01:16:53.225ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
21402025-03-01T01:16:53.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
21412025-03-01T01:16:53.227ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 11.876942ms iteration = 5 status = {"errors":[],"finish_invoked_ok":[]}
21422025-03-01T01:16:53.227ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21432025-03-01T01:16:53.227ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21442025-03-01T01:16:53.228ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
21452025-03-01T01:16:53.228ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
21462025-03-01T01:16:53.229ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
21472025-03-01T01:16:53.229ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
21482025-03-01T01:16:53.229ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 14.002255ms iteration = 3 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
21492025-03-01T01:16:53.229ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 14.2057ms iteration = 3 status = {"errors":[],"found_port_ok":[]}
21502025-03-01T01:16:53.230ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
21512025-03-01T01:16:53.230ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
21522025-03-01T01:16:53.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
21532025-03-01T01:16:53.231ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
21542025-03-01T01:16:53.231ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
21552025-03-01T01:16:53.231ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
21562025-03-01T01:16:53.232ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
21572025-03-01T01:16:53.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
21582025-03-01T01:16:53.234ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21592025-03-01T01:16:53.235ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21602025-03-01T01:16:53.236ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21612025-03-01T01:16:53.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21622025-03-01T01:16:53.237ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
21632025-03-01T01:16:53.237ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
21642025-03-01T01:16:53.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
21652025-03-01T01:16:53.237ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
21662025-03-01T01:16:53.237ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
21672025-03-01T01:16:53.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
21682025-03-01T01:16:53.239ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21692025-03-01T01:16:53.239ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1023, tv_nsec: 927379535 } })
21702025-03-01T01:16:53.240ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1154 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66
21712025-03-01T01:16:53.241ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
21722025-03-01T01:16:53.243ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
21732025-03-01T01:16:53.243ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
21742025-03-01T01:16:53.243ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
21752025-03-01T01:16:53.243ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
21762025-03-01T01:16:53.243ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
21772025-03-01T01:16:53.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
21782025-03-01T01:16:53.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
21792025-03-01T01:16:53.243ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
21802025-03-01T01:16:53.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
21812025-03-01T01:16:53.244ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21822025-03-01T01:16:53.244ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
21832025-03-01T01:16:53.245ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
21842025-03-01T01:16:53.245ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 30.026452ms iteration = 5 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
21852025-03-01T01:16:53.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
21862025-03-01T01:16:53.246ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21872025-03-01T01:16:53.247ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21882025-03-01T01:16:53.248ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
21892025-03-01T01:16:53.249ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7, lookup_type: ById(8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7) } result = Ok(())
21902025-03-01T01:16:53.249ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21912025-03-01T01:16:53.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21922025-03-01T01:16:53.251ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
21932025-03-01T01:16:53.251ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
21942025-03-01T01:16:53.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
21952025-03-01T01:16:53.270ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
21962025-03-01T01:16:53.270ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
21972025-03-01T01:16:53.271ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 original_time_created = 2025-03-01 01:14:50.436545 UTC target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 time_created = 2025-03-01 01:14:50.436545 UTC
21982025-03-01T01:16:53.271ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 56.766806ms iteration = 13 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7","time_created":"2025-03-01T01:14:50.436545Z"}
21992025-03-01T01:16:53.280ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22002025-03-01T01:16:53.281ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
22012025-03-01T01:16:53.282ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
22022025-03-01T01:16:53.282ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
22032025-03-01T01:16:53.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
22042025-03-01T01:16:53.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
22052025-03-01T01:16:53.282ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
22062025-03-01T01:16:53.282ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
22072025-03-01T01:16:53.282ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
22082025-03-01T01:16:53.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
22092025-03-01T01:16:53.284ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 68.706659ms iteration = 13 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
22102025-03-01T01:16:53.284ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
22112025-03-01T01:16:53.284ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22122025-03-01T01:16:53.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
22132025-03-01T01:16:53.286ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 70.805093ms iteration = 5 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
22142025-03-01T01:16:53.287ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
22152025-03-01T01:16:53.287ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
22162025-03-01T01:16:53.287ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
22172025-03-01T01:16:53.291ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 76.099331ms iteration = 5 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
22182025-03-01T01:16:53.291ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
22192025-03-01T01:16:53.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
22202025-03-01T01:16:53.294ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22212025-03-01T01:16:53.295ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
22222025-03-01T01:16:53.295ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 0a9e4b5c-53a1-4f0a-8849-98a8b1852af3 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
22232025-03-01T01:16:53.295ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
22242025-03-01T01:16:53.295ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
22252025-03-01T01:16:53.296ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
22262025-03-01T01:16:53.296ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
22272025-03-01T01:16:53.296ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
22282025-03-01T01:16:53.300ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
22292025-03-01T01:16:53.300ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
22302025-03-01T01:16:53.300ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
22312025-03-01T01:16:53.300ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
22322025-03-01T01:16:53.300ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
22332025-03-01T01:16:53.305ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
22342025-03-01T01:16:53.305ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
22352025-03-01T01:16:53.305ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 90.32217ms iteration = 3 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
22362025-03-01T01:16:53.306ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
22372025-03-01T01:16:53.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
22382025-03-01T01:16:53.311ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 96.191849ms iteration = 5 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
22392025-03-01T01:16:53.323ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
22402025-03-01T01:16:53.323ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
22412025-03-01T01:16:53.323ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 108.45873ms iteration = 5 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
22422025-03-01T01:16:53.335ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
22432025-03-01T01:16:53.343ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
22442025-03-01T01:16:53.343ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
22452025-03-01T01:16:53.375ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
22462025-03-01T01:16:53.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
22472025-03-01T01:16:53.376ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
22482025-03-01T01:16:53.387ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
22492025-03-01T01:16:53.387ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
22502025-03-01T01:16:53.387ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b0fe8ca6-688f-46fb-b9ce-d69ef407c347", "content-length": "26", "date": "Sat, 01 Mar 2025 01:16:53 GMT"} })
22512025-03-01T01:16:53.387ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
22522025-03-01T01:16:53.388ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 173.072245ms iteration = 5 status = {"errors":[],"garbage_collect_requested":[]}
22532025-03-01T01:16:53.389ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
22542025-03-01T01:16:53.482ZINFOnexus (BackgroundTasks): VPC route manager sled 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
22552025-03-01T01:16:53.482ZDEBGnexus (BackgroundTasks): client request SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
22562025-03-01T01:16:53.482ZDEBGnexus (BackgroundTasks): client response SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "3ba3f0b0-f0d7-47a4-811c-71d621a82f23", "content-length": "372", "date": "Sat, 01 Mar 2025 01:16:53 GMT"} })
22572025-03-01T01:16:53.482ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
22582025-03-01T01:16:53.483ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
22592025-03-01T01:16:53.484ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
22602025-03-01T01:16:53.485ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
22612025-03-01T01:16:53.485ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22622025-03-01T01:16:53.487ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22632025-03-01T01:16:53.490ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
22642025-03-01T01:16:53.490ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
22652025-03-01T01:16:53.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
22662025-03-01T01:16:53.491ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
22672025-03-01T01:16:53.491ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
22682025-03-01T01:16:53.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
22692025-03-01T01:16:53.492ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22702025-03-01T01:16:53.495ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
22712025-03-01T01:16:53.495ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
22722025-03-01T01:16:53.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
22732025-03-01T01:16:53.497ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22742025-03-01T01:16:53.498ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
22752025-03-01T01:16:53.499ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
22762025-03-01T01:16:53.501ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
22772025-03-01T01:16:53.501ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
22782025-03-01T01:16:53.501ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
22792025-03-01T01:16:53.519ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 0a9e4b5c-53a1-4f0a-8849-98a8b1852af3 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
22802025-03-01T01:16:53.519ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
22812025-03-01T01:16:53.519ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-03-01 01:14:53.460216 UTC dns_group = internal generation = 1
22822025-03-01T01:16:53.519ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 303.796878ms iteration = 3 status = {"generation":1}
22832025-03-01T01:16:53.524ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 309.621297ms iteration = 5 status = {}
22842025-03-01T01:16:53.526ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
22852025-03-01T01:16:53.527ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
22862025-03-01T01:16:53.527ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "fe52cf7e-7b9e-4590-8dda-eeeaa9dcf8cb", "content-length": "26", "date": "Sat, 01 Mar 2025 01:16:53 GMT"} })
22872025-03-01T01:16:53.527ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
22882025-03-01T01:16:53.528ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
22892025-03-01T01:16:53.529ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "b0e7d704-1ed4-4c16-994e-d9f762e44cb9", "date": "Sat, 01 Mar 2025 01:16:53 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
22902025-03-01T01:16:53.529ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
22912025-03-01T01:16:53.529ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
22922025-03-01T01:16:53.529ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1162 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 zone_address = fd00:1122:3344:101::2
22932025-03-01T01:16:53.529ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
22942025-03-01T01:16:53.530ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e610d8e7-37e6-428f-9513-bcb6e80943d3", "content-length": "26", "date": "Sat, 01 Mar 2025 01:16:53 GMT"} })
22952025-03-01T01:16:53.530ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1167 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
22962025-03-01T01:16:53.531ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "e1757efe-6281-427a-8ac9-5423b05910ab", "date": "Sat, 01 Mar 2025 01:16:53 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
22972025-03-01T01:16:53.531ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
22982025-03-01T01:16:53.532ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66
22992025-03-01T01:16:53.533ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
23002025-03-01T01:16:53.533ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 318.462527ms iteration = 5 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
23012025-03-01T01:16:53.549ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
23022025-03-01T01:16:53.549ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = cce65e3e-6c86-4cdd-98ad-9a38c98082e8 dns_zone_name = oxide.test found_so_far = 0 version = 2
23032025-03-01T01:16:53.549ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
23042025-03-01T01:16:53.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
23052025-03-01T01:16:53.551ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23062025-03-01T01:16:53.553ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23072025-03-01T01:16:53.556ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
23082025-03-01T01:16:53.556ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
23092025-03-01T01:16:53.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
23102025-03-01T01:16:53.557ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
23112025-03-01T01:16:53.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
23122025-03-01T01:16:53.558ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 3471264f-127e-4a25-bc10-2e8249e8d70a, lookup_type: ById(3471264f-127e-4a25-bc10-2e8249e8d70a) } result = Ok(())
23132025-03-01T01:16:53.558ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
23142025-03-01T01:16:53.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
23152025-03-01T01:16:53.559ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23162025-03-01T01:16:53.561ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 345.788623ms iteration = 5 status = 0
23172025-03-01T01:16:53.561ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
23182025-03-01T01:16:53.562ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
23192025-03-01T01:16:53.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
23202025-03-01T01:16:53.562ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
23212025-03-01T01:16:53.586ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
23222025-03-01T01:16:53.586ZDEBGnexus (BackgroundTasks): client request SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
23232025-03-01T01:16:53.586ZDEBGnexus (BackgroundTasks): client response SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "f8461343-b58d-4096-80cd-0d3976aab881", "date": "Sat, 01 Mar 2025 01:16:53 GMT"} })
23242025-03-01T01:16:53.586ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
23252025-03-01T01:16:53.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
23262025-03-01T01:16:53.589ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
23272025-03-01T01:16:53.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
23282025-03-01T01:16:53.591ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
23292025-03-01T01:16:53.591ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
23302025-03-01T01:16:53.596ZINFOnexus (BackgroundTasks): VPC route manager sled 3471264f-127e-4a25-bc10-2e8249e8d70a push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
23312025-03-01T01:16:53.596ZDEBGnexus (BackgroundTasks): client request SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
23322025-03-01T01:16:53.596ZDEBGnexus (BackgroundTasks): client response SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "bb877cc1-ee14-476b-b2f1-1ee074f98d1f", "date": "Sat, 01 Mar 2025 01:16:53 GMT"} })
23332025-03-01T01:16:53.597ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 382.744557ms iteration = 5 status = {}
23342025-03-01T01:16:53.602ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-03-01T01:14:49.537343Z, time_modified: 2025-03-01T01:14:49.537343Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 1682a303-6254-452b-b4cf-160ed9dc3fc9, db_silo: Silo { identity: SiloIdentity { id: 1682a303-6254-452b-b4cf-160ed9dc3fc9, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-03-01T01:14:54.631650Z, time_modified: 2025-03-01T01:14:54.631650Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "851c0b739689cfb98a2e401e6047fa98e9fcc283d9fc3f660bd69842a9c06be9" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 1682a303-6254-452b-b4cf-160ed9dc3fc9, db_silo: Silo { identity: SiloIdentity { id: 1682a303-6254-452b-b4cf-160ed9dc3fc9, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-03-01T01:14:54.631650Z, time_modified: 2025-03-01T01:14:54.631650Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "851c0b739689cfb98a2e401e6047fa98e9fcc283d9fc3f660bd69842a9c06be9" }] }) }
23352025-03-01T01:16:53.602ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 387.224378ms iteration = 3 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"1682a303-6254-452b-b4cf-160ed9dc3fc9","tls_certs":["851c0b739689cfb98a2e401e6047fa98e9fcc283d9fc3f660bd69842a9c06be9"]}},"default_endpoint":{"silo_id":"1682a303-6254-452b-b4cf-160ed9dc3fc9","tls_certs":["851c0b739689cfb98a2e401e6047fa98e9fcc283d9fc3f660bd69842a9c06be9"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
23362025-03-01T01:16:53.610ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
23372025-03-01T01:16:53.610ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "c3f9d2ad-fbb4-49d1-900e-38dacd254698", "content-length": "2", "date": "Sat, 01 Mar 2025 01:16:52 GMT"} })
23382025-03-01T01:16:53.612ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
23392025-03-01T01:16:53.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
23402025-03-01T01:16:53.614ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 399.712252ms iteration = 5 status = null
23412025-03-01T01:16:53.619ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
23422025-03-01T01:16:53.619ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 404.52157ms iteration = 3 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
23432025-03-01T01:16:53.623ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
23442025-03-01T01:16:53.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
23452025-03-01T01:16:53.625ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23462025-03-01T01:16:53.626ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 411.052123ms iteration = 6 status = {"physical_disks_added":0}
23472025-03-01T01:16:53.627ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
23482025-03-01T01:16:53.627ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
23492025-03-01T01:16:53.628ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
23502025-03-01T01:16:53.631ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
23512025-03-01T01:16:53.632ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "711e92b4-ddd8-4d6e-879c-6984ea7b4045", "date": "Sat, 01 Mar 2025 01:16:53 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
23522025-03-01T01:16:53.632ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
23532025-03-01T01:16:53.633ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "b12bec91-f3da-4a8a-800f-3cb6cb500c82", "date": "Sat, 01 Mar 2025 01:16:53 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
23542025-03-01T01:16:53.633ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
23552025-03-01T01:16:53.635ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "8f302ce2-453a-433e-bd85-87ccab8a4577", "date": "Sat, 01 Mar 2025 01:16:53 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
23562025-03-01T01:16:53.635ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
23572025-03-01T01:16:53.637ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
23582025-03-01T01:16:53.637ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 422.277982ms iteration = 5 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
23592025-03-01T01:16:53.639ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
23602025-03-01T01:16:53.639ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 424.089799ms iteration = 5 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
23612025-03-01T01:16:53.653ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = cce65e3e-6c86-4cdd-98ad-9a38c98082e8 dns_zone_name = oxide.test found_so_far = 1 version = 2
23622025-03-01T01:16:53.653ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
23632025-03-01T01:16:53.653ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-03-01 01:14:54.679503 UTC dns_group = external generation = 2
23642025-03-01T01:16:53.653ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 438.073674ms iteration = 3 status = {"generation":2}
23652025-03-01T01:16:53.656ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23662025-03-01T01:16:53.658ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
23672025-03-01T01:16:53.658ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
23682025-03-01T01:16:53.658ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
23692025-03-01T01:16:53.680ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
23702025-03-01T01:16:53.681ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
23712025-03-01T01:16:53.682ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 7f9c3c14-58c5-473f-8692-6376be44401e, rack_id: 4854cb88-dfba-4609-8f9d-72aac08cef66, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(cb10d0c6-a704-4231-b148-4f9ae21a03f8) } rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 switch_location = Switch0
23722025-03-01T01:16:53.682ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
23732025-03-01T01:16:53.682ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
23742025-03-01T01:16:53.745ZDEBGnexus (BackgroundTasks): client request SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
23752025-03-01T01:16:53.745ZDEBGnexus (BackgroundTasks): client response SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "1ea9d7a1-8b54-4cc5-8ee8-0c2c066404f2", "content-length": "691", "date": "Sat, 01 Mar 2025 01:16:53 GMT"} })
23762025-03-01T01:16:53.745ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
23772025-03-01T01:16:53.745ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
23782025-03-01T01:16:53.745ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
23792025-03-01T01:16:53.746ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 531.119679ms iteration = 5 status = {}
23802025-03-01T01:16:53.832ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
23812025-03-01T01:16:53.833ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "3f5a2b2e-ce64-4e7e-b3af-7fdd211657af", "content-length": "134", "date": "Sat, 01 Mar 2025 01:16:52 GMT"} })
23822025-03-01T01:16:53.833ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
23832025-03-01T01:16:53.833ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = cb10d0c6-a704-4231-b148-4f9ae21a03f8
23842025-03-01T01:16:53.833ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
23852025-03-01T01:16:53.833ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
23862025-03-01T01:16:53.833ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
23872025-03-01T01:16:53.833ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
23882025-03-01T01:16:53.833ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
23892025-03-01T01:16:53.833ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
23902025-03-01T01:16:53.833ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
23912025-03-01T01:16:53.833ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
23922025-03-01T01:16:53.834ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66
23932025-03-01T01:16:53.834ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
23942025-03-01T01:16:53.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
23952025-03-01T01:16:53.836ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
23962025-03-01T01:16:53.836ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "8bd66b3d-f3ae-4a5e-bc9a-819d98aa3341", "content-length": "2", "date": "Sat, 01 Mar 2025 01:16:52 GMT"} })
23972025-03-01T01:16:53.836ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
23982025-03-01T01:16:53.836ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "1119eae6-1e05-4031-a0c4-8b679a9efbe5", "content-length": "52", "date": "Sat, 01 Mar 2025 01:16:52 GMT"} })
23992025-03-01T01:16:53.836ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 switch_location = Switch0
24002025-03-01T01:16:53.836ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
24012025-03-01T01:16:53.941ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "3b928a2d-1ac0-4ae8-8897-54e415e9dd54", "date": "Sat, 01 Mar 2025 01:16:53 GMT"} })
24022025-03-01T01:16:53.941ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 switch = Switch0
24032025-03-01T01:16:53.941ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
24042025-03-01T01:16:53.941ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "1ca117f0-b410-4ada-8f3d-cda0217a3f64", "content-length": "682", "date": "Sat, 01 Mar 2025 01:16:53 GMT"} })
24052025-03-01T01:16:53.941ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24062025-03-01T01:16:53.942ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24072025-03-01T01:16:53.946ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24082025-03-01T01:16:53.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24092025-03-01T01:16:53.954ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24102025-03-01T01:16:53.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24112025-03-01T01:16:53.956ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24122025-03-01T01:16:53.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24132025-03-01T01:16:54.062ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 847.025885ms iteration = 5 status = {}
24142025-03-01T01:16:54.189ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 6de1edc2-c0a5-4b22-b1c7-b01575a96207 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
24152025-03-01T01:16:54.189ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 6de1edc2-c0a5-4b22-b1c7-b01575a96207 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
24162025-03-01T01:16:54.192ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2610 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 6de1edc2-c0a5-4b22-b1c7-b01575a96207 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
24172025-03-01T01:16:55.209ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = af460fc0-dea2-484f-b0f1-accafbc88244 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
24182025-03-01T01:16:55.209ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = af460fc0-dea2-484f-b0f1-accafbc88244 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
24192025-03-01T01:16:55.211ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2517 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = af460fc0-dea2-484f-b0f1-accafbc88244 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
24202025-03-01T01:16:56.230ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 4d0ef441-153f-4fd5-842a-ff93f1520332 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
24212025-03-01T01:16:56.231ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 4d0ef441-153f-4fd5-842a-ff93f1520332 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
24222025-03-01T01:16:56.233ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2779 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 4d0ef441-153f-4fd5-842a-ff93f1520332 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
24232025-03-01T01:16:57.252ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = e78a2f47-0676-4df8-b52f-7ed36114168c roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
24242025-03-01T01:16:57.252ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = e78a2f47-0676-4df8-b52f-7ed36114168c resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
24252025-03-01T01:16:57.254ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2765 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = e78a2f47-0676-4df8-b52f-7ed36114168c response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
24262025-03-01T01:16:57.415ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 396 local_addr = [fd00:1122:3344:101::c]:34357 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = 1278babe-a902-41e6-8ae0-babfafcc736a response_code = 200 uri = /67b03f4e-4cbd-4843-9cd9-647f610abcfc
24272025-03-01T01:16:58.274ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 7f7abf70-3144-4231-88d2-3c9ab20b49de roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
24282025-03-01T01:16:58.274ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 7f7abf70-3144-4231-88d2-3c9ab20b49de resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
24292025-03-01T01:16:58.276ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2746 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 7f7abf70-3144-4231-88d2-3c9ab20b49de response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
24302025-03-01T01:16:59.295ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 850dbb45-2865-46de-9e3d-edcdaea0496b roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
24312025-03-01T01:16:59.296ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 850dbb45-2865-46de-9e3d-edcdaea0496b resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
24322025-03-01T01:16:59.297ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2245 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 850dbb45-2865-46de-9e3d-edcdaea0496b response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
24332025-03-01T01:17:00.319ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 9e2af882-c9e8-4fe9-b433-c73c913b2f71 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
24342025-03-01T01:17:00.319ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 9e2af882-c9e8-4fe9-b433-c73c913b2f71 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
24352025-03-01T01:17:00.321ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2164 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 9e2af882-c9e8-4fe9-b433-c73c913b2f71 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
24362025-03-01T01:17:01.339ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 1d0a89b4-2197-42a3-8ddb-27db6e86b8ea roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
24372025-03-01T01:17:01.339ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 1d0a89b4-2197-42a3-8ddb-27db6e86b8ea resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
24382025-03-01T01:17:01.341ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1595 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 1d0a89b4-2197-42a3-8ddb-27db6e86b8ea response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
24392025-03-01T01:17:02.360ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 00c37eb8-7224-4fc5-a8b3-4a3ec135ae95 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
24402025-03-01T01:17:02.360ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 00c37eb8-7224-4fc5-a8b3-4a3ec135ae95 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
24412025-03-01T01:17:02.362ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2333 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 00c37eb8-7224-4fc5-a8b3-4a3ec135ae95 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
24422025-03-01T01:17:03.214ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 14 reason = Timeout
24432025-03-01T01:17:03.214ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 14 reason = Timeout
24442025-03-01T01:17:03.214ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24452025-03-01T01:17:03.214ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
24462025-03-01T01:17:03.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24472025-03-01T01:17:03.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
24482025-03-01T01:17:03.244ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
24492025-03-01T01:17:03.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
24502025-03-01T01:17:03.251ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24512025-03-01T01:17:03.254ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
24522025-03-01T01:17:03.254ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24532025-03-01T01:17:03.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24542025-03-01T01:17:03.256ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24552025-03-01T01:17:03.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24562025-03-01T01:17:03.258ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24572025-03-01T01:17:03.261ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7, lookup_type: ById(8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7) } result = Ok(())
24582025-03-01T01:17:03.261ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24592025-03-01T01:17:03.261ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24602025-03-01T01:17:03.273ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 original_time_created = 2025-03-01 01:14:50.436545 UTC target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 time_created = 2025-03-01 01:14:50.436545 UTC
24612025-03-01T01:17:03.273ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 58.41476ms iteration = 14 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7","time_created":"2025-03-01T01:14:50.436545Z"}
24622025-03-01T01:17:03.273ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 58.521562ms iteration = 14 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
24632025-03-01T01:17:03.385ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 608bb042-89d8-4b50-bbe8-94aa1ddcb262 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
24642025-03-01T01:17:03.385ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 608bb042-89d8-4b50-bbe8-94aa1ddcb262 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
24652025-03-01T01:17:03.387ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2001 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 608bb042-89d8-4b50-bbe8-94aa1ddcb262 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
24662025-03-01T01:17:04.407ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 4d417d10-4037-405a-8d1a-bb74b19a9ee3 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
24672025-03-01T01:17:04.407ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 4d417d10-4037-405a-8d1a-bb74b19a9ee3 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
24682025-03-01T01:17:04.409ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2202 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 4d417d10-4037-405a-8d1a-bb74b19a9ee3 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
24692025-03-01T01:17:05.428ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 5cb1596c-527b-4a9f-8643-5e92a55ea954 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
24702025-03-01T01:17:05.429ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 5cb1596c-527b-4a9f-8643-5e92a55ea954 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
24712025-03-01T01:17:05.430ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2156 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 5cb1596c-527b-4a9f-8643-5e92a55ea954 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
24722025-03-01T01:17:06.449ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 8dd63f28-de49-4189-bc78-30099cdf25cc roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
24732025-03-01T01:17:06.450ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 8dd63f28-de49-4189-bc78-30099cdf25cc resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
24742025-03-01T01:17:06.452ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2444 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 8dd63f28-de49-4189-bc78-30099cdf25cc response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
24752025-03-01T01:17:07.414ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 327 local_addr = [fd00:1122:3344:101::c]:34357 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = be659b56-23ba-477c-a224-79d7183fd43b response_code = 200 uri = /67b03f4e-4cbd-4843-9cd9-647f610abcfc
24762025-03-01T01:17:07.471ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 0e3525ac-339e-498c-b700-8f8df623080a roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
24772025-03-01T01:17:07.471ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 0e3525ac-339e-498c-b700-8f8df623080a resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
24782025-03-01T01:17:07.473ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2266 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 0e3525ac-339e-498c-b700-8f8df623080a response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
24792025-03-01T01:17:08.495ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 3dec75cd-bb0d-4a2d-995e-2761fe4ca6bc roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
24802025-03-01T01:17:08.495ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 3dec75cd-bb0d-4a2d-995e-2761fe4ca6bc resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
24812025-03-01T01:17:08.497ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2296 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 3dec75cd-bb0d-4a2d-995e-2761fe4ca6bc response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
24822025-03-01T01:17:09.517ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = b5f33849-85f7-490a-a931-de0793a317ee roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
24832025-03-01T01:17:09.517ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = b5f33849-85f7-490a-a931-de0793a317ee resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
24842025-03-01T01:17:09.519ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2532 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = b5f33849-85f7-490a-a931-de0793a317ee response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
24852025-03-01T01:17:10.539ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = adbe88e4-0309-43ed-8025-d3217cbc5286 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
24862025-03-01T01:17:10.539ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = adbe88e4-0309-43ed-8025-d3217cbc5286 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
24872025-03-01T01:17:10.541ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2114 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = adbe88e4-0309-43ed-8025-d3217cbc5286 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
24882025-03-01T01:17:11.561ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 181b553e-f9f8-4279-86f1-84c7f1410cf2 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
24892025-03-01T01:17:11.561ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 181b553e-f9f8-4279-86f1-84c7f1410cf2 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
24902025-03-01T01:17:11.563ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2014 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 181b553e-f9f8-4279-86f1-84c7f1410cf2 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
24912025-03-01T01:17:12.583ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 9df329f4-1052-48d2-a37f-8b624d458a4d roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
24922025-03-01T01:17:12.584ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 9df329f4-1052-48d2-a37f-8b624d458a4d resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
24932025-03-01T01:17:12.585ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2196 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 9df329f4-1052-48d2-a37f-8b624d458a4d response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
24942025-03-01T01:17:13.214ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 15 reason = Timeout
24952025-03-01T01:17:13.214ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
24962025-03-01T01:17:13.214ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 15 reason = Timeout
24972025-03-01T01:17:13.214ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24982025-03-01T01:17:13.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
24992025-03-01T01:17:13.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25002025-03-01T01:17:13.216ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
25012025-03-01T01:17:13.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
25022025-03-01T01:17:13.249ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 35.264668ms iteration = 15 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
25032025-03-01T01:17:13.250ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25042025-03-01T01:17:13.252ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
25052025-03-01T01:17:13.252ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25062025-03-01T01:17:13.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25072025-03-01T01:17:13.255ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25082025-03-01T01:17:13.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25092025-03-01T01:17:13.257ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25102025-03-01T01:17:13.259ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7, lookup_type: ById(8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7) } result = Ok(())
25112025-03-01T01:17:13.259ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25122025-03-01T01:17:13.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25132025-03-01T01:17:13.378ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 original_time_created = 2025-03-01 01:14:50.436545 UTC target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 time_created = 2025-03-01 01:14:50.436545 UTC
25142025-03-01T01:17:13.378ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 164.362398ms iteration = 15 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7","time_created":"2025-03-01T01:14:50.436545Z"}
25152025-03-01T01:17:13.605ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 37366e73-e593-44f2-b649-6214644b4183 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
25162025-03-01T01:17:13.606ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 37366e73-e593-44f2-b649-6214644b4183 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
25172025-03-01T01:17:13.607ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2074 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 37366e73-e593-44f2-b649-6214644b4183 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
25182025-03-01T01:17:14.628ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 12ea8304-dad8-4616-aa2d-a43a14f051ca roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
25192025-03-01T01:17:14.628ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 12ea8304-dad8-4616-aa2d-a43a14f051ca resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
25202025-03-01T01:17:14.629ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1893 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 12ea8304-dad8-4616-aa2d-a43a14f051ca response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
25212025-03-01T01:17:15.648ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 3def074c-7996-4b9c-8bbe-e28019e0f849 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
25222025-03-01T01:17:15.649ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 3def074c-7996-4b9c-8bbe-e28019e0f849 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
25232025-03-01T01:17:15.651ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2612 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 3def074c-7996-4b9c-8bbe-e28019e0f849 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
25242025-03-01T01:17:16.669ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 812a4571-8e87-4112-b85c-5492bd7fec37 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
25252025-03-01T01:17:16.670ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 812a4571-8e87-4112-b85c-5492bd7fec37 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
25262025-03-01T01:17:16.672ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2339 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 812a4571-8e87-4112-b85c-5492bd7fec37 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
25272025-03-01T01:17:17.415ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 407 local_addr = [fd00:1122:3344:101::c]:34357 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = ac064a9b-9d36-43b1-886b-e74c5919c9c2 response_code = 200 uri = /67b03f4e-4cbd-4843-9cd9-647f610abcfc
25282025-03-01T01:17:17.691ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = b64bcc78-7f08-4c39-b109-5544f3431866 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
25292025-03-01T01:17:17.691ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = b64bcc78-7f08-4c39-b109-5544f3431866 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
25302025-03-01T01:17:17.693ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2016 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = b64bcc78-7f08-4c39-b109-5544f3431866 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
25312025-03-01T01:17:18.714ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 06666416-c87c-40f6-9d28-1c2666a3d09e roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
25322025-03-01T01:17:18.714ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 06666416-c87c-40f6-9d28-1c2666a3d09e resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
25332025-03-01T01:17:18.716ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2219 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 06666416-c87c-40f6-9d28-1c2666a3d09e response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
25342025-03-01T01:17:19.735ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = a18b994c-7428-4c0d-ba41-21346607e89c roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
25352025-03-01T01:17:19.736ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = a18b994c-7428-4c0d-ba41-21346607e89c resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
25362025-03-01T01:17:19.737ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1853 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = a18b994c-7428-4c0d-ba41-21346607e89c response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
25372025-03-01T01:17:20.756ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 19d86b07-7769-474f-b21a-98e51d11fe44 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
25382025-03-01T01:17:20.757ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 19d86b07-7769-474f-b21a-98e51d11fe44 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
25392025-03-01T01:17:20.758ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2022 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 19d86b07-7769-474f-b21a-98e51d11fe44 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
25402025-03-01T01:17:21.780ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = de734421-45cc-4f4b-8127-5ebc54e5fbd9 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
25412025-03-01T01:17:21.780ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = de734421-45cc-4f4b-8127-5ebc54e5fbd9 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
25422025-03-01T01:17:21.782ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2203 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = de734421-45cc-4f4b-8127-5ebc54e5fbd9 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
25432025-03-01T01:17:22.801ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 6cd909d8-6cc1-4a9d-b6b2-1270549862a5 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
25442025-03-01T01:17:22.802ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 6cd909d8-6cc1-4a9d-b6b2-1270549862a5 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
25452025-03-01T01:17:22.804ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2221 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 6cd909d8-6cc1-4a9d-b6b2-1270549862a5 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
25462025-03-01T01:17:23.215ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 6 reason = Timeout
25472025-03-01T01:17:23.215ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
25482025-03-01T01:17:23.215ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 6 reason = Timeout
25492025-03-01T01:17:23.215ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 6 reason = Timeout
25502025-03-01T01:17:23.215ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
25512025-03-01T01:17:23.215ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 6 reason = Timeout
25522025-03-01T01:17:23.215ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25532025-03-01T01:17:23.215ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
25542025-03-01T01:17:23.215ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
25552025-03-01T01:17:23.215ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 16 reason = Timeout
25562025-03-01T01:17:23.215ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 6 reason = Timeout
25572025-03-01T01:17:23.215ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
25582025-03-01T01:17:23.215ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
25592025-03-01T01:17:23.215ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25602025-03-01T01:17:23.215ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 6 reason = Timeout
25612025-03-01T01:17:23.215ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
25622025-03-01T01:17:23.215ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 6 reason = Timeout
25632025-03-01T01:17:23.215ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
25642025-03-01T01:17:23.215ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 6 reason = Timeout
25652025-03-01T01:17:23.215ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
25662025-03-01T01:17:23.215ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 6 reason = Timeout
25672025-03-01T01:17:23.215ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
25682025-03-01T01:17:23.215ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 6 reason = Timeout
25692025-03-01T01:17:23.215ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 6 reason = Timeout
25702025-03-01T01:17:23.215ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
25712025-03-01T01:17:23.215ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
25722025-03-01T01:17:23.215ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 16 reason = Timeout
25732025-03-01T01:17:23.215ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25742025-03-01T01:17:23.215ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 6 reason = Timeout
25752025-03-01T01:17:23.215ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
25762025-03-01T01:17:23.215ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 6 reason = Timeout
25772025-03-01T01:17:23.215ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 6 reason = Timeout
25782025-03-01T01:17:23.215ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
25792025-03-01T01:17:23.215ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 7 reason = Timeout
25802025-03-01T01:17:23.215ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 6 reason = Timeout
25812025-03-01T01:17:23.215ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
25822025-03-01T01:17:23.215ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
25832025-03-01T01:17:23.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
25842025-03-01T01:17:23.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
25852025-03-01T01:17:23.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
25862025-03-01T01:17:23.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25872025-03-01T01:17:23.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
25882025-03-01T01:17:23.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
25892025-03-01T01:17:23.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
25902025-03-01T01:17:23.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
25912025-03-01T01:17:23.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
25922025-03-01T01:17:23.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
25932025-03-01T01:17:23.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
25942025-03-01T01:17:23.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
25952025-03-01T01:17:23.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
25962025-03-01T01:17:23.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
25972025-03-01T01:17:23.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25982025-03-01T01:17:23.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
25992025-03-01T01:17:23.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
26002025-03-01T01:17:23.219ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
26012025-03-01T01:17:23.219ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
26022025-03-01T01:17:23.219ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
26032025-03-01T01:17:23.219ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.720176ms iteration = 6 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
26042025-03-01T01:17:23.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
26052025-03-01T01:17:23.219ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26062025-03-01T01:17:23.220ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1053, tv_nsec: 908204875 } })
26072025-03-01T01:17:23.221ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1154
26082025-03-01T01:17:23.221ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
26092025-03-01T01:17:23.221ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26102025-03-01T01:17:23.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26112025-03-01T01:17:23.223ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26122025-03-01T01:17:23.224ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
26132025-03-01T01:17:23.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
26142025-03-01T01:17:23.226ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1053, tv_nsec: 913425711 } })
26152025-03-01T01:17:23.226ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
26162025-03-01T01:17:23.226ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
26172025-03-01T01:17:23.226ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1154
26182025-03-01T01:17:23.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
26192025-03-01T01:17:23.230ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1053, tv_nsec: 918316401 } })
26202025-03-01T01:17:23.231ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1154 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66
26212025-03-01T01:17:23.260ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
26222025-03-01T01:17:23.261ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
26232025-03-01T01:17:23.265ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 49.999299ms iteration = 6 status = {"errors":[],"garbage_collect_requested":[]}
26242025-03-01T01:17:23.268ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26252025-03-01T01:17:23.270ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
26262025-03-01T01:17:23.270ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
26272025-03-01T01:17:23.270ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
26282025-03-01T01:17:23.270ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
26292025-03-01T01:17:23.271ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
26302025-03-01T01:17:23.271ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 56.097183ms iteration = 6 status = {"errors":[],"finish_invoked_ok":[]}
26312025-03-01T01:17:23.273ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26322025-03-01T01:17:23.274ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26332025-03-01T01:17:23.275ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26342025-03-01T01:17:23.276ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
26352025-03-01T01:17:23.276ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26362025-03-01T01:17:23.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26372025-03-01T01:17:23.278ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
26382025-03-01T01:17:23.278ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
26392025-03-01T01:17:23.278ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
26402025-03-01T01:17:23.278ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
26412025-03-01T01:17:23.278ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
26422025-03-01T01:17:23.278ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
26432025-03-01T01:17:23.279ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26442025-03-01T01:17:23.279ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26452025-03-01T01:17:23.279ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
26462025-03-01T01:17:23.279ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
26472025-03-01T01:17:23.280ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
26482025-03-01T01:17:23.281ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26492025-03-01T01:17:23.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
26502025-03-01T01:17:23.281ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26512025-03-01T01:17:23.282ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
26522025-03-01T01:17:23.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
26532025-03-01T01:17:23.283ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
26542025-03-01T01:17:23.283ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
26552025-03-01T01:17:23.283ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
26562025-03-01T01:17:23.283ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
26572025-03-01T01:17:23.283ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
26582025-03-01T01:17:23.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
26592025-03-01T01:17:23.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
26602025-03-01T01:17:23.284ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7, lookup_type: ById(8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7) } result = Ok(())
26612025-03-01T01:17:23.284ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26622025-03-01T01:17:23.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26632025-03-01T01:17:23.285ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26642025-03-01T01:17:23.288ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
26652025-03-01T01:17:23.288ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
26662025-03-01T01:17:23.288ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
26672025-03-01T01:17:23.290ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
26682025-03-01T01:17:23.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
26692025-03-01T01:17:23.298ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 83.528422ms iteration = 16 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
26702025-03-01T01:17:23.299ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 original_time_created = 2025-03-01 01:14:50.436545 UTC target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 time_created = 2025-03-01 01:14:50.436545 UTC
26712025-03-01T01:17:23.299ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 84.002641ms iteration = 16 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7","time_created":"2025-03-01T01:14:50.436545Z"}
26722025-03-01T01:17:23.300ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 85.177355ms iteration = 6 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
26732025-03-01T01:17:23.305ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
26742025-03-01T01:17:23.305ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
26752025-03-01T01:17:23.305ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "78ec5dc9-1866-459f-918d-4961deb87c60", "content-length": "26", "date": "Sat, 01 Mar 2025 01:17:23 GMT"} })
26762025-03-01T01:17:23.305ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
26772025-03-01T01:17:23.307ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
26782025-03-01T01:17:23.307ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
26792025-03-01T01:17:23.307ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 92.019354ms iteration = 6 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
26802025-03-01T01:17:23.308ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26812025-03-01T01:17:23.310ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
26822025-03-01T01:17:23.310ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
26832025-03-01T01:17:23.310ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
26842025-03-01T01:17:23.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
26852025-03-01T01:17:23.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
26862025-03-01T01:17:23.311ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26872025-03-01T01:17:23.312ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1162 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 zone_address = fd00:1122:3344:101::2
26882025-03-01T01:17:23.312ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
26892025-03-01T01:17:23.312ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "19116078-dfe4-4c6e-a138-d480b2d7993a", "content-length": "26", "date": "Sat, 01 Mar 2025 01:17:23 GMT"} })
26902025-03-01T01:17:23.312ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1167 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
26912025-03-01T01:17:23.313ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
26922025-03-01T01:17:23.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
26932025-03-01T01:17:23.313ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
26942025-03-01T01:17:23.313ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
26952025-03-01T01:17:23.313ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
26962025-03-01T01:17:23.313ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
26972025-03-01T01:17:23.313ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66
26982025-03-01T01:17:23.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
26992025-03-01T01:17:23.314ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "96860274-9c56-4733-b022-56151ed8adf3", "content-length": "26", "date": "Sat, 01 Mar 2025 01:17:23 GMT"} })
27002025-03-01T01:17:23.314ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
27012025-03-01T01:17:23.315ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
27022025-03-01T01:17:23.323ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 107.799496ms iteration = 6 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
27032025-03-01T01:17:23.327ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
27042025-03-01T01:17:23.327ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
27052025-03-01T01:17:23.327ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 112.522183ms iteration = 6 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
27062025-03-01T01:17:23.344ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
27072025-03-01T01:17:23.345ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
27082025-03-01T01:17:23.364ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
27092025-03-01T01:17:23.365ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
27102025-03-01T01:17:23.421ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 206.545957ms iteration = 6 status = {}
27112025-03-01T01:17:23.432ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
27122025-03-01T01:17:23.432ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "fd992a33-df0b-40f3-9e33-a7f2e17f9e10", "content-length": "2", "date": "Sat, 01 Mar 2025 01:17:23 GMT"} })
27132025-03-01T01:17:23.434ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
27142025-03-01T01:17:23.434ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
27152025-03-01T01:17:23.436ZINFOnexus (BackgroundTasks): VPC route manager sled 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
27162025-03-01T01:17:23.436ZDEBGnexus (BackgroundTasks): client request SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
27172025-03-01T01:17:23.436ZDEBGnexus (BackgroundTasks): client response SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "43514614-4100-4097-b809-4c31b53de2e1", "content-length": "372", "date": "Sat, 01 Mar 2025 01:17:23 GMT"} })
27182025-03-01T01:17:23.436ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
27192025-03-01T01:17:23.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27202025-03-01T01:17:23.437ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
27212025-03-01T01:17:23.437ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 222.38814ms iteration = 6 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
27222025-03-01T01:17:23.437ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27232025-03-01T01:17:23.440ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 3471264f-127e-4a25-bc10-2e8249e8d70a, lookup_type: ById(3471264f-127e-4a25-bc10-2e8249e8d70a) } result = Ok(())
27242025-03-01T01:17:23.440ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
27252025-03-01T01:17:23.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
27262025-03-01T01:17:23.441ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 226.831601ms iteration = 6 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
27272025-03-01T01:17:23.443ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 227.77555ms iteration = 6 status = null
27282025-03-01T01:17:23.444ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 228.74676ms iteration = 6 status = 0
27292025-03-01T01:17:23.447ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
27302025-03-01T01:17:23.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
27312025-03-01T01:17:23.449ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27322025-03-01T01:17:23.451ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
27332025-03-01T01:17:23.451ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
27342025-03-01T01:17:23.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
27352025-03-01T01:17:23.453ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27362025-03-01T01:17:23.455ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
27372025-03-01T01:17:23.455ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
27382025-03-01T01:17:23.455ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
27392025-03-01T01:17:23.491ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
27402025-03-01T01:17:23.491ZDEBGnexus (BackgroundTasks): client request SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
27412025-03-01T01:17:23.491ZDEBGnexus (BackgroundTasks): client response SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "e0c632c6-4142-4d74-bb3f-47b407c9d66e", "date": "Sat, 01 Mar 2025 01:17:23 GMT"} })
27422025-03-01T01:17:23.491ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
27432025-03-01T01:17:23.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27442025-03-01T01:17:23.494ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
27452025-03-01T01:17:23.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27462025-03-01T01:17:23.496ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
27472025-03-01T01:17:23.497ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27482025-03-01T01:17:23.500ZINFOnexus (BackgroundTasks): VPC route manager sled 3471264f-127e-4a25-bc10-2e8249e8d70a push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
27492025-03-01T01:17:23.500ZDEBGnexus (BackgroundTasks): client request SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
27502025-03-01T01:17:23.500ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27512025-03-01T01:17:23.501ZDEBGnexus (BackgroundTasks): client response SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "163a5860-8804-4e5b-b3c5-cc3e5e761cea", "date": "Sat, 01 Mar 2025 01:17:23 GMT"} })
27522025-03-01T01:17:23.501ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27532025-03-01T01:17:23.502ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 287.037188ms iteration = 6 status = {}
27542025-03-01T01:17:23.502ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 7f9c3c14-58c5-473f-8692-6376be44401e, rack_id: 4854cb88-dfba-4609-8f9d-72aac08cef66, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(cb10d0c6-a704-4231-b148-4f9ae21a03f8) } rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 switch_location = Switch0
27552025-03-01T01:17:23.502ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27562025-03-01T01:17:23.503ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27572025-03-01T01:17:23.532ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 317.260892ms iteration = 7 status = {"physical_disks_added":0}
27582025-03-01T01:17:23.555ZDEBGnexus (BackgroundTasks): client request SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
27592025-03-01T01:17:23.555ZDEBGnexus (BackgroundTasks): client response SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "d1060b3c-5ea4-461d-b1ec-8f49d8419b6f", "content-length": "691", "date": "Sat, 01 Mar 2025 01:17:23 GMT"} })
27602025-03-01T01:17:23.555ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
27612025-03-01T01:17:23.555ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
27622025-03-01T01:17:23.555ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
27632025-03-01T01:17:23.556ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 341.358174ms iteration = 6 status = {}
27642025-03-01T01:17:23.629ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
27652025-03-01T01:17:23.629ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "6d9890c8-35ef-4e12-ac87-177957a4f33e", "content-length": "134", "date": "Sat, 01 Mar 2025 01:17:23 GMT"} })
27662025-03-01T01:17:23.629ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
27672025-03-01T01:17:23.629ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = cb10d0c6-a704-4231-b148-4f9ae21a03f8
27682025-03-01T01:17:23.629ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
27692025-03-01T01:17:23.629ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
27702025-03-01T01:17:23.629ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
27712025-03-01T01:17:23.629ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
27722025-03-01T01:17:23.629ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
27732025-03-01T01:17:23.629ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
27742025-03-01T01:17:23.630ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
27752025-03-01T01:17:23.630ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
27762025-03-01T01:17:23.630ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66
27772025-03-01T01:17:23.630ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27782025-03-01T01:17:23.630ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27792025-03-01T01:17:23.633ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
27802025-03-01T01:17:23.633ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "443651e2-8390-49a2-b5ad-57dc65f0d4ae", "content-length": "2", "date": "Sat, 01 Mar 2025 01:17:23 GMT"} })
27812025-03-01T01:17:23.633ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
27822025-03-01T01:17:23.633ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "58d8656f-078f-47e1-8e4e-362cf146cc6c", "content-length": "52", "date": "Sat, 01 Mar 2025 01:17:23 GMT"} })
27832025-03-01T01:17:23.633ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 switch_location = Switch0
27842025-03-01T01:17:23.633ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
27852025-03-01T01:17:23.762ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "4c095c3f-4247-4ce8-b6f0-bc877b75716c", "date": "Sat, 01 Mar 2025 01:17:23 GMT"} })
27862025-03-01T01:17:23.762ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 switch = Switch0
27872025-03-01T01:17:23.762ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
27882025-03-01T01:17:23.766ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "7da08010-09b1-40f8-9b59-64619bce204d", "content-length": "682", "date": "Sat, 01 Mar 2025 01:17:23 GMT"} })
27892025-03-01T01:17:23.766ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27902025-03-01T01:17:23.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27912025-03-01T01:17:23.770ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27922025-03-01T01:17:23.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27932025-03-01T01:17:23.772ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27942025-03-01T01:17:23.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27952025-03-01T01:17:23.775ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27962025-03-01T01:17:23.775ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27972025-03-01T01:17:23.782ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 566.861968ms iteration = 6 status = {}
27982025-03-01T01:17:23.826ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = f77b2ca5-a692-4b8e-b897-74c31877b0f9 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
27992025-03-01T01:17:23.826ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = f77b2ca5-a692-4b8e-b897-74c31877b0f9 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
28002025-03-01T01:17:23.828ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2062 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = f77b2ca5-a692-4b8e-b897-74c31877b0f9 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
28012025-03-01T01:17:24.851ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 3d58e54f-21f5-406a-a747-fa04de884977 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
28022025-03-01T01:17:24.851ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 3d58e54f-21f5-406a-a747-fa04de884977 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
28032025-03-01T01:17:24.852ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1884 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 3d58e54f-21f5-406a-a747-fa04de884977 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
28042025-03-01T01:17:25.874ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = e888b71a-931c-477e-95e6-83efc8a4fd33 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
28052025-03-01T01:17:25.874ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = e888b71a-931c-477e-95e6-83efc8a4fd33 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
28062025-03-01T01:17:25.875ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1704 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = e888b71a-931c-477e-95e6-83efc8a4fd33 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
28072025-03-01T01:17:26.897ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 7be91442-10d5-4f14-a573-0431f2631baf roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
28082025-03-01T01:17:26.897ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 7be91442-10d5-4f14-a573-0431f2631baf resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
28092025-03-01T01:17:26.899ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2588 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 7be91442-10d5-4f14-a573-0431f2631baf response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
28102025-03-01T01:17:27.415ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 326 local_addr = [fd00:1122:3344:101::c]:34357 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = 8ae4c716-86d4-4f7c-91d9-74779d04889e response_code = 200 uri = /67b03f4e-4cbd-4843-9cd9-647f610abcfc
28112025-03-01T01:17:27.922ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 2edee5e9-7272-423c-868a-b35b4dc799b3 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
28122025-03-01T01:17:27.923ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 2edee5e9-7272-423c-868a-b35b4dc799b3 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
28132025-03-01T01:17:27.925ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2352 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 2edee5e9-7272-423c-868a-b35b4dc799b3 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
28142025-03-01T01:17:28.944ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 80a0094a-a7c9-417c-be0a-259fbfcdb941 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
28152025-03-01T01:17:28.945ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 80a0094a-a7c9-417c-be0a-259fbfcdb941 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
28162025-03-01T01:17:28.947ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2314 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 80a0094a-a7c9-417c-be0a-259fbfcdb941 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
28172025-03-01T01:17:29.967ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 568e489f-1f46-4191-b2e5-fc3e72ab6aad roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
28182025-03-01T01:17:29.967ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 568e489f-1f46-4191-b2e5-fc3e72ab6aad resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
28192025-03-01T01:17:29.969ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2043 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 568e489f-1f46-4191-b2e5-fc3e72ab6aad response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
28202025-03-01T01:17:30.990ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 3a3c7e1c-6520-4184-a940-a2116f68c35d roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
28212025-03-01T01:17:30.991ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 3a3c7e1c-6520-4184-a940-a2116f68c35d resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
28222025-03-01T01:17:30.992ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1924 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 3a3c7e1c-6520-4184-a940-a2116f68c35d response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
28232025-03-01T01:17:32.012ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = d3abfe13-cbaf-455a-b258-978a3e88ad7f roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
28242025-03-01T01:17:32.013ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = d3abfe13-cbaf-455a-b258-978a3e88ad7f resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
28252025-03-01T01:17:32.015ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2208 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = d3abfe13-cbaf-455a-b258-978a3e88ad7f response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
28262025-03-01T01:17:33.034ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 30910a6d-3b2f-4ece-bf1a-8a87c10a1ba5 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
28272025-03-01T01:17:33.034ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 30910a6d-3b2f-4ece-bf1a-8a87c10a1ba5 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
28282025-03-01T01:17:33.036ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2521 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 30910a6d-3b2f-4ece-bf1a-8a87c10a1ba5 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
28292025-03-01T01:17:33.214ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 17 reason = Timeout
28302025-03-01T01:17:33.214ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 17 reason = Timeout
28312025-03-01T01:17:33.214ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
28322025-03-01T01:17:33.214ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28332025-03-01T01:17:33.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
28342025-03-01T01:17:33.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28352025-03-01T01:17:33.216ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28362025-03-01T01:17:33.216ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
28372025-03-01T01:17:33.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
28382025-03-01T01:17:33.218ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.192735ms iteration = 17 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
28392025-03-01T01:17:33.219ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
28402025-03-01T01:17:33.219ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28412025-03-01T01:17:33.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28422025-03-01T01:17:33.221ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28432025-03-01T01:17:33.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28442025-03-01T01:17:33.222ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28452025-03-01T01:17:33.225ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7, lookup_type: ById(8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7) } result = Ok(())
28462025-03-01T01:17:33.225ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28472025-03-01T01:17:33.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28482025-03-01T01:17:33.328ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 original_time_created = 2025-03-01 01:14:50.436545 UTC target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 time_created = 2025-03-01 01:14:50.436545 UTC
28492025-03-01T01:17:33.328ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 113.836318ms iteration = 17 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7","time_created":"2025-03-01T01:14:50.436545Z"}
28502025-03-01T01:17:34.055ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 3658adca-5187-493c-8e7d-b1685af806b4 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
28512025-03-01T01:17:34.056ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 3658adca-5187-493c-8e7d-b1685af806b4 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
28522025-03-01T01:17:34.057ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2154 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 3658adca-5187-493c-8e7d-b1685af806b4 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
28532025-03-01T01:17:35.077ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 113ca22b-00c2-4990-9bfa-851d5f808cf4 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
28542025-03-01T01:17:35.077ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 113ca22b-00c2-4990-9bfa-851d5f808cf4 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
28552025-03-01T01:17:35.079ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1726 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 113ca22b-00c2-4990-9bfa-851d5f808cf4 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
28562025-03-01T01:17:36.099ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 0fd541d7-f610-42ce-9527-8b3b302e5c22 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
28572025-03-01T01:17:36.099ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 0fd541d7-f610-42ce-9527-8b3b302e5c22 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
28582025-03-01T01:17:36.101ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2088 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 0fd541d7-f610-42ce-9527-8b3b302e5c22 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
28592025-03-01T01:17:37.120ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 6188393b-5222-419b-9d0e-808f7bfe3312 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
28602025-03-01T01:17:37.120ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 6188393b-5222-419b-9d0e-808f7bfe3312 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
28612025-03-01T01:17:37.122ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2302 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 6188393b-5222-419b-9d0e-808f7bfe3312 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
28622025-03-01T01:17:37.408ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61177 req_id = eba791cd-02d8-46f1-b458-d20d818ef4b8 roles = RoleSet { roles: {} } uri = /metrics/collectors/d77aa5d6-e6f9-4845-b1d4-57f91a3621e6/producers?sort_by=id_ascending
28632025-03-01T01:17:37.408ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61177 req_id = eba791cd-02d8-46f1-b458-d20d818ef4b8 resource = Database result = Ok(()) uri = /metrics/collectors/d77aa5d6-e6f9-4845-b1d4-57f91a3621e6/producers?sort_by=id_ascending
28642025-03-01T01:17:37.411ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3013 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61177 req_id = eba791cd-02d8-46f1-b458-d20d818ef4b8 response_code = 200 uri = /metrics/collectors/d77aa5d6-e6f9-4845-b1d4-57f91a3621e6/producers?sort_by=id_ascending
28652025-03-01T01:17:37.411ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61177 req_id = 9b1bde96-5859-4d96-9c80-f124e977c551 roles = RoleSet { roles: {} } uri = /metrics/collectors/d77aa5d6-e6f9-4845-b1d4-57f91a3621e6/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYmI0ODUwMS0zYzRlLTRkNDQtODgyMy1mOTc1ZTg2OTFmZmYifX0%3D
28662025-03-01T01:17:37.411ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61177 req_id = 9b1bde96-5859-4d96-9c80-f124e977c551 resource = Database result = Ok(()) uri = /metrics/collectors/d77aa5d6-e6f9-4845-b1d4-57f91a3621e6/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYmI0ODUwMS0zYzRlLTRkNDQtODgyMy1mOTc1ZTg2OTFmZmYifX0%3D
28672025-03-01T01:17:37.413ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2293 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61177 req_id = 9b1bde96-5859-4d96-9c80-f124e977c551 response_code = 200 uri = /metrics/collectors/d77aa5d6-e6f9-4845-b1d4-57f91a3621e6/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYmI0ODUwMS0zYzRlLTRkNDQtODgyMy1mOTc1ZTg2OTFmZmYifX0%3D
28682025-03-01T01:17:37.415ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 319 local_addr = [fd00:1122:3344:101::c]:34357 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = eb77ffa9-db77-4217-8d2e-2e8a07574808 response_code = 200 uri = /67b03f4e-4cbd-4843-9cd9-647f610abcfc
28692025-03-01T01:17:38.144ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = f45c44d3-3bf4-4fcd-8957-ae5c714af52e roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
28702025-03-01T01:17:38.144ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = f45c44d3-3bf4-4fcd-8957-ae5c714af52e resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
28712025-03-01T01:17:38.145ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1958 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = f45c44d3-3bf4-4fcd-8957-ae5c714af52e response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
28722025-03-01T01:17:39.166ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 3ea71d16-afaf-4b81-82a1-d0a6c49fa3ce roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
28732025-03-01T01:17:39.166ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 3ea71d16-afaf-4b81-82a1-d0a6c49fa3ce resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
28742025-03-01T01:17:39.168ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2180 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 3ea71d16-afaf-4b81-82a1-d0a6c49fa3ce response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
28752025-03-01T01:17:40.188ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 447a4fdd-860a-4347-9db7-ab727a5170f8 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
28762025-03-01T01:17:40.188ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 447a4fdd-860a-4347-9db7-ab727a5170f8 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
28772025-03-01T01:17:40.190ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2611 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 447a4fdd-860a-4347-9db7-ab727a5170f8 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
28782025-03-01T01:17:41.210ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = fa7cf903-f83c-4634-8b3f-273fb3fed55d roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
28792025-03-01T01:17:41.211ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = fa7cf903-f83c-4634-8b3f-273fb3fed55d resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
28802025-03-01T01:17:41.212ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2244 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = fa7cf903-f83c-4634-8b3f-273fb3fed55d response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
28812025-03-01T01:17:42.231ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 89322fd1-a7d9-4fd6-ad59-68499cd2660a roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
28822025-03-01T01:17:42.232ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 89322fd1-a7d9-4fd6-ad59-68499cd2660a resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
28832025-03-01T01:17:42.233ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1811 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 89322fd1-a7d9-4fd6-ad59-68499cd2660a response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
28842025-03-01T01:17:43.214ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 18 reason = Timeout
28852025-03-01T01:17:43.214ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 18 reason = Timeout
28862025-03-01T01:17:43.214ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28872025-03-01T01:17:43.214ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
28882025-03-01T01:17:43.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28892025-03-01T01:17:43.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
28902025-03-01T01:17:43.216ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28912025-03-01T01:17:43.219ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
28922025-03-01T01:17:43.219ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28932025-03-01T01:17:43.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28942025-03-01T01:17:43.221ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28952025-03-01T01:17:43.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28962025-03-01T01:17:43.223ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28972025-03-01T01:17:43.225ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7, lookup_type: ById(8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7) } result = Ok(())
28982025-03-01T01:17:43.225ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28992025-03-01T01:17:43.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29002025-03-01T01:17:43.233ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 original_time_created = 2025-03-01 01:14:50.436545 UTC target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 time_created = 2025-03-01 01:14:50.436545 UTC
29012025-03-01T01:17:43.233ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.858294ms iteration = 18 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7","time_created":"2025-03-01T01:14:50.436545Z"}
29022025-03-01T01:17:43.243ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
29032025-03-01T01:17:43.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
29042025-03-01T01:17:43.244ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.070963ms iteration = 18 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
29052025-03-01T01:17:43.253ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 6bdff8e4-66c1-4f45-b27f-4d2eb3d9a05c roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
29062025-03-01T01:17:43.253ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 6bdff8e4-66c1-4f45-b27f-4d2eb3d9a05c resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
29072025-03-01T01:17:43.254ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1825 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 6bdff8e4-66c1-4f45-b27f-4d2eb3d9a05c response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
29082025-03-01T01:17:44.274ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 0969e782-501b-4a58-8568-cb3647637227 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
29092025-03-01T01:17:44.275ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 0969e782-501b-4a58-8568-cb3647637227 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
29102025-03-01T01:17:44.277ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2251 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 0969e782-501b-4a58-8568-cb3647637227 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
29112025-03-01T01:17:45.296ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = f8f7b568-99d9-41ac-b63a-aa15feef63c1 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
29122025-03-01T01:17:45.297ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = f8f7b568-99d9-41ac-b63a-aa15feef63c1 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
29132025-03-01T01:17:45.299ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2532 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = f8f7b568-99d9-41ac-b63a-aa15feef63c1 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
29142025-03-01T01:17:46.320ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = f32d31be-06c9-4fe3-9f5c-936c817ee47b roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
29152025-03-01T01:17:46.320ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = f32d31be-06c9-4fe3-9f5c-936c817ee47b resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
29162025-03-01T01:17:46.322ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2087 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = f32d31be-06c9-4fe3-9f5c-936c817ee47b response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
29172025-03-01T01:17:47.342ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = fb8be6de-0031-4fa9-8b8c-7309d877b8ba roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
29182025-03-01T01:17:47.343ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = fb8be6de-0031-4fa9-8b8c-7309d877b8ba resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
29192025-03-01T01:17:47.345ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2193 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = fb8be6de-0031-4fa9-8b8c-7309d877b8ba response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
29202025-03-01T01:17:47.414ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 317 local_addr = [fd00:1122:3344:101::c]:34357 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = bb4879f0-0451-4ef6-94b1-debf9644970d response_code = 200 uri = /67b03f4e-4cbd-4843-9cd9-647f610abcfc
29212025-03-01T01:17:48.365ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = e86c9465-9f45-4939-a24c-e04176e5e5cd roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
29222025-03-01T01:17:48.365ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = e86c9465-9f45-4939-a24c-e04176e5e5cd resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
29232025-03-01T01:17:48.367ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2175 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = e86c9465-9f45-4939-a24c-e04176e5e5cd response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
29242025-03-01T01:17:49.386ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c4d6eda2-ab78-4026-889e-9538f42b4244 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
29252025-03-01T01:17:49.387ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c4d6eda2-ab78-4026-889e-9538f42b4244 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
29262025-03-01T01:17:49.388ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2132 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c4d6eda2-ab78-4026-889e-9538f42b4244 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
29272025-03-01T01:17:50.408ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c1f896b5-53dc-4c1c-8d15-970632ef2e47 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
29282025-03-01T01:17:50.409ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c1f896b5-53dc-4c1c-8d15-970632ef2e47 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
29292025-03-01T01:17:50.410ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2046 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c1f896b5-53dc-4c1c-8d15-970632ef2e47 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
29302025-03-01T01:17:51.431ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = baf0d61f-ef7b-4825-87e5-d9cd847c4468 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
29312025-03-01T01:17:51.432ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = baf0d61f-ef7b-4825-87e5-d9cd847c4468 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
29322025-03-01T01:17:51.433ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1998 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = baf0d61f-ef7b-4825-87e5-d9cd847c4468 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
29332025-03-01T01:17:52.454ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 3a6ce91b-2924-4cf1-b5e9-72341e40834f roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
29342025-03-01T01:17:52.454ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 3a6ce91b-2924-4cf1-b5e9-72341e40834f resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
29352025-03-01T01:17:52.456ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1995 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 3a6ce91b-2924-4cf1-b5e9-72341e40834f response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
29362025-03-01T01:17:53.215ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 4 reason = Timeout
29372025-03-01T01:17:53.215ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 8 reason = Timeout
29382025-03-01T01:17:53.215ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
29392025-03-01T01:17:53.215ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 7 reason = Timeout
29402025-03-01T01:17:53.215ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
29412025-03-01T01:17:53.215ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
29422025-03-01T01:17:53.215ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29432025-03-01T01:17:53.215ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 4 reason = Timeout
29442025-03-01T01:17:53.215ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 7 reason = Timeout
29452025-03-01T01:17:53.215ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
29462025-03-01T01:17:53.215ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 4 reason = Timeout
29472025-03-01T01:17:53.215ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
29482025-03-01T01:17:53.215ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 19 reason = Timeout
29492025-03-01T01:17:53.215ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
29502025-03-01T01:17:53.215ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 6 reason = Timeout
29512025-03-01T01:17:53.215ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29522025-03-01T01:17:53.215ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 7 reason = Timeout
29532025-03-01T01:17:53.215ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 4 reason = Timeout
29542025-03-01T01:17:53.215ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
29552025-03-01T01:17:53.215ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
29562025-03-01T01:17:53.215ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
29572025-03-01T01:17:53.215ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 4 reason = Timeout
29582025-03-01T01:17:53.215ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-03-01 01:07:53.215350210 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
29592025-03-01T01:17:53.215ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
29602025-03-01T01:17:53.215ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 7 reason = Timeout
29612025-03-01T01:17:53.215ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
29622025-03-01T01:17:53.215ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 4 reason = Timeout
29632025-03-01T01:17:53.215ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
29642025-03-01T01:17:53.215ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 5 reason = Timeout
29652025-03-01T01:17:53.215ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7
29662025-03-01T01:17:53.215ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 4 reason = Timeout
29672025-03-01T01:17:53.215ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 14.8\u{b5}s iteration = 5 status = {"enabled":false,"target_id":"8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7"}
29682025-03-01T01:17:53.215ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 4 reason = Timeout
29692025-03-01T01:17:53.215ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
29702025-03-01T01:17:53.215ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 4 reason = Timeout
29712025-03-01T01:17:53.215ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
29722025-03-01T01:17:53.215ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
29732025-03-01T01:17:53.215ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 4 reason = Timeout
29742025-03-01T01:17:53.215ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
29752025-03-01T01:17:53.215ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 7 reason = Timeout
29762025-03-01T01:17:53.215ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 7 reason = Timeout
29772025-03-01T01:17:53.215ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
29782025-03-01T01:17:53.215ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
29792025-03-01T01:17:53.215ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 7 reason = Timeout
29802025-03-01T01:17:53.215ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
29812025-03-01T01:17:53.215ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 7 reason = Timeout
29822025-03-01T01:17:53.215ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
29832025-03-01T01:17:53.215ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 7 reason = Timeout
29842025-03-01T01:17:53.215ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 19 reason = Timeout
29852025-03-01T01:17:53.215ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
29862025-03-01T01:17:53.215ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
29872025-03-01T01:17:53.215ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 7 reason = Timeout
29882025-03-01T01:17:53.215ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29892025-03-01T01:17:53.215ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 6 reason = Timeout
29902025-03-01T01:17:53.215ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 7 reason = Timeout
29912025-03-01T01:17:53.215ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
29922025-03-01T01:17:53.215ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 3 reason = Timeout
29932025-03-01T01:17:53.215ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 7 reason = Timeout
29942025-03-01T01:17:53.215ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
29952025-03-01T01:17:53.215ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
29962025-03-01T01:17:53.215ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 7 reason = Timeout
29972025-03-01T01:17:53.215ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
29982025-03-01T01:17:53.215ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 7 reason = Timeout
29992025-03-01T01:17:53.215ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
30002025-03-01T01:17:53.215ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 7 reason = Timeout
30012025-03-01T01:17:53.215ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
30022025-03-01T01:17:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
30032025-03-01T01:17:53.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
30042025-03-01T01:17:53.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
30052025-03-01T01:17:53.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
30062025-03-01T01:17:53.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
30072025-03-01T01:17:53.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
30082025-03-01T01:17:53.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30092025-03-01T01:17:53.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
30102025-03-01T01:17:53.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
30112025-03-01T01:17:53.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
30122025-03-01T01:17:53.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
30132025-03-01T01:17:53.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
30142025-03-01T01:17:53.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
30152025-03-01T01:17:53.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
30162025-03-01T01:17:53.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
30172025-03-01T01:17:53.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
30182025-03-01T01:17:53.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
30192025-03-01T01:17:53.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30202025-03-01T01:17:53.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
30212025-03-01T01:17:53.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
30222025-03-01T01:17:53.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
30232025-03-01T01:17:53.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
30242025-03-01T01:17:53.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
30252025-03-01T01:17:53.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
30262025-03-01T01:17:53.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
30272025-03-01T01:17:53.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
30282025-03-01T01:17:53.216ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
30292025-03-01T01:17:53.216ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("3a9b8294-d9f3-4130-a669-e74c6f1f65a0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("450e8d93-9ed3-4721-9fe9-42521f60bc93.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a4f72c78-99c6-478d-b490-f7d8793d4173.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("a4f72c78-99c6-478d-b490-f7d8793d4173.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1083, tv_nsec: 903832426 } })
30302025-03-01T01:17:53.216ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2e37f4af-57dc-468e-80e3-cf2aea2ffdc8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5f6eb3bd-0126-40e0-98ef-ee33df084158.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("5f6eb3bd-0126-40e0-98ef-ee33df084158.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1083, tv_nsec: 903851686 } })
30312025-03-01T01:17:53.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
30322025-03-01T01:17:53.216ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
30332025-03-01T01:17:53.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
30342025-03-01T01:17:53.216ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
30352025-03-01T01:17:53.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
30362025-03-01T01:17:53.216ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
30372025-03-01T01:17:53.216ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
30382025-03-01T01:17:53.216ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.699364ms iteration = 4 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
30392025-03-01T01:17:53.217ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
30402025-03-01T01:17:53.217ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.585353ms iteration = 4 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
30412025-03-01T01:17:53.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
30422025-03-01T01:17:53.218ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30432025-03-01T01:17:53.219ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30442025-03-01T01:17:53.219ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.250927ms iteration = 7 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
30452025-03-01T01:17:53.220ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30462025-03-01T01:17:53.220ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30472025-03-01T01:17:53.220ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
30482025-03-01T01:17:53.220ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
30492025-03-01T01:17:53.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
30502025-03-01T01:17:53.221ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
30512025-03-01T01:17:53.221ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
30522025-03-01T01:17:53.221ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
30532025-03-01T01:17:53.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
30542025-03-01T01:17:53.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
30552025-03-01T01:17:53.223ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
30562025-03-01T01:17:53.223ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
30572025-03-01T01:17:53.223ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30582025-03-01T01:17:53.223ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
30592025-03-01T01:17:53.223ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-03-01 01:07:53.215350210 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
30602025-03-01T01:17:53.223ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 8.533284ms iteration = 4 status = {"expiration":"2025-03-01T01:07:53.215350210Z","pruned":[]}
30612025-03-01T01:17:53.224ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
30622025-03-01T01:17:53.224ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
30632025-03-01T01:17:53.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
30642025-03-01T01:17:53.225ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30652025-03-01T01:17:53.225ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
30662025-03-01T01:17:53.225ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30672025-03-01T01:17:53.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30682025-03-01T01:17:53.226ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
30692025-03-01T01:17:53.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
30702025-03-01T01:17:53.227ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
30712025-03-01T01:17:53.227ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
30722025-03-01T01:17:53.228ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
30732025-03-01T01:17:53.229ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1083, tv_nsec: 917100166 } })
30742025-03-01T01:17:53.229ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1154
30752025-03-01T01:17:53.230ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30762025-03-01T01:17:53.230ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30772025-03-01T01:17:53.233ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
30782025-03-01T01:17:53.233ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
30792025-03-01T01:17:53.233ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
30802025-03-01T01:17:53.233ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30812025-03-01T01:17:53.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
30822025-03-01T01:17:53.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30832025-03-01T01:17:53.233ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
30842025-03-01T01:17:53.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
30852025-03-01T01:17:53.234ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
30862025-03-01T01:17:53.234ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
30872025-03-01T01:17:53.234ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
30882025-03-01T01:17:53.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
30892025-03-01T01:17:53.237ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30902025-03-01T01:17:53.240ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
30912025-03-01T01:17:53.240ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
30922025-03-01T01:17:53.240ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
30932025-03-01T01:17:53.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
30942025-03-01T01:17:53.240ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30952025-03-01T01:17:53.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
30962025-03-01T01:17:53.242ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
30972025-03-01T01:17:53.242ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
30982025-03-01T01:17:53.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
30992025-03-01T01:17:53.243ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31002025-03-01T01:17:53.245ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
31012025-03-01T01:17:53.245ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
31022025-03-01T01:17:53.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
31032025-03-01T01:17:53.245ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31042025-03-01T01:17:53.247ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
31052025-03-01T01:17:53.247ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
31062025-03-01T01:17:53.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
31072025-03-01T01:17:53.250ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31082025-03-01T01:17:53.252ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
31092025-03-01T01:17:53.252ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
31102025-03-01T01:17:53.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
31112025-03-01T01:17:53.252ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
31122025-03-01T01:17:53.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
31132025-03-01T01:17:53.254ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31142025-03-01T01:17:53.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31152025-03-01T01:17:53.256ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
31162025-03-01T01:17:53.256ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 41.478296ms iteration = 7 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
31172025-03-01T01:17:53.268ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
31182025-03-01T01:17:53.269ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
31192025-03-01T01:17:53.271ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 55.667154ms iteration = 7 status = {"errors":[],"garbage_collect_requested":[]}
31202025-03-01T01:17:53.271ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 56.026061ms iteration = 7 status = {"errors":[],"finish_invoked_ok":[]}
31212025-03-01T01:17:53.272ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
31222025-03-01T01:17:53.272ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
31232025-03-01T01:17:53.272ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 56.866348ms iteration = 4 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
31242025-03-01T01:17:53.274ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31252025-03-01T01:17:53.274ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31262025-03-01T01:17:53.276ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31272025-03-01T01:17:53.277ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
31282025-03-01T01:17:53.278ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31292025-03-01T01:17:53.278ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
31302025-03-01T01:17:53.278ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
31312025-03-01T01:17:53.278ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
31322025-03-01T01:17:53.279ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
31332025-03-01T01:17:53.279ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
31342025-03-01T01:17:53.279ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
31352025-03-01T01:17:53.280ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
31362025-03-01T01:17:53.282ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
31372025-03-01T01:17:53.282ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
31382025-03-01T01:17:53.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
31392025-03-01T01:17:53.282ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
31402025-03-01T01:17:53.282ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
31412025-03-01T01:17:53.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
31422025-03-01T01:17:53.285ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31432025-03-01T01:17:53.286ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31442025-03-01T01:17:53.288ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
31452025-03-01T01:17:53.288ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
31462025-03-01T01:17:53.288ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
31472025-03-01T01:17:53.289ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7, lookup_type: ById(8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7) } result = Ok(())
31482025-03-01T01:17:53.289ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31492025-03-01T01:17:53.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31502025-03-01T01:17:53.300ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
31512025-03-01T01:17:53.301ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
31522025-03-01T01:17:53.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
31532025-03-01T01:17:53.306ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31542025-03-01T01:17:53.310ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
31552025-03-01T01:17:53.311ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
31562025-03-01T01:17:53.313ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 97.486116ms iteration = 19 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
31572025-03-01T01:17:53.313ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
31582025-03-01T01:17:53.313ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
31592025-03-01T01:17:53.313ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 97.72739ms iteration = 4 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
31602025-03-01T01:17:53.315ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
31612025-03-01T01:17:53.315ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
31622025-03-01T01:17:53.315ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
31632025-03-01T01:17:53.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
31642025-03-01T01:17:53.315ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1084, tv_nsec: 3100088 } })
31652025-03-01T01:17:53.315ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1154
31662025-03-01T01:17:53.323ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
31672025-03-01T01:17:53.323ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
31682025-03-01T01:17:53.323ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
31692025-03-01T01:17:53.323ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
31702025-03-01T01:17:53.323ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
31712025-03-01T01:17:53.327ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 111.901149ms iteration = 4 status = {"errors":[],"found_port_ok":[]}
31722025-03-01T01:17:53.331ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
31732025-03-01T01:17:53.331ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
31742025-03-01T01:17:53.332ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 117.033284ms iteration = 7 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
31752025-03-01T01:17:53.332ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
31762025-03-01T01:17:53.332ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
31772025-03-01T01:17:53.333ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5cfeb8ad-ea2d-4a3a-ace4-270325c277ca", "content-length": "26", "date": "Sat, 01 Mar 2025 01:17:53 GMT"} })
31782025-03-01T01:17:53.333ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
31792025-03-01T01:17:53.334ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
31802025-03-01T01:17:53.343ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
31812025-03-01T01:17:53.343ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
31822025-03-01T01:17:53.343ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
31832025-03-01T01:17:53.343ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
31842025-03-01T01:17:53.344ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
31852025-03-01T01:17:53.359ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1084, tv_nsec: 47204286 } })
31862025-03-01T01:17:53.360ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1154 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66
31872025-03-01T01:17:53.367ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
31882025-03-01T01:17:53.368ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
31892025-03-01T01:17:53.474ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
31902025-03-01T01:17:53.475ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = e14d0f2b-bfc4-48e6-b8f7-140aa1950650 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
31912025-03-01T01:17:53.476ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = e14d0f2b-bfc4-48e6-b8f7-140aa1950650 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
31922025-03-01T01:17:53.503ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
31932025-03-01T01:17:53.503ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "ec97a1b8-9134-4d4d-89e0-dd5447ccf6be", "date": "Sat, 01 Mar 2025 01:17:53 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
31942025-03-01T01:17:53.504ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
31952025-03-01T01:17:53.505ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "fdc25b79-dc70-4ad6-9fec-289dc611a57d", "date": "Sat, 01 Mar 2025 01:17:53 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
31962025-03-01T01:17:53.505ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
31972025-03-01T01:17:53.507ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
31982025-03-01T01:17:53.507ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 291.946457ms iteration = 6 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
31992025-03-01T01:17:53.518ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
32002025-03-01T01:17:53.518ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "17388e77-af5a-4cea-820b-7c41c3c26601", "content-length": "2", "date": "Sat, 01 Mar 2025 01:17:52 GMT"} })
32012025-03-01T01:17:53.520ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
32022025-03-01T01:17:53.520ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
32032025-03-01T01:17:53.534ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::6]:32222/node/id
32042025-03-01T01:17:53.535ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::6]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4d61ec93-59cf-4863-8093-06e01759dbb1", "content-length": "64", "date": "Sat, 01 Mar 2025 01:17:53 GMT"} })
32052025-03-01T01:17:53.535ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
32062025-03-01T01:17:53.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
32072025-03-01T01:17:53.539ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
32082025-03-01T01:17:53.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
32092025-03-01T01:17:53.541ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1162 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 zone_address = fd00:1122:3344:101::2
32102025-03-01T01:17:53.541ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
32112025-03-01T01:17:53.541ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5e6bc21a-a772-40a2-a070-578fb1ec56ef", "content-length": "26", "date": "Sat, 01 Mar 2025 01:17:53 GMT"} })
32122025-03-01T01:17:53.541ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1167 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
32132025-03-01T01:17:53.542ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32142025-03-01T01:17:53.543ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66
32152025-03-01T01:17:53.545ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 69126 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = e14d0f2b-bfc4-48e6-b8f7-140aa1950650 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
32162025-03-01T01:17:53.545ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 329.813749ms iteration = 7 status = null
32172025-03-01T01:17:53.546ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
32182025-03-01T01:17:53.546ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
32192025-03-01T01:17:53.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
32202025-03-01T01:17:53.562ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 original_time_created = 2025-03-01 01:14:50.436545 UTC target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 time_created = 2025-03-01 01:14:50.436545 UTC
32212025-03-01T01:17:53.562ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 347.017019ms iteration = 19 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7","time_created":"2025-03-01T01:14:50.436545Z"}
32222025-03-01T01:17:53.575ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
32232025-03-01T01:17:53.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
32242025-03-01T01:17:53.577ZINFOnexus (BackgroundTasks): VPC route manager sled 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
32252025-03-01T01:17:53.577ZDEBGnexus (BackgroundTasks): client request SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
32262025-03-01T01:17:53.578ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
32272025-03-01T01:17:53.578ZDEBGnexus (BackgroundTasks): client response SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "ac901844-3572-42f1-8739-0784d0b280c6", "content-length": "372", "date": "Sat, 01 Mar 2025 01:17:53 GMT"} })
32282025-03-01T01:17:53.578ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32292025-03-01T01:17:53.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32302025-03-01T01:17:53.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
32312025-03-01T01:17:53.582ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 366.994066ms iteration = 7 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
32322025-03-01T01:17:53.583ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32332025-03-01T01:17:53.586ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
32342025-03-01T01:17:53.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
32352025-03-01T01:17:53.586ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
32362025-03-01T01:17:53.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
32372025-03-01T01:17:53.587ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 3471264f-127e-4a25-bc10-2e8249e8d70a, lookup_type: ById(3471264f-127e-4a25-bc10-2e8249e8d70a) } result = Ok(())
32382025-03-01T01:17:53.587ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
32392025-03-01T01:17:53.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
32402025-03-01T01:17:53.589ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32412025-03-01T01:17:53.589ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
32422025-03-01T01:17:53.589ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
32432025-03-01T01:17:53.589ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "77ee8f48-cd8d-4135-b535-cb9a287aed16", "content-length": "26", "date": "Sat, 01 Mar 2025 01:17:53 GMT"} })
32442025-03-01T01:17:53.589ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
32452025-03-01T01:17:53.591ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
32462025-03-01T01:17:53.591ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
32472025-03-01T01:17:53.591ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 376.0291ms iteration = 7 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
32482025-03-01T01:17:53.591ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
32492025-03-01T01:17:53.591ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
32502025-03-01T01:17:53.591ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
32512025-03-01T01:17:53.592ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
32522025-03-01T01:17:53.592ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32532025-03-01T01:17:53.595ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 377.748815ms iteration = 7 status = 0
32542025-03-01T01:17:53.597ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32552025-03-01T01:17:53.597ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
32562025-03-01T01:17:53.597ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
32572025-03-01T01:17:53.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
32582025-03-01T01:17:53.598ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32592025-03-01T01:17:53.600ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
32602025-03-01T01:17:53.600ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
32612025-03-01T01:17:53.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
32622025-03-01T01:17:53.600ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
32632025-03-01T01:17:53.600ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
32642025-03-01T01:17:53.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
32652025-03-01T01:17:53.602ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
32662025-03-01T01:17:53.602ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = cce65e3e-6c86-4cdd-98ad-9a38c98082e8 dns_zone_name = oxide.test found_so_far = 0 version = 2
32672025-03-01T01:17:53.602ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
32682025-03-01T01:17:53.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
32692025-03-01T01:17:53.604ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32702025-03-01T01:17:53.604ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 388.918722ms iteration = 3 status = {"nsuccess":5}
32712025-03-01T01:17:53.607ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
32722025-03-01T01:17:53.607ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
32732025-03-01T01:17:53.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
32742025-03-01T01:17:53.608ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = cce65e3e-6c86-4cdd-98ad-9a38c98082e8 dns_zone_name = oxide.test found_so_far = 1 version = 2
32752025-03-01T01:17:53.608ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
32762025-03-01T01:17:53.609ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-03-01 01:14:54.679503 UTC dns_group = external generation = 2
32772025-03-01T01:17:53.609ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 393.70949ms iteration = 4 status = {"generation":2}
32782025-03-01T01:17:53.619ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
32792025-03-01T01:17:53.620ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "dc97ac23-0cb6-45dc-b190-1d9129271962", "date": "Sat, 01 Mar 2025 01:17:53 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
32802025-03-01T01:17:53.620ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
32812025-03-01T01:17:53.621ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "4a8fb145-40a0-4c99-b6e3-1732f5cfa85f", "date": "Sat, 01 Mar 2025 01:17:53 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
32822025-03-01T01:17:53.621ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
32832025-03-01T01:17:53.623ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "18d6f347-f54e-44f3-b50e-3619a4565abc", "date": "Sat, 01 Mar 2025 01:17:53 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
32842025-03-01T01:17:53.623ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
32852025-03-01T01:17:53.626ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
32862025-03-01T01:17:53.626ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 410.625915ms iteration = 6 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
32872025-03-01T01:17:53.626ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 410.907851ms iteration = 7 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
32882025-03-01T01:17:53.630ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
32892025-03-01T01:17:53.630ZDEBGnexus (BackgroundTasks): client request SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
32902025-03-01T01:17:53.630ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
32912025-03-01T01:17:53.630ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 415.190208ms iteration = 7 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
32922025-03-01T01:17:53.630ZDEBGnexus (BackgroundTasks): client response SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "4dc78e0c-0478-43b4-8fe3-f521fc71c86a", "date": "Sat, 01 Mar 2025 01:17:53 GMT"} })
32932025-03-01T01:17:53.630ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32942025-03-01T01:17:53.631ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32952025-03-01T01:17:53.632ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-03-01T01:14:49.537343Z, time_modified: 2025-03-01T01:14:49.537343Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 1682a303-6254-452b-b4cf-160ed9dc3fc9, db_silo: Silo { identity: SiloIdentity { id: 1682a303-6254-452b-b4cf-160ed9dc3fc9, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-03-01T01:14:54.631650Z, time_modified: 2025-03-01T01:14:54.631650Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "851c0b739689cfb98a2e401e6047fa98e9fcc283d9fc3f660bd69842a9c06be9" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 1682a303-6254-452b-b4cf-160ed9dc3fc9, db_silo: Silo { identity: SiloIdentity { id: 1682a303-6254-452b-b4cf-160ed9dc3fc9, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-03-01T01:14:54.631650Z, time_modified: 2025-03-01T01:14:54.631650Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "851c0b739689cfb98a2e401e6047fa98e9fcc283d9fc3f660bd69842a9c06be9" }] }) }
32962025-03-01T01:17:53.632ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 417.401993ms iteration = 4 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"1682a303-6254-452b-b4cf-160ed9dc3fc9","tls_certs":["851c0b739689cfb98a2e401e6047fa98e9fcc283d9fc3f660bd69842a9c06be9"]}},"default_endpoint":{"silo_id":"1682a303-6254-452b-b4cf-160ed9dc3fc9","tls_certs":["851c0b739689cfb98a2e401e6047fa98e9fcc283d9fc3f660bd69842a9c06be9"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
32972025-03-01T01:17:53.639ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
32982025-03-01T01:17:53.639ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 0a9e4b5c-53a1-4f0a-8849-98a8b1852af3 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
32992025-03-01T01:17:53.639ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
33002025-03-01T01:17:53.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
33012025-03-01T01:17:53.641ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33022025-03-01T01:17:53.645ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
33032025-03-01T01:17:53.645ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
33042025-03-01T01:17:53.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
33052025-03-01T01:17:53.648ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 0a9e4b5c-53a1-4f0a-8849-98a8b1852af3 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
33062025-03-01T01:17:53.649ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
33072025-03-01T01:17:53.649ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-03-01 01:14:53.460216 UTC dns_group = internal generation = 1
33082025-03-01T01:17:53.649ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 433.584052ms iteration = 4 status = {"generation":1}
33092025-03-01T01:17:53.663ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
33102025-03-01T01:17:53.663ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 447.743331ms iteration = 4 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
33112025-03-01T01:17:53.666ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 451.411296ms iteration = 7 status = {}
33122025-03-01T01:17:53.674ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
33132025-03-01T01:17:53.675ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
33142025-03-01T01:17:53.676ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33152025-03-01T01:17:53.677ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 462.608723ms iteration = 8 status = {"physical_disks_added":0}
33162025-03-01T01:17:53.677ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
33172025-03-01T01:17:53.677ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
33182025-03-01T01:17:53.678ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
33192025-03-01T01:17:53.679ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33202025-03-01T01:17:53.681ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
33212025-03-01T01:17:53.681ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
33222025-03-01T01:17:53.681ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
33232025-03-01T01:17:53.716ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33242025-03-01T01:17:53.717ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33252025-03-01T01:17:53.719ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 7f9c3c14-58c5-473f-8692-6376be44401e, rack_id: 4854cb88-dfba-4609-8f9d-72aac08cef66, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(cb10d0c6-a704-4231-b148-4f9ae21a03f8) } rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 switch_location = Switch0
33262025-03-01T01:17:53.719ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33272025-03-01T01:17:53.720ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33282025-03-01T01:17:53.729ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
33292025-03-01T01:17:53.729ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "7294d58a-da40-41f6-8573-5c0fc1a3cdf0", "content-length": "134", "date": "Sat, 01 Mar 2025 01:17:52 GMT"} })
33302025-03-01T01:17:53.729ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
33312025-03-01T01:17:53.729ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = cb10d0c6-a704-4231-b148-4f9ae21a03f8
33322025-03-01T01:17:53.729ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
33332025-03-01T01:17:53.729ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
33342025-03-01T01:17:53.729ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
33352025-03-01T01:17:53.729ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
33362025-03-01T01:17:53.729ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
33372025-03-01T01:17:53.729ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
33382025-03-01T01:17:53.729ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
33392025-03-01T01:17:53.729ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
33402025-03-01T01:17:53.730ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66
33412025-03-01T01:17:53.730ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33422025-03-01T01:17:53.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33432025-03-01T01:17:53.732ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
33442025-03-01T01:17:53.732ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "dcc619c2-b212-4482-ae81-adff91aea1fe", "content-length": "2", "date": "Sat, 01 Mar 2025 01:17:52 GMT"} })
33452025-03-01T01:17:53.732ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
33462025-03-01T01:17:53.732ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "64ab5218-4929-4d51-b3e6-14ffe04432c6", "content-length": "52", "date": "Sat, 01 Mar 2025 01:17:52 GMT"} })
33472025-03-01T01:17:53.732ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 switch_location = Switch0
33482025-03-01T01:17:53.732ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
33492025-03-01T01:17:53.742ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33502025-03-01T01:17:53.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33512025-03-01T01:17:53.772ZDEBGnexus (BackgroundTasks): client request SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
33522025-03-01T01:17:53.775ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33532025-03-01T01:17:53.776ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33542025-03-01T01:17:53.839ZDEBGnexus (BackgroundTasks): client response SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "7d880578-b79a-4358-98a1-950069942d87", "content-length": "691", "date": "Sat, 01 Mar 2025 01:17:53 GMT"} })
33552025-03-01T01:17:53.839ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
33562025-03-01T01:17:53.839ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
33572025-03-01T01:17:53.839ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
33582025-03-01T01:17:53.841ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 625.889099ms iteration = 7 status = {}
33592025-03-01T01:17:53.887ZINFOnexus (BackgroundTasks): VPC route manager sled 3471264f-127e-4a25-bc10-2e8249e8d70a push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
33602025-03-01T01:17:53.887ZDEBGnexus (BackgroundTasks): client request SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
33612025-03-01T01:17:53.888ZDEBGnexus (BackgroundTasks): client response SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "8e6b97f1-ca77-4a87-8be2-79631190bdc2", "date": "Sat, 01 Mar 2025 01:17:53 GMT"} })
33622025-03-01T01:17:53.890ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 675.048091ms iteration = 7 status = {}
33632025-03-01T01:17:53.942ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "8a8d39b9-da20-427d-bf95-3eba5d74f6fc", "date": "Sat, 01 Mar 2025 01:17:53 GMT"} })
33642025-03-01T01:17:53.942ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 switch = Switch0
33652025-03-01T01:17:53.942ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
33662025-03-01T01:17:53.943ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "e575cd1e-b7a6-470a-b756-fa5c9efc057d", "content-length": "682", "date": "Sat, 01 Mar 2025 01:17:53 GMT"} })
33672025-03-01T01:17:53.943ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33682025-03-01T01:17:53.943ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33692025-03-01T01:17:53.947ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33702025-03-01T01:17:53.947ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33712025-03-01T01:17:53.954ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33722025-03-01T01:17:53.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33732025-03-01T01:17:53.956ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33742025-03-01T01:17:53.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33752025-03-01T01:17:53.964ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 748.826844ms iteration = 7 status = {}
33762025-03-01T01:17:54.573ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 4a8edbf0-da13-44b3-ae92-87e0c49ad70a roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
33772025-03-01T01:17:54.574ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 4a8edbf0-da13-44b3-ae92-87e0c49ad70a resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
33782025-03-01T01:17:54.575ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2267 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 4a8edbf0-da13-44b3-ae92-87e0c49ad70a response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
33792025-03-01T01:17:55.595ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 7a2a1017-3021-44bf-81f1-466d1520c414 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
33802025-03-01T01:17:55.596ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 7a2a1017-3021-44bf-81f1-466d1520c414 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
33812025-03-01T01:17:55.598ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2629 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 7a2a1017-3021-44bf-81f1-466d1520c414 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
33822025-03-01T01:17:56.618ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 5cf14aae-bd0d-458d-be75-d798b192e9b8 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
33832025-03-01T01:17:56.618ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 5cf14aae-bd0d-458d-be75-d798b192e9b8 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
33842025-03-01T01:17:56.620ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2270 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 5cf14aae-bd0d-458d-be75-d798b192e9b8 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
33852025-03-01T01:17:57.414ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 401 local_addr = [fd00:1122:3344:101::c]:34357 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = 4a31a2be-ae28-415e-b6f5-bcbc6c942fad response_code = 200 uri = /67b03f4e-4cbd-4843-9cd9-647f610abcfc
33862025-03-01T01:17:57.641ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = bd86dc2a-751f-4543-a6c7-1b576953cad9 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
33872025-03-01T01:17:57.642ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = bd86dc2a-751f-4543-a6c7-1b576953cad9 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
33882025-03-01T01:17:57.643ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2400 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = bd86dc2a-751f-4543-a6c7-1b576953cad9 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
33892025-03-01T01:17:58.664ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 3998cb89-0b2c-4fce-bed4-b679193a807b roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
33902025-03-01T01:17:58.664ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 3998cb89-0b2c-4fce-bed4-b679193a807b resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
33912025-03-01T01:17:58.666ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2466 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 3998cb89-0b2c-4fce-bed4-b679193a807b response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
33922025-03-01T01:17:59.684ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 15df38c0-ea1f-463e-a33c-1596933fa02d roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
33932025-03-01T01:17:59.685ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 15df38c0-ea1f-463e-a33c-1596933fa02d resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
33942025-03-01T01:17:59.687ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2765 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 15df38c0-ea1f-463e-a33c-1596933fa02d response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
33952025-03-01T01:18:00.706ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = e1e297f0-0f5f-4aca-861a-377db2321b7d roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
33962025-03-01T01:18:00.706ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = e1e297f0-0f5f-4aca-861a-377db2321b7d resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
33972025-03-01T01:18:00.708ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2129 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = e1e297f0-0f5f-4aca-861a-377db2321b7d response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
33982025-03-01T01:18:01.728ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = a037439d-d022-4bc4-8f7c-08d991976f58 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
33992025-03-01T01:18:01.728ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = a037439d-d022-4bc4-8f7c-08d991976f58 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
34002025-03-01T01:18:01.730ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2063 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = a037439d-d022-4bc4-8f7c-08d991976f58 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
34012025-03-01T01:18:02.749ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 49475dee-4941-41c2-8a93-b60afa69e987 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
34022025-03-01T01:18:02.749ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 49475dee-4941-41c2-8a93-b60afa69e987 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
34032025-03-01T01:18:02.751ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2163 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 49475dee-4941-41c2-8a93-b60afa69e987 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
34042025-03-01T01:18:03.214ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 20 reason = Timeout
34052025-03-01T01:18:03.214ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 20 reason = Timeout
34062025-03-01T01:18:03.214ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
34072025-03-01T01:18:03.214ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34082025-03-01T01:18:03.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34092025-03-01T01:18:03.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
34102025-03-01T01:18:03.216ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34112025-03-01T01:18:03.219ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
34122025-03-01T01:18:03.219ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34132025-03-01T01:18:03.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34142025-03-01T01:18:03.221ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34152025-03-01T01:18:03.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34162025-03-01T01:18:03.222ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34172025-03-01T01:18:03.225ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7, lookup_type: ById(8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7) } result = Ok(())
34182025-03-01T01:18:03.225ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34192025-03-01T01:18:03.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34202025-03-01T01:18:03.238ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 original_time_created = 2025-03-01 01:14:50.436545 UTC target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 time_created = 2025-03-01 01:14:50.436545 UTC
34212025-03-01T01:18:03.238ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.690112ms iteration = 20 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7","time_created":"2025-03-01T01:14:50.436545Z"}
34222025-03-01T01:18:03.244ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
34232025-03-01T01:18:03.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
34242025-03-01T01:18:03.272ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 57.794937ms iteration = 20 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
34252025-03-01T01:18:03.770ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 45db7e55-288c-4d65-920c-baa2c544b0a2 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
34262025-03-01T01:18:03.771ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 45db7e55-288c-4d65-920c-baa2c544b0a2 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
34272025-03-01T01:18:03.773ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2443 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 45db7e55-288c-4d65-920c-baa2c544b0a2 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
34282025-03-01T01:18:04.793ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = a6aea0cf-a7f3-4849-9c2b-2ef5be77f577 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
34292025-03-01T01:18:04.793ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = a6aea0cf-a7f3-4849-9c2b-2ef5be77f577 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
34302025-03-01T01:18:04.795ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2168 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = a6aea0cf-a7f3-4849-9c2b-2ef5be77f577 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
34312025-03-01T01:18:05.816ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = f9f23d85-4976-4785-adca-24881e4701b8 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
34322025-03-01T01:18:05.816ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = f9f23d85-4976-4785-adca-24881e4701b8 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
34332025-03-01T01:18:05.818ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2382 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = f9f23d85-4976-4785-adca-24881e4701b8 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
34342025-03-01T01:18:06.838ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 408a5792-f3ae-487e-9fb1-f7badbcbc91d roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
34352025-03-01T01:18:06.838ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 408a5792-f3ae-487e-9fb1-f7badbcbc91d resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
34362025-03-01T01:18:06.840ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1944 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 408a5792-f3ae-487e-9fb1-f7badbcbc91d response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
34372025-03-01T01:18:07.414ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 347 local_addr = [fd00:1122:3344:101::c]:34357 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = f3aafbcc-9c63-48d2-bd69-08637ba1fda9 response_code = 200 uri = /67b03f4e-4cbd-4843-9cd9-647f610abcfc
34382025-03-01T01:18:07.859ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 7ac677ed-0e09-4a61-91ac-6277b92ccc1d roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
34392025-03-01T01:18:07.860ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 7ac677ed-0e09-4a61-91ac-6277b92ccc1d resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
34402025-03-01T01:18:07.862ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2230 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 7ac677ed-0e09-4a61-91ac-6277b92ccc1d response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
34412025-03-01T01:18:08.883ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = a53d8b62-c784-4fa9-8079-095e96b85766 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
34422025-03-01T01:18:08.883ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = a53d8b62-c784-4fa9-8079-095e96b85766 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
34432025-03-01T01:18:08.885ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2043 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = a53d8b62-c784-4fa9-8079-095e96b85766 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
34442025-03-01T01:18:09.905ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 5d0dd07d-4c96-4997-9d32-dc6238445df8 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
34452025-03-01T01:18:09.906ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 5d0dd07d-4c96-4997-9d32-dc6238445df8 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
34462025-03-01T01:18:09.907ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2102 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 5d0dd07d-4c96-4997-9d32-dc6238445df8 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
34472025-03-01T01:18:10.927ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = aba7a4af-ebe9-4975-9d72-c4d8c6b9fbc3 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
34482025-03-01T01:18:10.927ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = aba7a4af-ebe9-4975-9d72-c4d8c6b9fbc3 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
34492025-03-01T01:18:10.929ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2030 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = aba7a4af-ebe9-4975-9d72-c4d8c6b9fbc3 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
34502025-03-01T01:18:11.948ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 08fe1dfd-9e85-4249-9a7d-4f0f39b98934 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
34512025-03-01T01:18:11.949ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 08fe1dfd-9e85-4249-9a7d-4f0f39b98934 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
34522025-03-01T01:18:11.950ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1605 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 08fe1dfd-9e85-4249-9a7d-4f0f39b98934 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
34532025-03-01T01:18:12.970ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 5d9693c9-f3d8-441a-98e7-84134469f01e roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
34542025-03-01T01:18:12.970ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 5d9693c9-f3d8-441a-98e7-84134469f01e resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
34552025-03-01T01:18:12.972ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1861 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 5d9693c9-f3d8-441a-98e7-84134469f01e response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
34562025-03-01T01:18:13.214ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 21 reason = Timeout
34572025-03-01T01:18:13.214ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 21 reason = Timeout
34582025-03-01T01:18:13.214ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
34592025-03-01T01:18:13.214ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34602025-03-01T01:18:13.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34612025-03-01T01:18:13.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
34622025-03-01T01:18:13.216ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34632025-03-01T01:18:13.219ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
34642025-03-01T01:18:13.219ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34652025-03-01T01:18:13.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34662025-03-01T01:18:13.221ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34672025-03-01T01:18:13.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34682025-03-01T01:18:13.223ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34692025-03-01T01:18:13.225ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7, lookup_type: ById(8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7) } result = Ok(())
34702025-03-01T01:18:13.225ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34712025-03-01T01:18:13.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34722025-03-01T01:18:13.237ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 original_time_created = 2025-03-01 01:14:50.436545 UTC target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 time_created = 2025-03-01 01:14:50.436545 UTC
34732025-03-01T01:18:13.237ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.546059ms iteration = 21 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7","time_created":"2025-03-01T01:14:50.436545Z"}
34742025-03-01T01:18:13.244ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
34752025-03-01T01:18:13.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
34762025-03-01T01:18:13.245ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.267317ms iteration = 21 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
34772025-03-01T01:18:13.991ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = eb533f33-ad28-4b79-bc31-2d9ae0223af9 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
34782025-03-01T01:18:13.991ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = eb533f33-ad28-4b79-bc31-2d9ae0223af9 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
34792025-03-01T01:18:13.993ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2248 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = eb533f33-ad28-4b79-bc31-2d9ae0223af9 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
34802025-03-01T01:18:15.014ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 79b2b1fc-f88b-41bb-8434-fbb5661d54dc roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
34812025-03-01T01:18:15.014ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 79b2b1fc-f88b-41bb-8434-fbb5661d54dc resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
34822025-03-01T01:18:15.016ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2678 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 79b2b1fc-f88b-41bb-8434-fbb5661d54dc response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
34832025-03-01T01:18:16.038ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = d7d83282-9dfd-49a6-82c9-3388c8aacd9c roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
34842025-03-01T01:18:16.039ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = d7d83282-9dfd-49a6-82c9-3388c8aacd9c resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
34852025-03-01T01:18:16.040ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1571 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = d7d83282-9dfd-49a6-82c9-3388c8aacd9c response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
34862025-03-01T01:18:17.060ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 9cfcdbd6-2ff0-4cf5-bb69-9842a2b8523c roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
34872025-03-01T01:18:17.061ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 9cfcdbd6-2ff0-4cf5-bb69-9842a2b8523c resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
34882025-03-01T01:18:17.063ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2376 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 9cfcdbd6-2ff0-4cf5-bb69-9842a2b8523c response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
34892025-03-01T01:18:17.414ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 304 local_addr = [fd00:1122:3344:101::c]:34357 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = ef98c870-af5e-4018-8e9e-7ce237e50e07 response_code = 200 uri = /67b03f4e-4cbd-4843-9cd9-647f610abcfc
34902025-03-01T01:18:18.084ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 07539b49-5c53-4459-8c87-26bc2dafb9be roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
34912025-03-01T01:18:18.084ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 07539b49-5c53-4459-8c87-26bc2dafb9be resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
34922025-03-01T01:18:18.086ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2647 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 07539b49-5c53-4459-8c87-26bc2dafb9be response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
34932025-03-01T01:18:19.106ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 1b9b1f89-70f2-4bc5-a5ac-7b7d46517bf1 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
34942025-03-01T01:18:19.106ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 1b9b1f89-70f2-4bc5-a5ac-7b7d46517bf1 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
34952025-03-01T01:18:19.108ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1922 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 1b9b1f89-70f2-4bc5-a5ac-7b7d46517bf1 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
34962025-03-01T01:18:20.128ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 6476c947-fd63-47fb-b30d-84a367a02747 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
34972025-03-01T01:18:20.128ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 6476c947-fd63-47fb-b30d-84a367a02747 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
34982025-03-01T01:18:20.130ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1984 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 6476c947-fd63-47fb-b30d-84a367a02747 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
34992025-03-01T01:18:21.150ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 2366254a-7025-4192-814e-5d50947d00be roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
35002025-03-01T01:18:21.150ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 2366254a-7025-4192-814e-5d50947d00be resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
35012025-03-01T01:18:21.151ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1607 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 2366254a-7025-4192-814e-5d50947d00be response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
35022025-03-01T01:18:22.171ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = cf4dd3c4-3d73-464b-b59b-91c0f34c9074 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
35032025-03-01T01:18:22.171ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = cf4dd3c4-3d73-464b-b59b-91c0f34c9074 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
35042025-03-01T01:18:22.172ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1958 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = cf4dd3c4-3d73-464b-b59b-91c0f34c9074 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
35052025-03-01T01:18:23.193ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 93650d23-d933-4e1c-ad63-ab573c61d263 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
35062025-03-01T01:18:23.193ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 93650d23-d933-4e1c-ad63-ab573c61d263 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
35072025-03-01T01:18:23.195ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2204 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 93650d23-d933-4e1c-ad63-ab573c61d263 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
35082025-03-01T01:18:23.214ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 8 reason = Timeout
35092025-03-01T01:18:23.214ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 8 reason = Timeout
35102025-03-01T01:18:23.214ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
35112025-03-01T01:18:23.214ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 8 reason = Timeout
35122025-03-01T01:18:23.214ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
35132025-03-01T01:18:23.214ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
35142025-03-01T01:18:23.214ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 8 reason = Timeout
35152025-03-01T01:18:23.214ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
35162025-03-01T01:18:23.214ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 8 reason = Timeout
35172025-03-01T01:18:23.214ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
35182025-03-01T01:18:23.214ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 22 reason = Timeout
35192025-03-01T01:18:23.214ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 8 reason = Timeout
35202025-03-01T01:18:23.214ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 8 reason = Timeout
35212025-03-01T01:18:23.214ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
35222025-03-01T01:18:23.214ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
35232025-03-01T01:18:23.214ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 8 reason = Timeout
35242025-03-01T01:18:23.214ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35252025-03-01T01:18:23.214ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 8 reason = Timeout
35262025-03-01T01:18:23.214ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
35272025-03-01T01:18:23.214ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
35282025-03-01T01:18:23.214ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35292025-03-01T01:18:23.214ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 8 reason = Timeout
35302025-03-01T01:18:23.214ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
35312025-03-01T01:18:23.214ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 8 reason = Timeout
35322025-03-01T01:18:23.214ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
35332025-03-01T01:18:23.214ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 8 reason = Timeout
35342025-03-01T01:18:23.214ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
35352025-03-01T01:18:23.214ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 9 reason = Timeout
35362025-03-01T01:18:23.214ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
35372025-03-01T01:18:23.214ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 8 reason = Timeout
35382025-03-01T01:18:23.214ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
35392025-03-01T01:18:23.214ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 8 reason = Timeout
35402025-03-01T01:18:23.214ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 8 reason = Timeout
35412025-03-01T01:18:23.214ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
35422025-03-01T01:18:23.214ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
35432025-03-01T01:18:23.214ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 22 reason = Timeout
35442025-03-01T01:18:23.214ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35452025-03-01T01:18:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
35462025-03-01T01:18:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
35472025-03-01T01:18:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
35482025-03-01T01:18:23.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
35492025-03-01T01:18:23.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
35502025-03-01T01:18:23.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
35512025-03-01T01:18:23.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
35522025-03-01T01:18:23.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35532025-03-01T01:18:23.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
35542025-03-01T01:18:23.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
35552025-03-01T01:18:23.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
35562025-03-01T01:18:23.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35572025-03-01T01:18:23.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
35582025-03-01T01:18:23.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
35592025-03-01T01:18:23.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
35602025-03-01T01:18:23.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
35612025-03-01T01:18:23.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35622025-03-01T01:18:23.216ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
35632025-03-01T01:18:23.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
35642025-03-01T01:18:23.217ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35652025-03-01T01:18:23.218ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.706345ms iteration = 8 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
35662025-03-01T01:18:23.218ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1113, tv_nsec: 906090832 } })
35672025-03-01T01:18:23.218ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35682025-03-01T01:18:23.218ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1154
35692025-03-01T01:18:23.219ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
35702025-03-01T01:18:23.219ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
35712025-03-01T01:18:23.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
35722025-03-01T01:18:23.221ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35732025-03-01T01:18:23.221ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35742025-03-01T01:18:23.222ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
35752025-03-01T01:18:23.222ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
35762025-03-01T01:18:23.223ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
35772025-03-01T01:18:23.223ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
35782025-03-01T01:18:23.223ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
35792025-03-01T01:18:23.223ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
35802025-03-01T01:18:23.224ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
35812025-03-01T01:18:23.224ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35822025-03-01T01:18:23.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35832025-03-01T01:18:23.224ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35842025-03-01T01:18:23.225ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35852025-03-01T01:18:23.226ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
35862025-03-01T01:18:23.226ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35872025-03-01T01:18:23.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35882025-03-01T01:18:23.227ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
35892025-03-01T01:18:23.227ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
35902025-03-01T01:18:23.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
35912025-03-01T01:18:23.232ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
35922025-03-01T01:18:23.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
35932025-03-01T01:18:23.233ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35942025-03-01T01:18:23.233ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1113, tv_nsec: 921041766 } })
35952025-03-01T01:18:23.235ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1154 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66
35962025-03-01T01:18:23.236ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
35972025-03-01T01:18:23.236ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35982025-03-01T01:18:23.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35992025-03-01T01:18:23.239ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36002025-03-01T01:18:23.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36012025-03-01T01:18:23.264ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 49.331454ms iteration = 8 status = {"errors":[],"garbage_collect_requested":[]}
36022025-03-01T01:18:23.269ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
36032025-03-01T01:18:23.270ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
36042025-03-01T01:18:23.270ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
36052025-03-01T01:18:23.270ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
36062025-03-01T01:18:23.270ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
36072025-03-01T01:18:23.271ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
36082025-03-01T01:18:23.271ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36092025-03-01T01:18:23.273ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
36102025-03-01T01:18:23.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
36112025-03-01T01:18:23.275ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
36122025-03-01T01:18:23.275ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36132025-03-01T01:18:23.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36142025-03-01T01:18:23.276ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
36152025-03-01T01:18:23.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
36162025-03-01T01:18:23.277ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
36172025-03-01T01:18:23.277ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36182025-03-01T01:18:23.277ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
36192025-03-01T01:18:23.277ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36202025-03-01T01:18:23.277ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
36212025-03-01T01:18:23.278ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
36222025-03-01T01:18:23.278ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36232025-03-01T01:18:23.278ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
36242025-03-01T01:18:23.278ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
36252025-03-01T01:18:23.278ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36262025-03-01T01:18:23.278ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "865e7124-55aa-44f1-b2d4-fc669678bda3", "content-length": "26", "date": "Sat, 01 Mar 2025 01:18:23 GMT"} })
36272025-03-01T01:18:23.278ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
36282025-03-01T01:18:23.278ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36292025-03-01T01:18:23.279ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 64.7945ms iteration = 8 status = {"errors":[],"finish_invoked_ok":[]}
36302025-03-01T01:18:23.280ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 65.498894ms iteration = 22 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
36312025-03-01T01:18:23.280ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
36322025-03-01T01:18:23.280ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36332025-03-01T01:18:23.280ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36342025-03-01T01:18:23.280ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36352025-03-01T01:18:23.281ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
36362025-03-01T01:18:23.281ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
36372025-03-01T01:18:23.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
36382025-03-01T01:18:23.282ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
36392025-03-01T01:18:23.282ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 68.24419ms iteration = 8 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
36402025-03-01T01:18:23.283ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7, lookup_type: ById(8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7) } result = Ok(())
36412025-03-01T01:18:23.283ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36422025-03-01T01:18:23.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36432025-03-01T01:18:23.283ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
36442025-03-01T01:18:23.283ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 68.740021ms iteration = 8 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
36452025-03-01T01:18:23.285ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36462025-03-01T01:18:23.287ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
36472025-03-01T01:18:23.287ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
36482025-03-01T01:18:23.287ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
36492025-03-01T01:18:23.295ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 original_time_created = 2025-03-01 01:14:50.436545 UTC target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 time_created = 2025-03-01 01:14:50.436545 UTC
36502025-03-01T01:18:23.295ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 81.097763ms iteration = 22 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7","time_created":"2025-03-01T01:14:50.436545Z"}
36512025-03-01T01:18:23.300ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1162 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 zone_address = fd00:1122:3344:101::2
36522025-03-01T01:18:23.300ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
36532025-03-01T01:18:23.300ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0ee2ce2d-efd0-46a3-9747-beebbbf6bc44", "content-length": "26", "date": "Sat, 01 Mar 2025 01:18:23 GMT"} })
36542025-03-01T01:18:23.300ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1167 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
36552025-03-01T01:18:23.302ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66
36562025-03-01T01:18:23.304ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
36572025-03-01T01:18:23.304ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
36582025-03-01T01:18:23.304ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
36592025-03-01T01:18:23.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
36602025-03-01T01:18:23.304ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 90.369531ms iteration = 8 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
36612025-03-01T01:18:23.304ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 90.246368ms iteration = 8 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
36622025-03-01T01:18:23.307ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 92.27237ms iteration = 8 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
36632025-03-01T01:18:23.311ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36642025-03-01T01:18:23.314ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 3471264f-127e-4a25-bc10-2e8249e8d70a, lookup_type: ById(3471264f-127e-4a25-bc10-2e8249e8d70a) } result = Ok(())
36652025-03-01T01:18:23.314ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36662025-03-01T01:18:23.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36672025-03-01T01:18:23.316ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1114, tv_nsec: 4400924 } })
36682025-03-01T01:18:23.317ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 102.56933ms iteration = 8 status = 0
36692025-03-01T01:18:23.317ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1154
36702025-03-01T01:18:23.337ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
36712025-03-01T01:18:23.337ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
36722025-03-01T01:18:23.337ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 122.575637ms iteration = 8 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
36732025-03-01T01:18:23.358ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
36742025-03-01T01:18:23.358ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
36752025-03-01T01:18:23.428ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 214.194573ms iteration = 9 status = {"physical_disks_added":0}
36762025-03-01T01:18:23.430ZINFOnexus (BackgroundTasks): VPC route manager sled 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
36772025-03-01T01:18:23.430ZDEBGnexus (BackgroundTasks): client request SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
36782025-03-01T01:18:23.430ZDEBGnexus (BackgroundTasks): client response SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "2201c946-83e7-45cf-b8c7-fe454f6d648b", "content-length": "372", "date": "Sat, 01 Mar 2025 01:18:23 GMT"} })
36792025-03-01T01:18:23.430ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36802025-03-01T01:18:23.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36812025-03-01T01:18:23.433ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
36822025-03-01T01:18:23.433ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "0a8e07fe-38cc-4f62-96a4-e280c49d1247", "content-length": "2", "date": "Sat, 01 Mar 2025 01:18:22 GMT"} })
36832025-03-01T01:18:23.435ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
36842025-03-01T01:18:23.435ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
36852025-03-01T01:18:23.437ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 222.581535ms iteration = 8 status = null
36862025-03-01T01:18:23.451ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
36872025-03-01T01:18:23.451ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
36882025-03-01T01:18:23.452ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "77c39679-538a-4ff7-90bc-7477263c8cc6", "content-length": "26", "date": "Sat, 01 Mar 2025 01:18:23 GMT"} })
36892025-03-01T01:18:23.452ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
36902025-03-01T01:18:23.455ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
36912025-03-01T01:18:23.482ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
36922025-03-01T01:18:23.482ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
36932025-03-01T01:18:23.484ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36942025-03-01T01:18:23.486ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
36952025-03-01T01:18:23.486ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
36962025-03-01T01:18:23.486ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
36972025-03-01T01:18:23.488ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36982025-03-01T01:18:23.491ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
36992025-03-01T01:18:23.491ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
37002025-03-01T01:18:23.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
37012025-03-01T01:18:23.531ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 317.15894ms iteration = 8 status = {}
37022025-03-01T01:18:23.543ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37032025-03-01T01:18:23.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37042025-03-01T01:18:23.546ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 7f9c3c14-58c5-473f-8692-6376be44401e, rack_id: 4854cb88-dfba-4609-8f9d-72aac08cef66, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(cb10d0c6-a704-4231-b148-4f9ae21a03f8) } rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 switch_location = Switch0
37052025-03-01T01:18:23.546ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37062025-03-01T01:18:23.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37072025-03-01T01:18:23.556ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
37082025-03-01T01:18:23.556ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "9100ae3a-a419-4197-9180-65577a271fb3", "content-length": "134", "date": "Sat, 01 Mar 2025 01:18:22 GMT"} })
37092025-03-01T01:18:23.556ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
37102025-03-01T01:18:23.556ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = cb10d0c6-a704-4231-b148-4f9ae21a03f8
37112025-03-01T01:18:23.556ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
37122025-03-01T01:18:23.556ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
37132025-03-01T01:18:23.556ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
37142025-03-01T01:18:23.556ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
37152025-03-01T01:18:23.556ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
37162025-03-01T01:18:23.556ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
37172025-03-01T01:18:23.557ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
37182025-03-01T01:18:23.557ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
37192025-03-01T01:18:23.557ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66
37202025-03-01T01:18:23.557ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37212025-03-01T01:18:23.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37222025-03-01T01:18:23.560ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
37232025-03-01T01:18:23.560ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "0d6c1859-6449-48e2-aaea-1d76b302f224", "content-length": "2", "date": "Sat, 01 Mar 2025 01:18:22 GMT"} })
37242025-03-01T01:18:23.560ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
37252025-03-01T01:18:23.560ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "010c8402-b32d-41ad-9e57-0935f1f41705", "content-length": "52", "date": "Sat, 01 Mar 2025 01:18:22 GMT"} })
37262025-03-01T01:18:23.560ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 switch_location = Switch0
37272025-03-01T01:18:23.560ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
37282025-03-01T01:18:23.568ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
37292025-03-01T01:18:23.568ZDEBGnexus (BackgroundTasks): client request SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
37302025-03-01T01:18:23.585ZDEBGnexus (BackgroundTasks): client request SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
37312025-03-01T01:18:23.662ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "7ff6b0fa-e8e4-4bd0-9a6c-84b1c22b5b16", "date": "Sat, 01 Mar 2025 01:18:23 GMT"} })
37322025-03-01T01:18:23.662ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 switch = Switch0
37332025-03-01T01:18:23.662ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
37342025-03-01T01:18:23.662ZDEBGnexus (BackgroundTasks): client response SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "ce52315b-26e7-4cec-93ca-74a779a66a90", "date": "Sat, 01 Mar 2025 01:18:23 GMT"} })
37352025-03-01T01:18:23.662ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37362025-03-01T01:18:23.662ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37372025-03-01T01:18:23.662ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "7c418ca8-73e5-4f9b-a885-5201f037f44a", "content-length": "682", "date": "Sat, 01 Mar 2025 01:18:23 GMT"} })
37382025-03-01T01:18:23.662ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37392025-03-01T01:18:23.662ZDEBGnexus (BackgroundTasks): client response SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "42d902a7-df8a-4f3f-990c-a2d5db6ebcf8", "content-length": "691", "date": "Sat, 01 Mar 2025 01:18:23 GMT"} })
37402025-03-01T01:18:23.662ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
37412025-03-01T01:18:23.663ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
37422025-03-01T01:18:23.663ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
37432025-03-01T01:18:23.663ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37442025-03-01T01:18:23.664ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 450.12351ms iteration = 8 status = {}
37452025-03-01T01:18:23.665ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37462025-03-01T01:18:23.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37472025-03-01T01:18:23.666ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37482025-03-01T01:18:23.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37492025-03-01T01:18:23.669ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37502025-03-01T01:18:23.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37512025-03-01T01:18:23.670ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37522025-03-01T01:18:23.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37532025-03-01T01:18:23.672ZINFOnexus (BackgroundTasks): VPC route manager sled 3471264f-127e-4a25-bc10-2e8249e8d70a push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
37542025-03-01T01:18:23.672ZDEBGnexus (BackgroundTasks): client request SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
37552025-03-01T01:18:23.673ZDEBGnexus (BackgroundTasks): client response SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "96c99362-59eb-4b1a-8eba-94c56b247b36", "date": "Sat, 01 Mar 2025 01:18:23 GMT"} })
37562025-03-01T01:18:23.674ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 459.759385ms iteration = 8 status = {}
37572025-03-01T01:18:23.777ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37582025-03-01T01:18:23.778ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37592025-03-01T01:18:23.784ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 570.307218ms iteration = 8 status = {}
37602025-03-01T01:18:23.844ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
37612025-03-01T01:18:23.844ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
37622025-03-01T01:18:23.875ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
37632025-03-01T01:18:23.875ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:64852
37642025-03-01T01:18:23.875ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:64852 req_id = c7f4c7f1-2c90-490d-8ba4-b2268f63cda8 roles = RoleSet { roles: {} } uri = /metrics/producers
37652025-03-01T01:18:23.875ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:64852 req_id = c7f4c7f1-2c90-490d-8ba4-b2268f63cda8 resource = Database result = Ok(()) uri = /metrics/producers
37662025-03-01T01:18:23.910ZINFOnexus: assigned collector to new producer collector_id = d77aa5d6-e6f9-4845-b1d4-57f91a3621e6 file = nexus/src/app/oximeter.rs:76 producer_id = 67b03f4e-4cbd-4843-9cd9-647f610abcfc
37672025-03-01T01:18:23.910ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 35523 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:64852 req_id = c7f4c7f1-2c90-490d-8ba4-b2268f63cda8 response_code = 201 uri = /metrics/producers
37682025-03-01T01:18:23.911ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "c7f4c7f1-2c90-490d-8ba4-b2268f63cda8", "content-length": "41", "date": "Sat, 01 Mar 2025 01:18:23 GMT"} })
37692025-03-01T01:18:23.913ZDEBGnexus (producer-registration-task): registered with nexus successfully
37702025-03-01T01:18:23.913ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
37712025-03-01T01:18:24.216ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = fa1a18b8-3175-4663-979f-c9be69709a7b roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
37722025-03-01T01:18:24.216ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = fa1a18b8-3175-4663-979f-c9be69709a7b resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
37732025-03-01T01:18:24.217ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1814 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = fa1a18b8-3175-4663-979f-c9be69709a7b response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
37742025-03-01T01:18:25.238ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 93c82401-64b3-45d0-a4e2-02241a11a3e3 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
37752025-03-01T01:18:25.238ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 93c82401-64b3-45d0-a4e2-02241a11a3e3 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
37762025-03-01T01:18:25.240ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2105 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 93c82401-64b3-45d0-a4e2-02241a11a3e3 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
37772025-03-01T01:18:26.263ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 976ece13-ff65-405b-8618-a235270c2785 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
37782025-03-01T01:18:26.263ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 976ece13-ff65-405b-8618-a235270c2785 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
37792025-03-01T01:18:26.265ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2278 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 976ece13-ff65-405b-8618-a235270c2785 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
37802025-03-01T01:18:27.285ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = be26ce38-bd19-4d01-b9a7-216515b4631d roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
37812025-03-01T01:18:27.285ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = be26ce38-bd19-4d01-b9a7-216515b4631d resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
37822025-03-01T01:18:27.287ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2297 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = be26ce38-bd19-4d01-b9a7-216515b4631d response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
37832025-03-01T01:18:27.415ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 326 local_addr = [fd00:1122:3344:101::c]:34357 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = 16e87cbf-7106-4d27-ad35-fa189c9260a6 response_code = 200 uri = /67b03f4e-4cbd-4843-9cd9-647f610abcfc
37842025-03-01T01:18:28.307ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = f78ca099-3680-40f5-8272-1ef7fbaac201 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
37852025-03-01T01:18:28.307ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = f78ca099-3680-40f5-8272-1ef7fbaac201 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
37862025-03-01T01:18:28.309ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2069 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = f78ca099-3680-40f5-8272-1ef7fbaac201 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
37872025-03-01T01:18:29.328ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 3f41957f-b6dc-41a2-b118-9b716000d31a roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
37882025-03-01T01:18:29.329ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 3f41957f-b6dc-41a2-b118-9b716000d31a resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
37892025-03-01T01:18:29.330ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1838 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 3f41957f-b6dc-41a2-b118-9b716000d31a response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
37902025-03-01T01:18:30.349ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 0912139d-ae65-4445-9522-1091d63e2fa7 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
37912025-03-01T01:18:30.349ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 0912139d-ae65-4445-9522-1091d63e2fa7 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
37922025-03-01T01:18:30.351ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2393 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 0912139d-ae65-4445-9522-1091d63e2fa7 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
37932025-03-01T01:18:31.371ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = ce975395-43b7-4f23-80f8-e75f5ff852be roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
37942025-03-01T01:18:31.371ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = ce975395-43b7-4f23-80f8-e75f5ff852be resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
37952025-03-01T01:18:31.373ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2665 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = ce975395-43b7-4f23-80f8-e75f5ff852be response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
37962025-03-01T01:18:32.394ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 79206f29-5888-407c-8140-eb932cea82c4 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
37972025-03-01T01:18:32.394ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 79206f29-5888-407c-8140-eb932cea82c4 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
37982025-03-01T01:18:32.396ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2274 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 79206f29-5888-407c-8140-eb932cea82c4 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
37992025-03-01T01:18:33.214ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 23 reason = Timeout
38002025-03-01T01:18:33.215ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 23 reason = Timeout
38012025-03-01T01:18:33.215ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38022025-03-01T01:18:33.215ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38032025-03-01T01:18:33.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38042025-03-01T01:18:33.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38052025-03-01T01:18:33.217ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38062025-03-01T01:18:33.219ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
38072025-03-01T01:18:33.219ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38082025-03-01T01:18:33.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38092025-03-01T01:18:33.221ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38102025-03-01T01:18:33.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38112025-03-01T01:18:33.223ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38122025-03-01T01:18:33.226ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7, lookup_type: ById(8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7) } result = Ok(())
38132025-03-01T01:18:33.226ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38142025-03-01T01:18:33.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38152025-03-01T01:18:33.238ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 original_time_created = 2025-03-01 01:14:50.436545 UTC target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 time_created = 2025-03-01 01:14:50.436545 UTC
38162025-03-01T01:18:33.238ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.10108ms iteration = 23 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7","time_created":"2025-03-01T01:14:50.436545Z"}
38172025-03-01T01:18:33.243ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38182025-03-01T01:18:33.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38192025-03-01T01:18:33.244ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 29.576693ms iteration = 23 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
38202025-03-01T01:18:33.416ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = a9fef6a7-2873-4840-8ba0-751f6bc13064 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
38212025-03-01T01:18:33.417ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = a9fef6a7-2873-4840-8ba0-751f6bc13064 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
38222025-03-01T01:18:33.418ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1502 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = a9fef6a7-2873-4840-8ba0-751f6bc13064 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
38232025-03-01T01:18:34.439ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 40b6d930-578b-459f-9689-fcba15d26f91 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
38242025-03-01T01:18:34.440ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 40b6d930-578b-459f-9689-fcba15d26f91 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
38252025-03-01T01:18:34.441ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2257 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 40b6d930-578b-459f-9689-fcba15d26f91 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
38262025-03-01T01:18:35.461ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = f978ae4f-dd58-42a1-ba64-0d680e448ced roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
38272025-03-01T01:18:35.462ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = f978ae4f-dd58-42a1-ba64-0d680e448ced resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
38282025-03-01T01:18:35.464ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2318 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = f978ae4f-dd58-42a1-ba64-0d680e448ced response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
38292025-03-01T01:18:36.482ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = a463fab0-31bf-47ef-aff0-edb702c16184 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
38302025-03-01T01:18:36.483ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = a463fab0-31bf-47ef-aff0-edb702c16184 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
38312025-03-01T01:18:36.485ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2353 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = a463fab0-31bf-47ef-aff0-edb702c16184 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
38322025-03-01T01:18:37.414ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 384 local_addr = [fd00:1122:3344:101::c]:34357 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = 797e4c50-9f25-4cca-8731-145614e700e1 response_code = 200 uri = /67b03f4e-4cbd-4843-9cd9-647f610abcfc
38332025-03-01T01:18:37.505ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 5a28557c-1dc3-4013-99d3-ab08ed7e143d roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
38342025-03-01T01:18:37.506ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 5a28557c-1dc3-4013-99d3-ab08ed7e143d resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
38352025-03-01T01:18:37.507ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1801 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 5a28557c-1dc3-4013-99d3-ab08ed7e143d response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
38362025-03-01T01:18:38.527ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 2039109c-d4a1-47cb-a238-9fb58a83fd08 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
38372025-03-01T01:18:38.527ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 2039109c-d4a1-47cb-a238-9fb58a83fd08 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
38382025-03-01T01:18:38.529ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1866 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 2039109c-d4a1-47cb-a238-9fb58a83fd08 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
38392025-03-01T01:18:39.549ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 19b09373-6a02-4b71-a636-0b1b9a3643df roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
38402025-03-01T01:18:39.549ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 19b09373-6a02-4b71-a636-0b1b9a3643df resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
38412025-03-01T01:18:39.551ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2365 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 19b09373-6a02-4b71-a636-0b1b9a3643df response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
38422025-03-01T01:18:40.571ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = f2353666-8b50-4af8-be09-577c1dce873c roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
38432025-03-01T01:18:40.571ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = f2353666-8b50-4af8-be09-577c1dce873c resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
38442025-03-01T01:18:40.573ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2163 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = f2353666-8b50-4af8-be09-577c1dce873c response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
38452025-03-01T01:18:41.593ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = a9de96a7-3580-4587-9045-4488f7b30bca roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
38462025-03-01T01:18:41.593ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = a9de96a7-3580-4587-9045-4488f7b30bca resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
38472025-03-01T01:18:41.595ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1851 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = a9de96a7-3580-4587-9045-4488f7b30bca response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
38482025-03-01T01:18:42.614ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 5a2743ed-7507-48f7-853e-cc8f5ec46e31 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
38492025-03-01T01:18:42.614ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 5a2743ed-7507-48f7-853e-cc8f5ec46e31 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
38502025-03-01T01:18:42.617ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2475 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 5a2743ed-7507-48f7-853e-cc8f5ec46e31 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
38512025-03-01T01:18:43.215ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 24 reason = Timeout
38522025-03-01T01:18:43.215ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 24 reason = Timeout
38532025-03-01T01:18:43.215ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38542025-03-01T01:18:43.215ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38552025-03-01T01:18:43.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38562025-03-01T01:18:43.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38572025-03-01T01:18:43.217ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38582025-03-01T01:18:43.218ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38592025-03-01T01:18:43.218ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38602025-03-01T01:18:43.220ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.89736ms iteration = 24 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
38612025-03-01T01:18:43.220ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
38622025-03-01T01:18:43.220ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38632025-03-01T01:18:43.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38642025-03-01T01:18:43.222ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38652025-03-01T01:18:43.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38662025-03-01T01:18:43.223ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38672025-03-01T01:18:43.225ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7, lookup_type: ById(8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7) } result = Ok(())
38682025-03-01T01:18:43.225ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38692025-03-01T01:18:43.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38702025-03-01T01:18:43.235ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 original_time_created = 2025-03-01 01:14:50.436545 UTC target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 time_created = 2025-03-01 01:14:50.436545 UTC
38712025-03-01T01:18:43.235ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.921865ms iteration = 24 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7","time_created":"2025-03-01T01:14:50.436545Z"}
38722025-03-01T01:18:43.636ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 1f642d53-27aa-4b25-b85c-2735fa4e32c8 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
38732025-03-01T01:18:43.636ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 1f642d53-27aa-4b25-b85c-2735fa4e32c8 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
38742025-03-01T01:18:43.638ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2259 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 1f642d53-27aa-4b25-b85c-2735fa4e32c8 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
38752025-03-01T01:18:44.657ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c2f21b7f-da0e-4847-aa81-61a8a0ef857a roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
38762025-03-01T01:18:44.658ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c2f21b7f-da0e-4847-aa81-61a8a0ef857a resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
38772025-03-01T01:18:44.660ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2754 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c2f21b7f-da0e-4847-aa81-61a8a0ef857a response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
38782025-03-01T01:18:45.678ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c6e66f8b-25f8-4a4a-b9b6-d6d449bb08fd roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
38792025-03-01T01:18:45.678ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c6e66f8b-25f8-4a4a-b9b6-d6d449bb08fd resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
38802025-03-01T01:18:45.680ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2022 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c6e66f8b-25f8-4a4a-b9b6-d6d449bb08fd response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
38812025-03-01T01:18:46.700ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 0d83fe3a-fc75-4ee3-a772-3734352b656f roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
38822025-03-01T01:18:46.700ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 0d83fe3a-fc75-4ee3-a772-3734352b656f resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
38832025-03-01T01:18:46.702ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1828 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 0d83fe3a-fc75-4ee3-a772-3734352b656f response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
38842025-03-01T01:18:47.415ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 380 local_addr = [fd00:1122:3344:101::c]:34357 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = 3bb89cbf-d914-476c-952c-9614245921be response_code = 200 uri = /67b03f4e-4cbd-4843-9cd9-647f610abcfc
38852025-03-01T01:18:47.722ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 2846dc35-09f7-4528-a1c9-0e8aeb9b7100 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
38862025-03-01T01:18:47.722ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 2846dc35-09f7-4528-a1c9-0e8aeb9b7100 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
38872025-03-01T01:18:47.724ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2294 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 2846dc35-09f7-4528-a1c9-0e8aeb9b7100 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
38882025-03-01T01:18:48.744ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = e44fcc42-f37a-4e74-a709-850456a00722 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
38892025-03-01T01:18:48.744ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = e44fcc42-f37a-4e74-a709-850456a00722 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
38902025-03-01T01:18:48.746ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2285 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = e44fcc42-f37a-4e74-a709-850456a00722 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
38912025-03-01T01:18:49.767ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 917dfe5f-e35f-4fae-a451-2628a4a21880 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
38922025-03-01T01:18:49.767ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 917dfe5f-e35f-4fae-a451-2628a4a21880 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
38932025-03-01T01:18:49.768ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1954 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 917dfe5f-e35f-4fae-a451-2628a4a21880 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
38942025-03-01T01:18:50.789ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c5eeb096-6e3c-453b-9221-0db513cab382 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
38952025-03-01T01:18:50.789ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c5eeb096-6e3c-453b-9221-0db513cab382 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
38962025-03-01T01:18:50.791ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2188 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c5eeb096-6e3c-453b-9221-0db513cab382 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
38972025-03-01T01:18:51.810ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 1e8a1002-fdf3-4938-9ed9-8fc4667d62e1 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
38982025-03-01T01:18:51.811ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 1e8a1002-fdf3-4938-9ed9-8fc4667d62e1 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
38992025-03-01T01:18:51.813ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2410 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 1e8a1002-fdf3-4938-9ed9-8fc4667d62e1 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
39002025-03-01T01:18:52.833ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = aa43cb6e-c039-41ca-8d3e-6ab95d1a2fa2 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
39012025-03-01T01:18:52.834ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = aa43cb6e-c039-41ca-8d3e-6ab95d1a2fa2 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
39022025-03-01T01:18:52.835ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1936 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = aa43cb6e-c039-41ca-8d3e-6ab95d1a2fa2 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
39032025-03-01T01:18:53.214ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 7 reason = Timeout
39042025-03-01T01:18:53.214ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 9 reason = Timeout
39052025-03-01T01:18:53.214ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
39062025-03-01T01:18:53.214ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 9 reason = Timeout
39072025-03-01T01:18:53.214ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 5 reason = Timeout
39082025-03-01T01:18:53.214ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39092025-03-01T01:18:53.214ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 6 reason = Timeout
39102025-03-01T01:18:53.214ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7
39112025-03-01T01:18:53.214ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 9 reason = Timeout
39122025-03-01T01:18:53.214ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
39132025-03-01T01:18:53.214ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 17.11\u{b5}s iteration = 6 status = {"enabled":false,"target_id":"8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7"}
39142025-03-01T01:18:53.214ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 5 reason = Timeout
39152025-03-01T01:18:53.214ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 25 reason = Timeout
39162025-03-01T01:18:53.214ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39172025-03-01T01:18:53.214ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
39182025-03-01T01:18:53.214ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39192025-03-01T01:18:53.214ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 5 reason = Timeout
39202025-03-01T01:18:53.214ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 7 reason = Timeout
39212025-03-01T01:18:53.215ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 9 reason = Timeout
39222025-03-01T01:18:53.215ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
39232025-03-01T01:18:53.215ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
39242025-03-01T01:18:53.215ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 9 reason = Timeout
39252025-03-01T01:18:53.215ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39262025-03-01T01:18:53.215ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 5 reason = Timeout
39272025-03-01T01:18:53.215ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
39282025-03-01T01:18:53.215ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 9 reason = Timeout
39292025-03-01T01:18:53.215ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
39302025-03-01T01:18:53.215ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 9 reason = Timeout
39312025-03-01T01:18:53.215ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 10 reason = Timeout
39322025-03-01T01:18:53.215ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
39332025-03-01T01:18:53.215ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 25 reason = Timeout
39342025-03-01T01:18:53.215ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 9 reason = Timeout
39352025-03-01T01:18:53.215ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
39362025-03-01T01:18:53.215ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 9 reason = Timeout
39372025-03-01T01:18:53.215ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39382025-03-01T01:18:53.215ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
39392025-03-01T01:18:53.215ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 5 reason = Timeout
39402025-03-01T01:18:53.215ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
39412025-03-01T01:18:53.215ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-03-01 01:08:53.215066976 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
39422025-03-01T01:18:53.215ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
39432025-03-01T01:18:53.215ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 5 reason = Timeout
39442025-03-01T01:18:53.215ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 5 reason = Timeout
39452025-03-01T01:18:53.215ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
39462025-03-01T01:18:53.215ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 9 reason = Timeout
39472025-03-01T01:18:53.215ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
39482025-03-01T01:18:53.215ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
39492025-03-01T01:18:53.215ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 5 reason = Timeout
39502025-03-01T01:18:53.215ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
39512025-03-01T01:18:53.215ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
39522025-03-01T01:18:53.215ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 9 reason = Timeout
39532025-03-01T01:18:53.215ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
39542025-03-01T01:18:53.215ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 9 reason = Timeout
39552025-03-01T01:18:53.215ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
39562025-03-01T01:18:53.215ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 5 reason = Timeout
39572025-03-01T01:18:53.215ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
39582025-03-01T01:18:53.215ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 5 reason = Timeout
39592025-03-01T01:18:53.215ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
39602025-03-01T01:18:53.215ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
39612025-03-01T01:18:53.215ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 9 reason = Timeout
39622025-03-01T01:18:53.215ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
39632025-03-01T01:18:53.215ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 9 reason = Timeout
39642025-03-01T01:18:53.215ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 9 reason = Timeout
39652025-03-01T01:18:53.215ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
39662025-03-01T01:18:53.215ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
39672025-03-01T01:18:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39682025-03-01T01:18:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
39692025-03-01T01:18:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
39702025-03-01T01:18:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39712025-03-01T01:18:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
39722025-03-01T01:18:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39732025-03-01T01:18:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39742025-03-01T01:18:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
39752025-03-01T01:18:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
39762025-03-01T01:18:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
39772025-03-01T01:18:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39782025-03-01T01:18:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
39792025-03-01T01:18:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
39802025-03-01T01:18:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
39812025-03-01T01:18:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
39822025-03-01T01:18:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
39832025-03-01T01:18:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
39842025-03-01T01:18:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
39852025-03-01T01:18:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
39862025-03-01T01:18:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
39872025-03-01T01:18:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
39882025-03-01T01:18:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
39892025-03-01T01:18:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
39902025-03-01T01:18:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
39912025-03-01T01:18:53.215ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2e37f4af-57dc-468e-80e3-cf2aea2ffdc8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5f6eb3bd-0126-40e0-98ef-ee33df084158.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("5f6eb3bd-0126-40e0-98ef-ee33df084158.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1143, tv_nsec: 903296515 } })
39922025-03-01T01:18:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
39932025-03-01T01:18:53.215ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("3a9b8294-d9f3-4130-a669-e74c6f1f65a0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("450e8d93-9ed3-4721-9fe9-42521f60bc93.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a4f72c78-99c6-478d-b490-f7d8793d4173.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("a4f72c78-99c6-478d-b490-f7d8793d4173.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1143, tv_nsec: 903323785 } })
39942025-03-01T01:18:53.216ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
39952025-03-01T01:18:53.216ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.371138ms iteration = 5 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
39962025-03-01T01:18:53.216ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
39972025-03-01T01:18:53.216ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.284346ms iteration = 5 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
39982025-03-01T01:18:53.217ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39992025-03-01T01:18:53.218ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40002025-03-01T01:18:53.218ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1143, tv_nsec: 906323456 } })
40012025-03-01T01:18:53.219ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1154
40022025-03-01T01:18:53.219ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.311998ms iteration = 9 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
40032025-03-01T01:18:53.219ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 4.613334ms iteration = 5 status = {"errors":[],"found_port_ok":[]}
40042025-03-01T01:18:53.219ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 4.726636ms iteration = 9 status = {"errors":[],"garbage_collect_requested":[]}
40052025-03-01T01:18:53.219ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
40062025-03-01T01:18:53.219ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40072025-03-01T01:18:53.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40082025-03-01T01:18:53.221ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
40092025-03-01T01:18:53.221ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40102025-03-01T01:18:53.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40112025-03-01T01:18:53.222ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40122025-03-01T01:18:53.223ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1143, tv_nsec: 910731446 } })
40132025-03-01T01:18:53.223ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1154
40142025-03-01T01:18:53.224ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
40152025-03-01T01:18:53.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
40162025-03-01T01:18:53.224ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
40172025-03-01T01:18:53.224ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40182025-03-01T01:18:53.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40192025-03-01T01:18:53.226ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40202025-03-01T01:18:53.226ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
40212025-03-01T01:18:53.226ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
40222025-03-01T01:18:53.226ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
40232025-03-01T01:18:53.227ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40242025-03-01T01:18:53.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
40252025-03-01T01:18:53.227ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
40262025-03-01T01:18:53.227ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40272025-03-01T01:18:53.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
40282025-03-01T01:18:53.227ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40292025-03-01T01:18:53.228ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
40302025-03-01T01:18:53.228ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
40312025-03-01T01:18:53.228ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
40322025-03-01T01:18:53.229ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
40332025-03-01T01:18:53.229ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
40342025-03-01T01:18:53.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
40352025-03-01T01:18:53.230ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
40362025-03-01T01:18:53.230ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
40372025-03-01T01:18:53.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
40382025-03-01T01:18:53.231ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
40392025-03-01T01:18:53.231ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
40402025-03-01T01:18:53.231ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
40412025-03-01T01:18:53.232ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
40422025-03-01T01:18:53.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
40432025-03-01T01:18:53.233ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40442025-03-01T01:18:53.233ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
40452025-03-01T01:18:53.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
40462025-03-01T01:18:53.234ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
40472025-03-01T01:18:53.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
40482025-03-01T01:18:53.235ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
40492025-03-01T01:18:53.235ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
40502025-03-01T01:18:53.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
40512025-03-01T01:18:53.236ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1143, tv_nsec: 923775292 } })
40522025-03-01T01:18:53.236ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1154 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66
40532025-03-01T01:18:53.238ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40542025-03-01T01:18:53.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40552025-03-01T01:18:53.238ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40562025-03-01T01:18:53.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40572025-03-01T01:18:53.239ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40582025-03-01T01:18:53.241ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
40592025-03-01T01:18:53.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
40602025-03-01T01:18:53.243ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
40612025-03-01T01:18:53.245ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
40622025-03-01T01:18:53.245ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
40632025-03-01T01:18:53.245ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
40642025-03-01T01:18:53.245ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
40652025-03-01T01:18:53.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
40662025-03-01T01:18:53.247ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40672025-03-01T01:18:53.248ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
40682025-03-01T01:18:53.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
40692025-03-01T01:18:53.251ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
40702025-03-01T01:18:53.253ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40712025-03-01T01:18:53.255ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
40722025-03-01T01:18:53.255ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40732025-03-01T01:18:53.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40742025-03-01T01:18:53.257ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40752025-03-01T01:18:53.257ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40762025-03-01T01:18:53.257ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40772025-03-01T01:18:53.261ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
40782025-03-01T01:18:53.261ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
40792025-03-01T01:18:53.261ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
40802025-03-01T01:18:53.261ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7, lookup_type: ById(8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7) } result = Ok(())
40812025-03-01T01:18:53.261ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40822025-03-01T01:18:53.262ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
40832025-03-01T01:18:53.262ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
40842025-03-01T01:18:53.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40852025-03-01T01:18:53.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
40862025-03-01T01:18:53.264ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40872025-03-01T01:18:53.266ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
40882025-03-01T01:18:53.266ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40892025-03-01T01:18:53.267ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40902025-03-01T01:18:53.268ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40912025-03-01T01:18:53.268ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
40922025-03-01T01:18:53.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
40932025-03-01T01:18:53.272ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
40942025-03-01T01:18:53.272ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
40952025-03-01T01:18:53.272ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
40962025-03-01T01:18:53.275ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
40972025-03-01T01:18:53.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
40982025-03-01T01:18:53.277ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40992025-03-01T01:18:53.278ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
41002025-03-01T01:18:53.278ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
41012025-03-01T01:18:53.278ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 63.307449ms iteration = 5 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
41022025-03-01T01:18:53.279ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
41032025-03-01T01:18:53.279ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
41042025-03-01T01:18:53.280ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
41052025-03-01T01:18:53.280ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 65.559985ms iteration = 9 status = {"errors":[],"finish_invoked_ok":[]}
41062025-03-01T01:18:53.283ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
41072025-03-01T01:18:53.283ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
41082025-03-01T01:18:53.283ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
41092025-03-01T01:18:53.283ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 68.282711ms iteration = 25 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
41102025-03-01T01:18:53.283ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 original_time_created = 2025-03-01 01:14:50.436545 UTC target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 time_created = 2025-03-01 01:14:50.436545 UTC
41112025-03-01T01:18:53.283ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 68.520266ms iteration = 25 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7","time_created":"2025-03-01T01:14:50.436545Z"}
41122025-03-01T01:18:53.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
41132025-03-01T01:18:53.284ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
41142025-03-01T01:18:53.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
41152025-03-01T01:18:53.286ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 70.912244ms iteration = 9 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
41162025-03-01T01:18:53.287ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
41172025-03-01T01:18:53.287ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 72.745651ms iteration = 9 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
41182025-03-01T01:18:53.288ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
41192025-03-01T01:18:53.288ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
41202025-03-01T01:18:53.288ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 73.482947ms iteration = 5 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
41212025-03-01T01:18:53.289ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
41222025-03-01T01:18:53.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
41232025-03-01T01:18:53.291ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
41242025-03-01T01:18:53.291ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
41252025-03-01T01:18:53.291ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
41262025-03-01T01:18:53.292ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
41272025-03-01T01:18:53.292ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
41282025-03-01T01:18:53.292ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
41292025-03-01T01:18:53.292ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
41302025-03-01T01:18:53.297ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
41312025-03-01T01:18:53.297ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
41322025-03-01T01:18:53.335ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-03-01 01:08:53.215066976 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
41332025-03-01T01:18:53.335ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 120.476784ms iteration = 5 status = {"expiration":"2025-03-01T01:08:53.215066976Z","pruned":[]}
41342025-03-01T01:18:53.355ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
41352025-03-01T01:18:53.374ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
41362025-03-01T01:18:53.374ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
41372025-03-01T01:18:53.374ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9c4d3bcc-735a-4418-99d8-9ea9ef5b3970", "content-length": "26", "date": "Sat, 01 Mar 2025 01:18:53 GMT"} })
41382025-03-01T01:18:53.374ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
41392025-03-01T01:18:53.376ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
41402025-03-01T01:18:53.390ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
41412025-03-01T01:18:53.390ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
41422025-03-01T01:18:53.398ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
41432025-03-01T01:18:53.398ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
41442025-03-01T01:18:53.399ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8535f195-cce8-4038-8a49-6747eb77b273", "content-length": "26", "date": "Sat, 01 Mar 2025 01:18:53 GMT"} })
41452025-03-01T01:18:53.399ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
41462025-03-01T01:18:53.400ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
41472025-03-01T01:18:53.402ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 187.295765ms iteration = 10 status = {"physical_disks_added":0}
41482025-03-01T01:18:53.458ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
41492025-03-01T01:18:53.474ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1162 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 zone_address = fd00:1122:3344:101::2
41502025-03-01T01:18:53.474ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
41512025-03-01T01:18:53.474ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9b5854a2-03a3-4f70-9d6e-981a5d1e470f", "content-length": "26", "date": "Sat, 01 Mar 2025 01:18:53 GMT"} })
41522025-03-01T01:18:53.474ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1167 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
41532025-03-01T01:18:53.475ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66
41542025-03-01T01:18:53.560ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
41552025-03-01T01:18:53.564ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 349.967019ms iteration = 9 status = {}
41562025-03-01T01:18:53.572ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
41572025-03-01T01:18:53.572ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "32040a42-f5b1-449c-af77-5b211cc027ea", "content-length": "2", "date": "Sat, 01 Mar 2025 01:18:52 GMT"} })
41582025-03-01T01:18:53.573ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
41592025-03-01T01:18:53.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
41602025-03-01T01:18:53.602ZINFOnexus (BackgroundTasks): VPC route manager sled 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
41612025-03-01T01:18:53.602ZDEBGnexus (BackgroundTasks): client request SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
41622025-03-01T01:18:53.605ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 390.328201ms iteration = 9 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
41632025-03-01T01:18:53.608ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-03-01T01:14:49.537343Z, time_modified: 2025-03-01T01:14:49.537343Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 1682a303-6254-452b-b4cf-160ed9dc3fc9, db_silo: Silo { identity: SiloIdentity { id: 1682a303-6254-452b-b4cf-160ed9dc3fc9, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-03-01T01:14:54.631650Z, time_modified: 2025-03-01T01:14:54.631650Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "851c0b739689cfb98a2e401e6047fa98e9fcc283d9fc3f660bd69842a9c06be9" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 1682a303-6254-452b-b4cf-160ed9dc3fc9, db_silo: Silo { identity: SiloIdentity { id: 1682a303-6254-452b-b4cf-160ed9dc3fc9, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-03-01T01:14:54.631650Z, time_modified: 2025-03-01T01:14:54.631650Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "851c0b739689cfb98a2e401e6047fa98e9fcc283d9fc3f660bd69842a9c06be9" }] }) }
41642025-03-01T01:18:53.608ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 392.972505ms iteration = 5 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"1682a303-6254-452b-b4cf-160ed9dc3fc9","tls_certs":["851c0b739689cfb98a2e401e6047fa98e9fcc283d9fc3f660bd69842a9c06be9"]}},"default_endpoint":{"silo_id":"1682a303-6254-452b-b4cf-160ed9dc3fc9","tls_certs":["851c0b739689cfb98a2e401e6047fa98e9fcc283d9fc3f660bd69842a9c06be9"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
41652025-03-01T01:18:53.612ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
41662025-03-01T01:18:53.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
41672025-03-01T01:18:53.619ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 404.547491ms iteration = 9 status = null
41682025-03-01T01:18:53.625ZDEBGnexus (BackgroundTasks): client response SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "2cf86ee3-07ec-4437-adf5-69a9c096f91e", "content-length": "372", "date": "Sat, 01 Mar 2025 01:18:53 GMT"} })
41692025-03-01T01:18:53.625ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41702025-03-01T01:18:53.625ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41712025-03-01T01:18:53.641ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
41722025-03-01T01:18:53.641ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 0a9e4b5c-53a1-4f0a-8849-98a8b1852af3 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
41732025-03-01T01:18:53.641ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
41742025-03-01T01:18:53.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
41752025-03-01T01:18:53.643ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41762025-03-01T01:18:53.647ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
41772025-03-01T01:18:53.647ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
41782025-03-01T01:18:53.648ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
41792025-03-01T01:18:53.651ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
41802025-03-01T01:18:53.652ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "fd2a421b-09fd-46af-9705-8fd84df11465", "date": "Sat, 01 Mar 2025 01:18:53 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
41812025-03-01T01:18:53.652ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
41822025-03-01T01:18:53.653ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41832025-03-01T01:18:53.654ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "13a0ea29-af86-443a-8c96-240c4c19e0c4", "date": "Sat, 01 Mar 2025 01:18:53 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
41842025-03-01T01:18:53.654ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
41852025-03-01T01:18:53.656ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
41862025-03-01T01:18:53.656ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 441.560995ms iteration = 7 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
41872025-03-01T01:18:53.656ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 0a9e4b5c-53a1-4f0a-8849-98a8b1852af3 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
41882025-03-01T01:18:53.656ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
41892025-03-01T01:18:53.656ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-03-01 01:14:53.460216 UTC dns_group = internal generation = 1
41902025-03-01T01:18:53.656ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 441.84231ms iteration = 5 status = {"generation":1}
41912025-03-01T01:18:53.659ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 3471264f-127e-4a25-bc10-2e8249e8d70a, lookup_type: ById(3471264f-127e-4a25-bc10-2e8249e8d70a) } result = Ok(())
41922025-03-01T01:18:53.659ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41932025-03-01T01:18:53.659ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
41942025-03-01T01:18:53.659ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
41952025-03-01T01:18:53.661ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
41962025-03-01T01:18:53.662ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 447.1923ms iteration = 9 status = 0
41972025-03-01T01:18:53.662ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "e9992b5b-c0a4-4ae9-81bc-0b9fa71c83d9", "date": "Sat, 01 Mar 2025 01:18:53 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
41982025-03-01T01:18:53.662ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
41992025-03-01T01:18:53.662ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
42002025-03-01T01:18:53.662ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
42012025-03-01T01:18:53.662ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
42022025-03-01T01:18:53.664ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "ca9a739d-5f17-496b-8a4d-a6b7e14aec6b", "date": "Sat, 01 Mar 2025 01:18:53 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
42032025-03-01T01:18:53.664ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
42042025-03-01T01:18:53.665ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
42052025-03-01T01:18:53.665ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
42062025-03-01T01:18:53.665ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 450.372665ms iteration = 9 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
42072025-03-01T01:18:53.666ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "0f62fd61-8669-4361-a608-7e2ce1485a94", "date": "Sat, 01 Mar 2025 01:18:53 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
42082025-03-01T01:18:53.666ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
42092025-03-01T01:18:53.667ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 452.268793ms iteration = 9 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
42102025-03-01T01:18:53.668ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
42112025-03-01T01:18:53.668ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 453.776523ms iteration = 7 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
42122025-03-01T01:18:53.671ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42132025-03-01T01:18:53.674ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
42142025-03-01T01:18:53.674ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
42152025-03-01T01:18:53.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
42162025-03-01T01:18:53.676ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
42172025-03-01T01:18:53.676ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
42182025-03-01T01:18:53.678ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42192025-03-01T01:18:53.681ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
42202025-03-01T01:18:53.681ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
42212025-03-01T01:18:53.681ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
42222025-03-01T01:18:53.692ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
42232025-03-01T01:18:53.692ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 477.543588ms iteration = 9 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
42242025-03-01T01:18:53.693ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
42252025-03-01T01:18:53.693ZDEBGnexus (BackgroundTasks): client request SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
42262025-03-01T01:18:53.694ZDEBGnexus (BackgroundTasks): client response SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "467f567b-5495-4890-933e-6b7bc6dee08d", "date": "Sat, 01 Mar 2025 01:18:53 GMT"} })
42272025-03-01T01:18:53.694ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
42282025-03-01T01:18:53.694ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
42292025-03-01T01:18:53.696ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
42302025-03-01T01:18:53.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
42312025-03-01T01:18:53.699ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
42322025-03-01T01:18:53.699ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
42332025-03-01T01:18:53.702ZINFOnexus (BackgroundTasks): VPC route manager sled 3471264f-127e-4a25-bc10-2e8249e8d70a push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
42342025-03-01T01:18:53.703ZDEBGnexus (BackgroundTasks): client request SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
42352025-03-01T01:18:53.703ZDEBGnexus (BackgroundTasks): client response SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "d3922eb8-87bf-4363-aa80-2277a7b11f26", "date": "Sat, 01 Mar 2025 01:18:53 GMT"} })
42362025-03-01T01:18:53.705ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 490.157265ms iteration = 9 status = {}
42372025-03-01T01:18:53.718ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
42382025-03-01T01:18:53.718ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = cce65e3e-6c86-4cdd-98ad-9a38c98082e8 dns_zone_name = oxide.test found_so_far = 0 version = 2
42392025-03-01T01:18:53.718ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
42402025-03-01T01:18:53.719ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
42412025-03-01T01:18:53.722ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42422025-03-01T01:18:53.724ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
42432025-03-01T01:18:53.724ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
42442025-03-01T01:18:53.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
42452025-03-01T01:18:53.725ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42462025-03-01T01:18:53.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42472025-03-01T01:18:53.727ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 7f9c3c14-58c5-473f-8692-6376be44401e, rack_id: 4854cb88-dfba-4609-8f9d-72aac08cef66, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(cb10d0c6-a704-4231-b148-4f9ae21a03f8) } rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 switch_location = Switch0
42482025-03-01T01:18:53.727ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42492025-03-01T01:18:53.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42502025-03-01T01:18:53.728ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
42512025-03-01T01:18:53.728ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 513.419488ms iteration = 5 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
42522025-03-01T01:18:53.740ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
42532025-03-01T01:18:53.741ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "0f75c0a2-2825-4f66-843b-d3596eff2dbd", "content-length": "134", "date": "Sat, 01 Mar 2025 01:18:52 GMT"} })
42542025-03-01T01:18:53.741ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
42552025-03-01T01:18:53.741ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = cb10d0c6-a704-4231-b148-4f9ae21a03f8
42562025-03-01T01:18:53.741ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
42572025-03-01T01:18:53.741ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
42582025-03-01T01:18:53.741ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
42592025-03-01T01:18:53.741ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
42602025-03-01T01:18:53.741ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
42612025-03-01T01:18:53.741ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
42622025-03-01T01:18:53.741ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
42632025-03-01T01:18:53.741ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
42642025-03-01T01:18:53.741ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66
42652025-03-01T01:18:53.741ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42662025-03-01T01:18:53.742ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42672025-03-01T01:18:53.744ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
42682025-03-01T01:18:53.744ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "88328178-3e1b-4171-add4-c457ed5e0bfd", "content-length": "2", "date": "Sat, 01 Mar 2025 01:18:52 GMT"} })
42692025-03-01T01:18:53.744ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
42702025-03-01T01:18:53.745ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "a4a3fa36-ee92-4c2d-9ac0-751339e59a2c", "content-length": "52", "date": "Sat, 01 Mar 2025 01:18:52 GMT"} })
42712025-03-01T01:18:53.745ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 switch_location = Switch0
42722025-03-01T01:18:53.745ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
42732025-03-01T01:18:53.755ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42742025-03-01T01:18:53.758ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
42752025-03-01T01:18:53.758ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
42762025-03-01T01:18:53.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
42772025-03-01T01:18:53.760ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = cce65e3e-6c86-4cdd-98ad-9a38c98082e8 dns_zone_name = oxide.test found_so_far = 1 version = 2
42782025-03-01T01:18:53.760ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
42792025-03-01T01:18:53.760ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-03-01 01:14:54.679503 UTC dns_group = external generation = 2
42802025-03-01T01:18:53.760ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 545.425791ms iteration = 5 status = {"generation":2}
42812025-03-01T01:18:53.820ZDEBGnexus (BackgroundTasks): client request SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
42822025-03-01T01:18:53.852ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "6764d772-c10c-4e5f-94d6-72d7f8bbb18a", "date": "Sat, 01 Mar 2025 01:18:53 GMT"} })
42832025-03-01T01:18:53.852ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 switch = Switch0
42842025-03-01T01:18:53.852ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
42852025-03-01T01:18:53.852ZDEBGnexus (BackgroundTasks): client response SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "1e872770-9925-4960-9b9e-bfb280bb6945", "content-length": "691", "date": "Sat, 01 Mar 2025 01:18:53 GMT"} })
42862025-03-01T01:18:53.853ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
42872025-03-01T01:18:53.853ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
42882025-03-01T01:18:53.853ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
42892025-03-01T01:18:53.853ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "c681337a-f5a1-41db-b10f-ddefbf017633", "content-length": "682", "date": "Sat, 01 Mar 2025 01:18:53 GMT"} })
42902025-03-01T01:18:53.853ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42912025-03-01T01:18:53.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42922025-03-01T01:18:53.854ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 639.314783ms iteration = 9 status = {}
42932025-03-01T01:18:53.856ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 2b5eab82-e9cf-4114-b452-e1d004a1d730 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
42942025-03-01T01:18:53.857ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42952025-03-01T01:18:53.857ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 2b5eab82-e9cf-4114-b452-e1d004a1d730 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
42962025-03-01T01:18:53.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42972025-03-01T01:18:53.859ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2221 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 2b5eab82-e9cf-4114-b452-e1d004a1d730 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
42982025-03-01T01:18:53.860ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42992025-03-01T01:18:53.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43002025-03-01T01:18:53.863ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43012025-03-01T01:18:53.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43022025-03-01T01:18:53.870ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 655.35077ms iteration = 9 status = {}
43032025-03-01T01:18:54.878ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 4659c0c7-3718-43ce-b5ae-41b904cd05b9 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
43042025-03-01T01:18:54.878ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 4659c0c7-3718-43ce-b5ae-41b904cd05b9 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
43052025-03-01T01:18:54.880ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1935 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 4659c0c7-3718-43ce-b5ae-41b904cd05b9 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
43062025-03-01T01:18:55.900ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = a4841ab6-fc87-444e-a7e7-824d2eda330c roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
43072025-03-01T01:18:55.901ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = a4841ab6-fc87-444e-a7e7-824d2eda330c resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
43082025-03-01T01:18:55.902ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2104 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = a4841ab6-fc87-444e-a7e7-824d2eda330c response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
43092025-03-01T01:18:56.921ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 2e64f20c-5cf8-4d18-9a94-7f8f8f7b97f1 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
43102025-03-01T01:18:56.922ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 2e64f20c-5cf8-4d18-9a94-7f8f8f7b97f1 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
43112025-03-01T01:18:56.923ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1951 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 2e64f20c-5cf8-4d18-9a94-7f8f8f7b97f1 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
43122025-03-01T01:18:57.415ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 397 local_addr = [fd00:1122:3344:101::c]:34357 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = abb14134-366e-415d-a9c6-a35c3c9685dc response_code = 200 uri = /67b03f4e-4cbd-4843-9cd9-647f610abcfc
43132025-03-01T01:18:57.943ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = fbd600d9-a6ac-4eb1-bdc1-f3148110b898 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
43142025-03-01T01:18:57.943ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = fbd600d9-a6ac-4eb1-bdc1-f3148110b898 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
43152025-03-01T01:18:57.948ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 4777 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = fbd600d9-a6ac-4eb1-bdc1-f3148110b898 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
43162025-03-01T01:18:58.966ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 9b05e85c-e285-44c5-a825-ba0d407d5367 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
43172025-03-01T01:18:58.967ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 9b05e85c-e285-44c5-a825-ba0d407d5367 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
43182025-03-01T01:18:58.969ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2906 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 9b05e85c-e285-44c5-a825-ba0d407d5367 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
43192025-03-01T01:18:59.988ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 15b4a1eb-2e81-41be-8d08-95eeb0e99bf0 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
43202025-03-01T01:18:59.988ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 15b4a1eb-2e81-41be-8d08-95eeb0e99bf0 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
43212025-03-01T01:18:59.990ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2159 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 15b4a1eb-2e81-41be-8d08-95eeb0e99bf0 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
43222025-03-01T01:19:01.012ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 5d460d47-c9f4-438e-aacc-5ff5e9ba22c3 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
43232025-03-01T01:19:01.012ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 5d460d47-c9f4-438e-aacc-5ff5e9ba22c3 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
43242025-03-01T01:19:01.014ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2691 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 5d460d47-c9f4-438e-aacc-5ff5e9ba22c3 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
43252025-03-01T01:19:02.034ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = f01a0892-d7af-42ce-a012-fda2f142c93b roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
43262025-03-01T01:19:02.034ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = f01a0892-d7af-42ce-a012-fda2f142c93b resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
43272025-03-01T01:19:02.035ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1813 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = f01a0892-d7af-42ce-a012-fda2f142c93b response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
43282025-03-01T01:19:03.054ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 9e966999-ed90-4dc8-8e3b-287d954bbbef roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
43292025-03-01T01:19:03.055ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 9e966999-ed90-4dc8-8e3b-287d954bbbef resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
43302025-03-01T01:19:03.057ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2232 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 9e966999-ed90-4dc8-8e3b-287d954bbbef response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
43312025-03-01T01:19:03.215ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 26 reason = Timeout
43322025-03-01T01:19:03.215ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 26 reason = Timeout
43332025-03-01T01:19:03.215ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43342025-03-01T01:19:03.215ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
43352025-03-01T01:19:03.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43362025-03-01T01:19:03.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
43372025-03-01T01:19:03.218ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
43382025-03-01T01:19:03.218ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
43392025-03-01T01:19:03.220ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.90467ms iteration = 26 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
43402025-03-01T01:19:03.245ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43412025-03-01T01:19:03.247ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
43422025-03-01T01:19:03.247ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43432025-03-01T01:19:03.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43442025-03-01T01:19:03.250ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43452025-03-01T01:19:03.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43462025-03-01T01:19:03.283ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43472025-03-01T01:19:03.286ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7, lookup_type: ById(8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7) } result = Ok(())
43482025-03-01T01:19:03.286ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43492025-03-01T01:19:03.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43502025-03-01T01:19:03.298ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 original_time_created = 2025-03-01 01:14:50.436545 UTC target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 time_created = 2025-03-01 01:14:50.436545 UTC
43512025-03-01T01:19:03.298ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 83.547052ms iteration = 26 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7","time_created":"2025-03-01T01:14:50.436545Z"}
43522025-03-01T01:19:04.078ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 4664f739-4720-4e50-beb5-08a497627a01 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
43532025-03-01T01:19:04.078ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 4664f739-4720-4e50-beb5-08a497627a01 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
43542025-03-01T01:19:04.080ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2277 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 4664f739-4720-4e50-beb5-08a497627a01 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
43552025-03-01T01:19:05.100ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 9e3090a6-d69e-42d9-9637-58d5cdda8665 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
43562025-03-01T01:19:05.100ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 9e3090a6-d69e-42d9-9637-58d5cdda8665 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
43572025-03-01T01:19:05.102ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2374 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 9e3090a6-d69e-42d9-9637-58d5cdda8665 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
43582025-03-01T01:19:06.121ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = afd6fc2a-de78-4783-92da-869d457d1af7 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
43592025-03-01T01:19:06.121ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = afd6fc2a-de78-4783-92da-869d457d1af7 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
43602025-03-01T01:19:06.123ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1949 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = afd6fc2a-de78-4783-92da-869d457d1af7 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
43612025-03-01T01:19:07.143ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = d267b5ea-7343-4c67-a52e-81e0cae1c640 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
43622025-03-01T01:19:07.144ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = d267b5ea-7343-4c67-a52e-81e0cae1c640 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
43632025-03-01T01:19:07.145ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2009 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = d267b5ea-7343-4c67-a52e-81e0cae1c640 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
43642025-03-01T01:19:07.407ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61177 req_id = 55572426-b589-4aa2-82ca-cc992c276dbe roles = RoleSet { roles: {} } uri = /metrics/collectors/d77aa5d6-e6f9-4845-b1d4-57f91a3621e6/producers?sort_by=id_ascending
43652025-03-01T01:19:07.408ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61177 req_id = 55572426-b589-4aa2-82ca-cc992c276dbe resource = Database result = Ok(()) uri = /metrics/collectors/d77aa5d6-e6f9-4845-b1d4-57f91a3621e6/producers?sort_by=id_ascending
43662025-03-01T01:19:07.410ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2480 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61177 req_id = 55572426-b589-4aa2-82ca-cc992c276dbe response_code = 200 uri = /metrics/collectors/d77aa5d6-e6f9-4845-b1d4-57f91a3621e6/producers?sort_by=id_ascending
43672025-03-01T01:19:07.410ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61177 req_id = 1f4174d5-e8ff-4bae-aa10-a68d8dc3a954 roles = RoleSet { roles: {} } uri = /metrics/collectors/d77aa5d6-e6f9-4845-b1d4-57f91a3621e6/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYmI0ODUwMS0zYzRlLTRkNDQtODgyMy1mOTc1ZTg2OTFmZmYifX0%3D
43682025-03-01T01:19:07.410ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61177 req_id = 1f4174d5-e8ff-4bae-aa10-a68d8dc3a954 resource = Database result = Ok(()) uri = /metrics/collectors/d77aa5d6-e6f9-4845-b1d4-57f91a3621e6/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYmI0ODUwMS0zYzRlLTRkNDQtODgyMy1mOTc1ZTg2OTFmZmYifX0%3D
43692025-03-01T01:19:07.412ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2370 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61177 req_id = 1f4174d5-e8ff-4bae-aa10-a68d8dc3a954 response_code = 200 uri = /metrics/collectors/d77aa5d6-e6f9-4845-b1d4-57f91a3621e6/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYmI0ODUwMS0zYzRlLTRkNDQtODgyMy1mOTc1ZTg2OTFmZmYifX0%3D
43702025-03-01T01:19:07.415ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 357 local_addr = [fd00:1122:3344:101::c]:34357 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = fd63ee3b-6a43-4d8c-8654-624b78d0e72a response_code = 200 uri = /67b03f4e-4cbd-4843-9cd9-647f610abcfc
43712025-03-01T01:19:08.166ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 44842682-af6d-4d78-8a90-b9ce01174b9d roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
43722025-03-01T01:19:08.166ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 44842682-af6d-4d78-8a90-b9ce01174b9d resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
43732025-03-01T01:19:08.168ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2375 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 44842682-af6d-4d78-8a90-b9ce01174b9d response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
43742025-03-01T01:19:09.188ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 1ee24187-f731-400d-8ece-96d8b3dbcabc roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
43752025-03-01T01:19:09.188ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 1ee24187-f731-400d-8ece-96d8b3dbcabc resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
43762025-03-01T01:19:09.190ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1964 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 1ee24187-f731-400d-8ece-96d8b3dbcabc response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
43772025-03-01T01:19:10.210ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 0d279af8-add6-40a5-be75-eff7a111dd5c roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
43782025-03-01T01:19:10.210ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 0d279af8-add6-40a5-be75-eff7a111dd5c resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
43792025-03-01T01:19:10.212ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2530 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 0d279af8-add6-40a5-be75-eff7a111dd5c response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
43802025-03-01T01:19:11.232ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = d8c3b303-50a9-4bde-8e6e-573b4c2598b1 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
43812025-03-01T01:19:11.232ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = d8c3b303-50a9-4bde-8e6e-573b4c2598b1 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
43822025-03-01T01:19:11.234ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1950 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = d8c3b303-50a9-4bde-8e6e-573b4c2598b1 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
43832025-03-01T01:19:12.253ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 4ae0eb99-c4d0-44d8-ae32-9fbc4eca63b9 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
43842025-03-01T01:19:12.253ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 4ae0eb99-c4d0-44d8-ae32-9fbc4eca63b9 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
43852025-03-01T01:19:12.255ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2032 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 4ae0eb99-c4d0-44d8-ae32-9fbc4eca63b9 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
43862025-03-01T01:19:13.214ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 27 reason = Timeout
43872025-03-01T01:19:13.214ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
43882025-03-01T01:19:13.214ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 27 reason = Timeout
43892025-03-01T01:19:13.214ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43902025-03-01T01:19:13.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
43912025-03-01T01:19:13.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43922025-03-01T01:19:13.216ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
43932025-03-01T01:19:13.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
43942025-03-01T01:19:13.217ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43952025-03-01T01:19:13.220ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
43962025-03-01T01:19:13.220ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43972025-03-01T01:19:13.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43982025-03-01T01:19:13.222ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43992025-03-01T01:19:13.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44002025-03-01T01:19:13.223ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44012025-03-01T01:19:13.226ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7, lookup_type: ById(8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7) } result = Ok(())
44022025-03-01T01:19:13.226ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44032025-03-01T01:19:13.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44042025-03-01T01:19:13.238ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 original_time_created = 2025-03-01 01:14:50.436545 UTC target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 time_created = 2025-03-01 01:14:50.436545 UTC
44052025-03-01T01:19:13.238ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.500479ms iteration = 27 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7","time_created":"2025-03-01T01:14:50.436545Z"}
44062025-03-01T01:19:13.245ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.766917ms iteration = 27 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
44072025-03-01T01:19:13.274ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 800fcbe0-4dee-49e6-9239-337ccdda8c7c roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
44082025-03-01T01:19:13.275ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 800fcbe0-4dee-49e6-9239-337ccdda8c7c resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
44092025-03-01T01:19:13.276ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1845 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 800fcbe0-4dee-49e6-9239-337ccdda8c7c response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
44102025-03-01T01:19:14.296ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 421b6007-e730-44cf-933e-aa855006d682 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
44112025-03-01T01:19:14.296ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 421b6007-e730-44cf-933e-aa855006d682 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
44122025-03-01T01:19:14.298ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2380 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 421b6007-e730-44cf-933e-aa855006d682 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
44132025-03-01T01:19:15.318ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 61767675-6c9f-4502-8777-b309db365849 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
44142025-03-01T01:19:15.318ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 61767675-6c9f-4502-8777-b309db365849 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
44152025-03-01T01:19:15.320ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2432 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 61767675-6c9f-4502-8777-b309db365849 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
44162025-03-01T01:19:16.341ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = d2fd53d8-4569-4487-b6e2-eed379d5061b roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
44172025-03-01T01:19:16.341ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = d2fd53d8-4569-4487-b6e2-eed379d5061b resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
44182025-03-01T01:19:16.343ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2379 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = d2fd53d8-4569-4487-b6e2-eed379d5061b response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
44192025-03-01T01:19:17.363ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 2f054966-59cf-4a91-a323-3926f10779cc roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
44202025-03-01T01:19:17.363ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 2f054966-59cf-4a91-a323-3926f10779cc resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
44212025-03-01T01:19:17.365ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2829 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 2f054966-59cf-4a91-a323-3926f10779cc response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
44222025-03-01T01:19:17.415ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 327 local_addr = [fd00:1122:3344:101::c]:34357 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = 8190f11a-8776-43e8-b833-8a26337bc45d response_code = 200 uri = /67b03f4e-4cbd-4843-9cd9-647f610abcfc
44232025-03-01T01:19:18.385ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = d82afc1a-6d9d-4308-8565-3ff2b7eda9d5 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
44242025-03-01T01:19:18.385ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = d82afc1a-6d9d-4308-8565-3ff2b7eda9d5 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
44252025-03-01T01:19:18.387ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1870 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = d82afc1a-6d9d-4308-8565-3ff2b7eda9d5 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
44262025-03-01T01:19:19.405ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 0dfeb88f-14fe-49b7-b952-0bf88f2eb4cd roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
44272025-03-01T01:19:19.406ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 0dfeb88f-14fe-49b7-b952-0bf88f2eb4cd resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
44282025-03-01T01:19:19.408ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2368 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 0dfeb88f-14fe-49b7-b952-0bf88f2eb4cd response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
44292025-03-01T01:19:20.430ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = a421fbc1-59b4-48b7-9ae3-66fbaead097f roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
44302025-03-01T01:19:20.430ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = a421fbc1-59b4-48b7-9ae3-66fbaead097f resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
44312025-03-01T01:19:20.432ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2179 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = a421fbc1-59b4-48b7-9ae3-66fbaead097f response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
44322025-03-01T01:19:21.451ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 3c27a6c1-4f76-4f20-a5c9-f1ac0a6ad55a roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
44332025-03-01T01:19:21.451ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 3c27a6c1-4f76-4f20-a5c9-f1ac0a6ad55a resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
44342025-03-01T01:19:21.453ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2226 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 3c27a6c1-4f76-4f20-a5c9-f1ac0a6ad55a response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
44352025-03-01T01:19:22.473ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 639c6493-fa13-4a16-8d86-15bb88094405 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
44362025-03-01T01:19:22.473ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 639c6493-fa13-4a16-8d86-15bb88094405 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
44372025-03-01T01:19:22.475ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2125 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 639c6493-fa13-4a16-8d86-15bb88094405 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
44382025-03-01T01:19:23.214ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 10 reason = Timeout
44392025-03-01T01:19:23.214ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 10 reason = Timeout
44402025-03-01T01:19:23.214ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
44412025-03-01T01:19:23.214ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
44422025-03-01T01:19:23.214ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 10 reason = Timeout
44432025-03-01T01:19:23.214ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 10 reason = Timeout
44442025-03-01T01:19:23.214ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
44452025-03-01T01:19:23.214ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
44462025-03-01T01:19:23.214ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 10 reason = Timeout
44472025-03-01T01:19:23.214ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 28 reason = Timeout
44482025-03-01T01:19:23.214ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
44492025-03-01T01:19:23.214ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 28 reason = Timeout
44502025-03-01T01:19:23.214ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
44512025-03-01T01:19:23.214ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44522025-03-01T01:19:23.214ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 10 reason = Timeout
44532025-03-01T01:19:23.214ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 10 reason = Timeout
44542025-03-01T01:19:23.214ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44552025-03-01T01:19:23.214ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
44562025-03-01T01:19:23.214ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 10 reason = Timeout
44572025-03-01T01:19:23.214ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 10 reason = Timeout
44582025-03-01T01:19:23.214ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
44592025-03-01T01:19:23.215ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
44602025-03-01T01:19:23.215ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 10 reason = Timeout
44612025-03-01T01:19:23.215ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
44622025-03-01T01:19:23.215ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 10 reason = Timeout
44632025-03-01T01:19:23.215ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 10 reason = Timeout
44642025-03-01T01:19:23.215ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
44652025-03-01T01:19:23.215ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
44662025-03-01T01:19:23.215ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 10 reason = Timeout
44672025-03-01T01:19:23.215ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
44682025-03-01T01:19:23.215ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44692025-03-01T01:19:23.215ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 10 reason = Timeout
44702025-03-01T01:19:23.215ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 11 reason = Timeout
44712025-03-01T01:19:23.215ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
44722025-03-01T01:19:23.215ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
44732025-03-01T01:19:23.215ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 10 reason = Timeout
44742025-03-01T01:19:23.215ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
44752025-03-01T01:19:23.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
44762025-03-01T01:19:23.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
44772025-03-01T01:19:23.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
44782025-03-01T01:19:23.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
44792025-03-01T01:19:23.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44802025-03-01T01:19:23.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
44812025-03-01T01:19:23.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
44822025-03-01T01:19:23.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
44832025-03-01T01:19:23.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44842025-03-01T01:19:23.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
44852025-03-01T01:19:23.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
44862025-03-01T01:19:23.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44872025-03-01T01:19:23.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
44882025-03-01T01:19:23.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
44892025-03-01T01:19:23.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
44902025-03-01T01:19:23.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
44912025-03-01T01:19:23.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
44922025-03-01T01:19:23.217ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1173, tv_nsec: 905409648 } })
44932025-03-01T01:19:23.217ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44942025-03-01T01:19:23.218ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1154
44952025-03-01T01:19:23.218ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
44962025-03-01T01:19:23.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
44972025-03-01T01:19:23.219ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.051283ms iteration = 10 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
44982025-03-01T01:19:23.220ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
44992025-03-01T01:19:23.220ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
45002025-03-01T01:19:23.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
45012025-03-01T01:19:23.222ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1173, tv_nsec: 909643504 } })
45022025-03-01T01:19:23.222ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1154
45032025-03-01T01:19:23.222ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45042025-03-01T01:19:23.223ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45052025-03-01T01:19:23.223ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45062025-03-01T01:19:23.226ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
45072025-03-01T01:19:23.226ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45082025-03-01T01:19:23.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45092025-03-01T01:19:23.227ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
45102025-03-01T01:19:23.227ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45112025-03-01T01:19:23.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45122025-03-01T01:19:23.227ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
45132025-03-01T01:19:23.227ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
45142025-03-01T01:19:23.228ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
45152025-03-01T01:19:23.231ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45162025-03-01T01:19:23.231ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45172025-03-01T01:19:23.232ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45182025-03-01T01:19:23.233ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
45192025-03-01T01:19:23.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
45202025-03-01T01:19:23.234ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
45212025-03-01T01:19:23.234ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45222025-03-01T01:19:23.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45232025-03-01T01:19:23.255ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
45242025-03-01T01:19:23.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
45252025-03-01T01:19:23.261ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
45262025-03-01T01:19:23.261ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
45272025-03-01T01:19:23.261ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
45282025-03-01T01:19:23.262ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45292025-03-01T01:19:23.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
45302025-03-01T01:19:23.262ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45312025-03-01T01:19:23.264ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
45322025-03-01T01:19:23.264ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
45332025-03-01T01:19:23.265ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
45342025-03-01T01:19:23.265ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
45352025-03-01T01:19:23.265ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 50.936567ms iteration = 10 status = {"errors":[],"finish_invoked_ok":[]}
45362025-03-01T01:19:23.265ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
45372025-03-01T01:19:23.265ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
45382025-03-01T01:19:23.265ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
45392025-03-01T01:19:23.266ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
45402025-03-01T01:19:23.267ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
45412025-03-01T01:19:23.267ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
45422025-03-01T01:19:23.268ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45432025-03-01T01:19:23.269ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 54.367167ms iteration = 10 status = {"errors":[],"garbage_collect_requested":[]}
45442025-03-01T01:19:23.269ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
45452025-03-01T01:19:23.269ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
45462025-03-01T01:19:23.270ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
45472025-03-01T01:19:23.270ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45482025-03-01T01:19:23.270ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45492025-03-01T01:19:23.271ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 56.615644ms iteration = 28 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
45502025-03-01T01:19:23.271ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45512025-03-01T01:19:23.273ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
45522025-03-01T01:19:23.273ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
45532025-03-01T01:19:23.273ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
45542025-03-01T01:19:23.273ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
45552025-03-01T01:19:23.273ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1173, tv_nsec: 961034081 } })
45562025-03-01T01:19:23.273ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1154 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66
45572025-03-01T01:19:23.273ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
45582025-03-01T01:19:23.273ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
45592025-03-01T01:19:23.273ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
45602025-03-01T01:19:23.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
45612025-03-01T01:19:23.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
45622025-03-01T01:19:23.276ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
45632025-03-01T01:19:23.276ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 61.930992ms iteration = 10 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
45642025-03-01T01:19:23.279ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
45652025-03-01T01:19:23.279ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
45662025-03-01T01:19:23.280ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
45672025-03-01T01:19:23.280ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
45682025-03-01T01:19:23.280ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "66aed406-48f6-4889-bbcd-5330c134f31b", "content-length": "26", "date": "Sat, 01 Mar 2025 01:19:23 GMT"} })
45692025-03-01T01:19:23.280ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
45702025-03-01T01:19:23.281ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 66.525236ms iteration = 10 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
45712025-03-01T01:19:23.281ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
45722025-03-01T01:19:23.284ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
45732025-03-01T01:19:23.284ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
45742025-03-01T01:19:23.284ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "18363d00-ae65-49e9-a9dd-5350a8ba0664", "content-length": "26", "date": "Sat, 01 Mar 2025 01:19:23 GMT"} })
45752025-03-01T01:19:23.284ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
45762025-03-01T01:19:23.284ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45772025-03-01T01:19:23.286ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
45782025-03-01T01:19:23.287ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
45792025-03-01T01:19:23.288ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7, lookup_type: ById(8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7) } result = Ok(())
45802025-03-01T01:19:23.288ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45812025-03-01T01:19:23.288ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
45822025-03-01T01:19:23.288ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45832025-03-01T01:19:23.305ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45842025-03-01T01:19:23.305ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 original_time_created = 2025-03-01 01:14:50.436545 UTC target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 time_created = 2025-03-01 01:14:50.436545 UTC
45852025-03-01T01:19:23.305ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 90.860661ms iteration = 28 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7","time_created":"2025-03-01T01:14:50.436545Z"}
45862025-03-01T01:19:23.305ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
45872025-03-01T01:19:23.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
45882025-03-01T01:19:23.308ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45892025-03-01T01:19:23.308ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 3471264f-127e-4a25-bc10-2e8249e8d70a, lookup_type: ById(3471264f-127e-4a25-bc10-2e8249e8d70a) } result = Ok(())
45902025-03-01T01:19:23.308ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
45912025-03-01T01:19:23.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
45922025-03-01T01:19:23.310ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
45932025-03-01T01:19:23.310ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
45942025-03-01T01:19:23.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
45952025-03-01T01:19:23.310ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 95.69352ms iteration = 10 status = 0
45962025-03-01T01:19:23.311ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
45972025-03-01T01:19:23.311ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 96.868053ms iteration = 10 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
45982025-03-01T01:19:23.318ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 103.222113ms iteration = 10 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
45992025-03-01T01:19:23.318ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
46002025-03-01T01:19:23.318ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
46012025-03-01T01:19:23.318ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 103.528709ms iteration = 10 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
46022025-03-01T01:19:23.328ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 113.124465ms iteration = 11 status = {"physical_disks_added":0}
46032025-03-01T01:19:23.336ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 121.76532ms iteration = 10 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
46042025-03-01T01:19:23.346ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
46052025-03-01T01:19:23.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
46062025-03-01T01:19:23.376ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1162 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 zone_address = fd00:1122:3344:101::2
46072025-03-01T01:19:23.376ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
46082025-03-01T01:19:23.377ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ece4baa3-adc4-4c7c-bd06-01afa06699e0", "content-length": "26", "date": "Sat, 01 Mar 2025 01:19:23 GMT"} })
46092025-03-01T01:19:23.377ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1167 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
46102025-03-01T01:19:23.378ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66
46112025-03-01T01:19:23.398ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 184.205572ms iteration = 10 status = {}
46122025-03-01T01:19:23.401ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
46132025-03-01T01:19:23.401ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "a9abb777-3de2-4cd5-9e30-2b43f7e953c1", "content-length": "2", "date": "Sat, 01 Mar 2025 01:19:22 GMT"} })
46142025-03-01T01:19:23.403ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
46152025-03-01T01:19:23.404ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
46162025-03-01T01:19:23.428ZINFOnexus (BackgroundTasks): VPC route manager sled 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
46172025-03-01T01:19:23.428ZDEBGnexus (BackgroundTasks): client request SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
46182025-03-01T01:19:23.437ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 222.327819ms iteration = 10 status = null
46192025-03-01T01:19:23.470ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
46202025-03-01T01:19:23.471ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
46212025-03-01T01:19:23.473ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46222025-03-01T01:19:23.475ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
46232025-03-01T01:19:23.475ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
46242025-03-01T01:19:23.475ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
46252025-03-01T01:19:23.476ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46262025-03-01T01:19:23.478ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
46272025-03-01T01:19:23.478ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
46282025-03-01T01:19:23.478ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
46292025-03-01T01:19:23.508ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = ff8fa4e3-f749-44d5-8723-f00d3a11bd6c roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
46302025-03-01T01:19:23.509ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = ff8fa4e3-f749-44d5-8723-f00d3a11bd6c resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
46312025-03-01T01:19:23.509ZDEBGnexus (BackgroundTasks): client response SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "79848ebf-98f0-4f82-bace-48a041554f33", "content-length": "372", "date": "Sat, 01 Mar 2025 01:19:23 GMT"} })
46322025-03-01T01:19:23.509ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46332025-03-01T01:19:23.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46342025-03-01T01:19:23.511ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2510 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = ff8fa4e3-f749-44d5-8723-f00d3a11bd6c response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
46352025-03-01T01:19:23.545ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46362025-03-01T01:19:23.546ZDEBGnexus (BackgroundTasks): client request SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
46372025-03-01T01:19:23.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46382025-03-01T01:19:23.546ZDEBGnexus (BackgroundTasks): client response SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "35d46e2c-a5f1-43aa-8f40-d696f8845030", "content-length": "691", "date": "Sat, 01 Mar 2025 01:19:23 GMT"} })
46392025-03-01T01:19:23.546ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
46402025-03-01T01:19:23.546ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
46412025-03-01T01:19:23.546ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
46422025-03-01T01:19:23.548ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 7f9c3c14-58c5-473f-8692-6376be44401e, rack_id: 4854cb88-dfba-4609-8f9d-72aac08cef66, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(cb10d0c6-a704-4231-b148-4f9ae21a03f8) } rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 switch_location = Switch0
46432025-03-01T01:19:23.548ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46442025-03-01T01:19:23.548ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 333.422652ms iteration = 10 status = {}
46452025-03-01T01:19:23.548ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46462025-03-01T01:19:23.556ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
46472025-03-01T01:19:23.556ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
46482025-03-01T01:19:23.556ZDEBGnexus (BackgroundTasks): client request SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
46492025-03-01T01:19:23.556ZDEBGnexus (BackgroundTasks): client response SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "49e6b2ab-8c20-4dac-bb34-85c9dffc8fde", "date": "Sat, 01 Mar 2025 01:19:23 GMT"} })
46502025-03-01T01:19:23.556ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46512025-03-01T01:19:23.556ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "0a09251e-3ff7-4aee-81c7-d2f6ca38052b", "content-length": "134", "date": "Sat, 01 Mar 2025 01:19:22 GMT"} })
46522025-03-01T01:19:23.557ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
46532025-03-01T01:19:23.557ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = cb10d0c6-a704-4231-b148-4f9ae21a03f8
46542025-03-01T01:19:23.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46552025-03-01T01:19:23.557ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
46562025-03-01T01:19:23.557ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
46572025-03-01T01:19:23.557ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
46582025-03-01T01:19:23.557ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
46592025-03-01T01:19:23.557ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
46602025-03-01T01:19:23.557ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
46612025-03-01T01:19:23.557ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
46622025-03-01T01:19:23.557ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
46632025-03-01T01:19:23.557ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66
46642025-03-01T01:19:23.557ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46652025-03-01T01:19:23.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46662025-03-01T01:19:23.558ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46672025-03-01T01:19:23.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46682025-03-01T01:19:23.560ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
46692025-03-01T01:19:23.560ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "89ee9367-af3c-41ee-8ded-c154676464cb", "content-length": "2", "date": "Sat, 01 Mar 2025 01:19:22 GMT"} })
46702025-03-01T01:19:23.560ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
46712025-03-01T01:19:23.560ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "4fb88d45-97a5-4ebf-9625-9603acde658b", "content-length": "52", "date": "Sat, 01 Mar 2025 01:19:22 GMT"} })
46722025-03-01T01:19:23.560ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 switch_location = Switch0
46732025-03-01T01:19:23.560ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
46742025-03-01T01:19:23.561ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46752025-03-01T01:19:23.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46762025-03-01T01:19:23.569ZINFOnexus (BackgroundTasks): VPC route manager sled 3471264f-127e-4a25-bc10-2e8249e8d70a push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
46772025-03-01T01:19:23.569ZDEBGnexus (BackgroundTasks): client request SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
46782025-03-01T01:19:23.664ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "c6db9117-a43c-4d13-8d70-8e291959679a", "date": "Sat, 01 Mar 2025 01:19:23 GMT"} })
46792025-03-01T01:19:23.664ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 switch = Switch0
46802025-03-01T01:19:23.664ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
46812025-03-01T01:19:23.664ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "492f8552-64fb-4bf8-bee1-65f9ba8c68fa", "content-length": "682", "date": "Sat, 01 Mar 2025 01:19:23 GMT"} })
46822025-03-01T01:19:23.665ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46832025-03-01T01:19:23.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46842025-03-01T01:19:23.665ZDEBGnexus (BackgroundTasks): client response SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "e9468ba7-7a3a-4d87-902a-5185c6e5ed13", "date": "Sat, 01 Mar 2025 01:19:23 GMT"} })
46852025-03-01T01:19:23.666ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 451.686661ms iteration = 10 status = {}
46862025-03-01T01:19:23.669ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46872025-03-01T01:19:23.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46882025-03-01T01:19:23.673ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46892025-03-01T01:19:23.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46902025-03-01T01:19:23.674ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46912025-03-01T01:19:23.675ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46922025-03-01T01:19:23.682ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 467.441592ms iteration = 10 status = {}
46932025-03-01T01:19:24.532ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c1a07e51-f57b-4669-aa85-fdbde77e6d52 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
46942025-03-01T01:19:24.532ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c1a07e51-f57b-4669-aa85-fdbde77e6d52 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
46952025-03-01T01:19:24.534ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2199 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c1a07e51-f57b-4669-aa85-fdbde77e6d52 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
46962025-03-01T01:19:25.553ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = dffa1fd9-ac5e-4502-ba65-f07082e05667 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
46972025-03-01T01:19:25.553ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = dffa1fd9-ac5e-4502-ba65-f07082e05667 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
46982025-03-01T01:19:25.554ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1869 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = dffa1fd9-ac5e-4502-ba65-f07082e05667 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
46992025-03-01T01:19:26.574ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 98f78ec3-ae29-449b-b098-2a8519f42996 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
47002025-03-01T01:19:26.575ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 98f78ec3-ae29-449b-b098-2a8519f42996 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
47012025-03-01T01:19:26.576ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1867 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 98f78ec3-ae29-449b-b098-2a8519f42996 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
47022025-03-01T01:19:27.415ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 303 local_addr = [fd00:1122:3344:101::c]:34357 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = 9ffc1b9e-0d07-43db-ade1-8258559e2a92 response_code = 200 uri = /67b03f4e-4cbd-4843-9cd9-647f610abcfc
47032025-03-01T01:19:27.595ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = e6a3c1d7-19e2-45d4-8811-4dc6764eff1b roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
47042025-03-01T01:19:27.595ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = e6a3c1d7-19e2-45d4-8811-4dc6764eff1b resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
47052025-03-01T01:19:27.596ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1911 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = e6a3c1d7-19e2-45d4-8811-4dc6764eff1b response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
47062025-03-01T01:19:28.616ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 3b8e207a-f8f4-4d54-85a7-4bc840efb71e roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
47072025-03-01T01:19:28.616ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 3b8e207a-f8f4-4d54-85a7-4bc840efb71e resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
47082025-03-01T01:19:28.618ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2021 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 3b8e207a-f8f4-4d54-85a7-4bc840efb71e response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
47092025-03-01T01:19:29.638ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = ae5d118b-c40d-45f7-ab3d-f21937910518 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
47102025-03-01T01:19:29.638ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = ae5d118b-c40d-45f7-ab3d-f21937910518 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
47112025-03-01T01:19:29.640ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2182 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = ae5d118b-c40d-45f7-ab3d-f21937910518 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
47122025-03-01T01:19:30.660ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 54becf61-d0c2-4193-b424-cb767fc1c19c roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
47132025-03-01T01:19:30.660ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 54becf61-d0c2-4193-b424-cb767fc1c19c resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
47142025-03-01T01:19:30.662ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1847 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 54becf61-d0c2-4193-b424-cb767fc1c19c response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
47152025-03-01T01:19:31.682ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 40c322e8-352f-4eb5-af0c-757d2401d199 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
47162025-03-01T01:19:31.682ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 40c322e8-352f-4eb5-af0c-757d2401d199 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
47172025-03-01T01:19:31.684ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2006 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 40c322e8-352f-4eb5-af0c-757d2401d199 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
47182025-03-01T01:19:32.703ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = b675270d-8011-4333-973f-0f55d7f54821 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
47192025-03-01T01:19:32.703ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = b675270d-8011-4333-973f-0f55d7f54821 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
47202025-03-01T01:19:32.705ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2166 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = b675270d-8011-4333-973f-0f55d7f54821 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
47212025-03-01T01:19:33.214ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 29 reason = Timeout
47222025-03-01T01:19:33.214ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 29 reason = Timeout
47232025-03-01T01:19:33.214ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
47242025-03-01T01:19:33.214ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47252025-03-01T01:19:33.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47262025-03-01T01:19:33.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
47272025-03-01T01:19:33.216ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
47282025-03-01T01:19:33.216ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47292025-03-01T01:19:33.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
47302025-03-01T01:19:33.218ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
47312025-03-01T01:19:33.218ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47322025-03-01T01:19:33.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47332025-03-01T01:19:33.220ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47342025-03-01T01:19:33.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47352025-03-01T01:19:33.222ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47362025-03-01T01:19:33.225ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7, lookup_type: ById(8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7) } result = Ok(())
47372025-03-01T01:19:33.225ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47382025-03-01T01:19:33.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47392025-03-01T01:19:33.237ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 original_time_created = 2025-03-01 01:14:50.436545 UTC target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 time_created = 2025-03-01 01:14:50.436545 UTC
47402025-03-01T01:19:33.237ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.477568ms iteration = 29 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7","time_created":"2025-03-01T01:14:50.436545Z"}
47412025-03-01T01:19:33.247ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 32.87695ms iteration = 29 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
47422025-03-01T01:19:33.726ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 710fa565-07bd-49fe-b2cb-e158e8bb3bb7 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
47432025-03-01T01:19:33.726ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 710fa565-07bd-49fe-b2cb-e158e8bb3bb7 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
47442025-03-01T01:19:33.728ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2440 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 710fa565-07bd-49fe-b2cb-e158e8bb3bb7 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
47452025-03-01T01:19:34.747ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = a8698f21-546e-4cae-823b-24e3916cff05 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
47462025-03-01T01:19:34.748ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = a8698f21-546e-4cae-823b-24e3916cff05 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
47472025-03-01T01:19:34.749ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1474 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = a8698f21-546e-4cae-823b-24e3916cff05 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
47482025-03-01T01:19:35.769ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = d4b35f78-b232-44d0-8607-c85e5f3a5054 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
47492025-03-01T01:19:35.769ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = d4b35f78-b232-44d0-8607-c85e5f3a5054 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
47502025-03-01T01:19:35.771ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2418 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = d4b35f78-b232-44d0-8607-c85e5f3a5054 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
47512025-03-01T01:19:36.791ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = bc568770-7de5-4a95-b646-87fbdfc8a972 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
47522025-03-01T01:19:36.791ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = bc568770-7de5-4a95-b646-87fbdfc8a972 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
47532025-03-01T01:19:36.792ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1892 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = bc568770-7de5-4a95-b646-87fbdfc8a972 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
47542025-03-01T01:19:37.415ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 383 local_addr = [fd00:1122:3344:101::c]:34357 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = ed5889a3-ed7e-41bf-b4dc-7e7b055aa048 response_code = 200 uri = /67b03f4e-4cbd-4843-9cd9-647f610abcfc
47552025-03-01T01:19:37.813ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 9e0fd13c-0f39-4492-9f59-efcbad08240e roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
47562025-03-01T01:19:37.813ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 9e0fd13c-0f39-4492-9f59-efcbad08240e resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
47572025-03-01T01:19:37.815ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2371 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 9e0fd13c-0f39-4492-9f59-efcbad08240e response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
47582025-03-01T01:19:38.835ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 2542c504-4451-4020-a6c5-0f829a9732b1 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
47592025-03-01T01:19:38.835ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 2542c504-4451-4020-a6c5-0f829a9732b1 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
47602025-03-01T01:19:38.837ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1909 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 2542c504-4451-4020-a6c5-0f829a9732b1 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
47612025-03-01T01:19:39.860ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 7d2eaf4d-cee6-4f42-af37-6e4f55b8f31b roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
47622025-03-01T01:19:39.860ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 7d2eaf4d-cee6-4f42-af37-6e4f55b8f31b resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
47632025-03-01T01:19:39.862ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2311 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 7d2eaf4d-cee6-4f42-af37-6e4f55b8f31b response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
47642025-03-01T01:19:40.881ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 9f8a4a04-433f-4c0d-a750-e01259fb3c43 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
47652025-03-01T01:19:40.881ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 9f8a4a04-433f-4c0d-a750-e01259fb3c43 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
47662025-03-01T01:19:40.883ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2026 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 9f8a4a04-433f-4c0d-a750-e01259fb3c43 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
47672025-03-01T01:19:41.903ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 6cbbbd46-01a0-4544-a977-d8d201c70321 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
47682025-03-01T01:19:41.904ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 6cbbbd46-01a0-4544-a977-d8d201c70321 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
47692025-03-01T01:19:41.906ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2229 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 6cbbbd46-01a0-4544-a977-d8d201c70321 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
47702025-03-01T01:19:42.925ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 25a4488e-de3f-4d3e-8d6d-ab8ffed03397 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
47712025-03-01T01:19:42.925ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 25a4488e-de3f-4d3e-8d6d-ab8ffed03397 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
47722025-03-01T01:19:42.928ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2589 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 25a4488e-de3f-4d3e-8d6d-ab8ffed03397 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
47732025-03-01T01:19:43.214ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 30 reason = Timeout
47742025-03-01T01:19:43.214ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 30 reason = Timeout
47752025-03-01T01:19:43.214ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47762025-03-01T01:19:43.214ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
47772025-03-01T01:19:43.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47782025-03-01T01:19:43.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
47792025-03-01T01:19:43.215ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47802025-03-01T01:19:43.216ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
47812025-03-01T01:19:43.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
47822025-03-01T01:19:43.218ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.574273ms iteration = 30 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
47832025-03-01T01:19:43.218ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
47842025-03-01T01:19:43.218ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47852025-03-01T01:19:43.218ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47862025-03-01T01:19:43.220ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47872025-03-01T01:19:43.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47882025-03-01T01:19:43.221ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47892025-03-01T01:19:43.223ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7, lookup_type: ById(8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7) } result = Ok(())
47902025-03-01T01:19:43.223ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47912025-03-01T01:19:43.223ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47922025-03-01T01:19:43.231ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 original_time_created = 2025-03-01 01:14:50.436545 UTC target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 time_created = 2025-03-01 01:14:50.436545 UTC
47932025-03-01T01:19:43.231ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 17.060317ms iteration = 30 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7","time_created":"2025-03-01T01:14:50.436545Z"}
47942025-03-01T01:19:43.947ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 82d6fcd2-7807-4147-833e-9347987f10c0 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
47952025-03-01T01:19:43.948ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 82d6fcd2-7807-4147-833e-9347987f10c0 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
47962025-03-01T01:19:43.949ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1808 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 82d6fcd2-7807-4147-833e-9347987f10c0 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
47972025-03-01T01:19:44.969ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = f31da791-1158-4552-a7c2-4d4d6daafbf5 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
47982025-03-01T01:19:44.969ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = f31da791-1158-4552-a7c2-4d4d6daafbf5 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
47992025-03-01T01:19:44.971ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1991 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = f31da791-1158-4552-a7c2-4d4d6daafbf5 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
48002025-03-01T01:19:45.990ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = e836f73f-820b-4e17-b77f-07068706e28e roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
48012025-03-01T01:19:45.990ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = e836f73f-820b-4e17-b77f-07068706e28e resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
48022025-03-01T01:19:45.992ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2215 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = e836f73f-820b-4e17-b77f-07068706e28e response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
48032025-03-01T01:19:47.012ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 757b314a-41e1-4190-903c-f0ef1124f64a roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
48042025-03-01T01:19:47.012ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 757b314a-41e1-4190-903c-f0ef1124f64a resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
48052025-03-01T01:19:47.014ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2047 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 757b314a-41e1-4190-903c-f0ef1124f64a response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
48062025-03-01T01:19:47.414ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 360 local_addr = [fd00:1122:3344:101::c]:34357 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = 73eb0822-1b00-4d7d-87f5-d425c8ef8c60 response_code = 200 uri = /67b03f4e-4cbd-4843-9cd9-647f610abcfc
48072025-03-01T01:19:48.035ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 6ea58b58-e72c-496e-bfd8-bacaf59874ff roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
48082025-03-01T01:19:48.036ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 6ea58b58-e72c-496e-bfd8-bacaf59874ff resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
48092025-03-01T01:19:48.038ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2504 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 6ea58b58-e72c-496e-bfd8-bacaf59874ff response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
48102025-03-01T01:19:49.057ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = d88f6be0-0ab9-4955-a531-35778b53f417 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
48112025-03-01T01:19:49.058ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = d88f6be0-0ab9-4955-a531-35778b53f417 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
48122025-03-01T01:19:49.059ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1919 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = d88f6be0-0ab9-4955-a531-35778b53f417 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
48132025-03-01T01:19:50.081ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = ac39bc1f-1a45-4a4c-8229-737b8fdd5c2a roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
48142025-03-01T01:19:50.081ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = ac39bc1f-1a45-4a4c-8229-737b8fdd5c2a resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
48152025-03-01T01:19:50.082ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2045 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = ac39bc1f-1a45-4a4c-8229-737b8fdd5c2a response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
48162025-03-01T01:19:51.103ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 3431cf10-b88d-44af-bc6a-8a785d76648b roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
48172025-03-01T01:19:51.103ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 3431cf10-b88d-44af-bc6a-8a785d76648b resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
48182025-03-01T01:19:51.105ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2143 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 3431cf10-b88d-44af-bc6a-8a785d76648b response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
48192025-03-01T01:19:52.125ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 4dcf0016-88c7-45bb-ad4a-8f11bea8e1b3 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
48202025-03-01T01:19:52.125ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 4dcf0016-88c7-45bb-ad4a-8f11bea8e1b3 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
48212025-03-01T01:19:52.127ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2779 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 4dcf0016-88c7-45bb-ad4a-8f11bea8e1b3 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
48222025-03-01T01:19:52.408ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61177 req_id = 84217edc-7de3-4c41-b98e-575ad13ab3bd roles = RoleSet { roles: {} } uri = /metrics/collectors/d77aa5d6-e6f9-4845-b1d4-57f91a3621e6/producers?sort_by=id_ascending
48232025-03-01T01:19:52.408ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61177 req_id = 84217edc-7de3-4c41-b98e-575ad13ab3bd resource = Database result = Ok(()) uri = /metrics/collectors/d77aa5d6-e6f9-4845-b1d4-57f91a3621e6/producers?sort_by=id_ascending
48242025-03-01T01:19:52.411ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3670 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61177 req_id = 84217edc-7de3-4c41-b98e-575ad13ab3bd response_code = 200 uri = /metrics/collectors/d77aa5d6-e6f9-4845-b1d4-57f91a3621e6/producers?sort_by=id_ascending
48252025-03-01T01:19:52.411ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61177 req_id = 4072a968-03c3-4694-a620-1261787bae0c roles = RoleSet { roles: {} } uri = /metrics/collectors/d77aa5d6-e6f9-4845-b1d4-57f91a3621e6/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYmI0ODUwMS0zYzRlLTRkNDQtODgyMy1mOTc1ZTg2OTFmZmYifX0%3D
48262025-03-01T01:19:52.412ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61177 req_id = 4072a968-03c3-4694-a620-1261787bae0c resource = Database result = Ok(()) uri = /metrics/collectors/d77aa5d6-e6f9-4845-b1d4-57f91a3621e6/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYmI0ODUwMS0zYzRlLTRkNDQtODgyMy1mOTc1ZTg2OTFmZmYifX0%3D
48272025-03-01T01:19:52.414ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2462 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61177 req_id = 4072a968-03c3-4694-a620-1261787bae0c response_code = 200 uri = /metrics/collectors/d77aa5d6-e6f9-4845-b1d4-57f91a3621e6/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYmI0ODUwMS0zYzRlLTRkNDQtODgyMy1mOTc1ZTg2OTFmZmYifX0%3D
48282025-03-01T01:19:53.149ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 5387ac5f-3692-4ee7-92d6-21aa6b79a644 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
48292025-03-01T01:19:53.149ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 5387ac5f-3692-4ee7-92d6-21aa6b79a644 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
48302025-03-01T01:19:53.151ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2545 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 5387ac5f-3692-4ee7-92d6-21aa6b79a644 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
48312025-03-01T01:19:53.214ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 8 reason = Timeout
48322025-03-01T01:19:53.214ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 31 reason = Timeout
48332025-03-01T01:19:53.214ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48342025-03-01T01:19:53.214ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 11 reason = Timeout
48352025-03-01T01:19:53.214ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_rendezvous iteration = 3 reason = Timeout
48362025-03-01T01:19:53.214ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48372025-03-01T01:19:53.214ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 6 reason = Timeout
48382025-03-01T01:19:53.215ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
48392025-03-01T01:19:53.215ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
48402025-03-01T01:19:53.215ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
48412025-03-01T01:19:53.215ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 11 reason = Timeout
48422025-03-01T01:19:53.215ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 7 reason = Timeout
48432025-03-01T01:19:53.215ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
48442025-03-01T01:19:53.215ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7
48452025-03-01T01:19:53.215ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 12 reason = Timeout
48462025-03-01T01:19:53.215ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 15.411\u{b5}s iteration = 7 status = {"enabled":false,"target_id":"8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7"}
48472025-03-01T01:19:53.215ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 31 reason = Timeout
48482025-03-01T01:19:53.215ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
48492025-03-01T01:19:53.215ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
48502025-03-01T01:19:53.215ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 11 reason = Timeout
48512025-03-01T01:19:53.215ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
48522025-03-01T01:19:53.215ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 6 reason = Timeout
48532025-03-01T01:19:53.215ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
48542025-03-01T01:19:53.215ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 6 reason = Timeout
48552025-03-01T01:19:53.215ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
48562025-03-01T01:19:53.215ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 11 reason = Timeout
48572025-03-01T01:19:53.215ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
48582025-03-01T01:19:53.215ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
48592025-03-01T01:19:53.215ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 11 reason = Timeout
48602025-03-01T01:19:53.215ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
48612025-03-01T01:19:53.215ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 2 reason = Timeout
48622025-03-01T01:19:53.215ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
48632025-03-01T01:19:53.215ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
48642025-03-01T01:19:53.215ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 11 reason = Timeout
48652025-03-01T01:19:53.215ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
48662025-03-01T01:19:53.215ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 6 reason = Timeout
48672025-03-01T01:19:53.215ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 6 reason = Timeout
48682025-03-01T01:19:53.215ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
48692025-03-01T01:19:53.215ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 6 reason = Timeout
48702025-03-01T01:19:53.215ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
48712025-03-01T01:19:53.215ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 8 reason = Timeout
48722025-03-01T01:19:53.215ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 11 reason = Timeout
48732025-03-01T01:19:53.215ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
48742025-03-01T01:19:53.215ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 6 reason = Timeout
48752025-03-01T01:19:53.215ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
48762025-03-01T01:19:53.215ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 11 reason = Timeout
48772025-03-01T01:19:53.215ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
48782025-03-01T01:19:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48792025-03-01T01:19:53.215ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 11 reason = Timeout
48802025-03-01T01:19:53.215ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
48812025-03-01T01:19:53.215ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 6 reason = Timeout
48822025-03-01T01:19:53.215ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 11 reason = Timeout
48832025-03-01T01:19:53.215ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
48842025-03-01T01:19:53.215ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 11 reason = Timeout
48852025-03-01T01:19:53.215ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
48862025-03-01T01:19:53.215ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
48872025-03-01T01:19:53.215ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
48882025-03-01T01:19:53.215ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 11 reason = Timeout
48892025-03-01T01:19:53.215ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48902025-03-01T01:19:53.215ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
48912025-03-01T01:19:53.215ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 6 reason = Timeout
48922025-03-01T01:19:53.215ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 11 reason = Timeout
48932025-03-01T01:19:53.215ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
48942025-03-01T01:19:53.215ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 6 reason = Timeout
48952025-03-01T01:19:53.215ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-03-01 01:09:53.215337543 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
48962025-03-01T01:19:53.215ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
48972025-03-01T01:19:53.215ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 11 reason = Timeout
48982025-03-01T01:19:53.215ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 11 reason = Timeout
48992025-03-01T01:19:53.215ZDEBGnexus (BackgroundTasks): activating background_task = tuf_artifact_replication iteration = 2 reason = Timeout
49002025-03-01T01:19:53.215ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
49012025-03-01T01:19:53.215ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
49022025-03-01T01:19:53.215ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
49032025-03-01T01:19:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49042025-03-01T01:19:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
49052025-03-01T01:19:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
49062025-03-01T01:19:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
49072025-03-01T01:19:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
49082025-03-01T01:19:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
49092025-03-01T01:19:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
49102025-03-01T01:19:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
49112025-03-01T01:19:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
49122025-03-01T01:19:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
49132025-03-01T01:19:53.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
49142025-03-01T01:19:53.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
49152025-03-01T01:19:53.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
49162025-03-01T01:19:53.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
49172025-03-01T01:19:53.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
49182025-03-01T01:19:53.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
49192025-03-01T01:19:53.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
49202025-03-01T01:19:53.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
49212025-03-01T01:19:53.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
49222025-03-01T01:19:53.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
49232025-03-01T01:19:53.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
49242025-03-01T01:19:53.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
49252025-03-01T01:19:53.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
49262025-03-01T01:19:53.216ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2e37f4af-57dc-468e-80e3-cf2aea2ffdc8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5f6eb3bd-0126-40e0-98ef-ee33df084158.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("5f6eb3bd-0126-40e0-98ef-ee33df084158.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1203, tv_nsec: 903515289 } })
49272025-03-01T01:19:53.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49282025-03-01T01:19:53.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
49292025-03-01T01:19:53.216ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("3a9b8294-d9f3-4130-a669-e74c6f1f65a0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("450e8d93-9ed3-4721-9fe9-42521f60bc93.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a4f72c78-99c6-478d-b490-f7d8793d4173.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("a4f72c78-99c6-478d-b490-f7d8793d4173.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1203, tv_nsec: 903554090 } })
49302025-03-01T01:19:53.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
49312025-03-01T01:19:53.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
49322025-03-01T01:19:53.216ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
49332025-03-01T01:19:53.216ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.250055ms iteration = 6 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
49342025-03-01T01:19:53.216ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
49352025-03-01T01:19:53.216ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.216085ms iteration = 6 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
49362025-03-01T01:19:53.217ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49372025-03-01T01:19:53.218ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49382025-03-01T01:19:53.219ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49392025-03-01T01:19:53.219ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.455211ms iteration = 11 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
49402025-03-01T01:19:53.220ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
49412025-03-01T01:19:53.220ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49422025-03-01T01:19:53.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49432025-03-01T01:19:53.220ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
49442025-03-01T01:19:53.220ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49452025-03-01T01:19:53.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49462025-03-01T01:19:53.221ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Inventory result = Ok(())
49472025-03-01T01:19:53.221ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
49482025-03-01T01:19:53.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
49492025-03-01T01:19:53.222ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
49502025-03-01T01:19:53.222ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
49512025-03-01T01:19:53.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
49522025-03-01T01:19:53.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
49532025-03-01T01:19:53.224ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49542025-03-01T01:19:53.224ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49552025-03-01T01:19:53.225ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49562025-03-01T01:19:53.226ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
49572025-03-01T01:19:53.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
49582025-03-01T01:19:53.226ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
49592025-03-01T01:19:53.226ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
49602025-03-01T01:19:53.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
49612025-03-01T01:19:53.227ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
49622025-03-01T01:19:53.227ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
49632025-03-01T01:19:53.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
49642025-03-01T01:19:53.228ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
49652025-03-01T01:19:53.228ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
49662025-03-01T01:19:53.228ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
49672025-03-01T01:19:53.232ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49682025-03-01T01:19:53.232ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49692025-03-01T01:19:53.233ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
49702025-03-01T01:19:53.233ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
49712025-03-01T01:19:53.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
49722025-03-01T01:19:53.234ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49732025-03-01T01:19:53.235ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
49742025-03-01T01:19:53.235ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
49752025-03-01T01:19:53.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
49762025-03-01T01:19:53.236ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 20.837525ms iteration = 6 status = {"errors":[],"found_port_ok":[]}
49772025-03-01T01:19:53.237ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
49782025-03-01T01:19:53.237ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
49792025-03-01T01:19:53.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
49802025-03-01T01:19:53.237ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1203, tv_nsec: 925454506 } })
49812025-03-01T01:19:53.237ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1203, tv_nsec: 925502357 } })
49822025-03-01T01:19:53.238ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1154
49832025-03-01T01:19:53.238ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1154
49842025-03-01T01:19:53.238ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
49852025-03-01T01:19:53.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
49862025-03-01T01:19:53.240ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49872025-03-01T01:19:53.240ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-03-01 01:09:53.215337543 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
49882025-03-01T01:19:53.240ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 25.074691ms iteration = 6 status = {"expiration":"2025-03-01T01:09:53.215337543Z","pruned":[]}
49892025-03-01T01:19:53.241ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49902025-03-01T01:19:53.242ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
49912025-03-01T01:19:53.242ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
49922025-03-01T01:19:53.242ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
49932025-03-01T01:19:53.242ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
49942025-03-01T01:19:53.242ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49952025-03-01T01:19:53.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
49962025-03-01T01:19:53.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49972025-03-01T01:19:53.243ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
49982025-03-01T01:19:53.243ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
49992025-03-01T01:19:53.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
50002025-03-01T01:19:53.245ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50012025-03-01T01:19:53.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50022025-03-01T01:19:53.247ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1203, tv_nsec: 934626213 } })
50032025-03-01T01:19:53.247ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1154 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66
50042025-03-01T01:19:53.249ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
50052025-03-01T01:19:53.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
50062025-03-01T01:19:53.251ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50072025-03-01T01:19:53.252ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
50082025-03-01T01:19:53.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
50092025-03-01T01:19:53.253ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
50102025-03-01T01:19:53.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
50112025-03-01T01:19:53.254ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
50122025-03-01T01:19:53.257ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
50132025-03-01T01:19:53.257ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 42.295551ms iteration = 11 status = {"errors":[],"finish_invoked_ok":[]}
50142025-03-01T01:19:53.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
50152025-03-01T01:19:53.257ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
50162025-03-01T01:19:53.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
50172025-03-01T01:19:53.258ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50182025-03-01T01:19:53.259ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
50192025-03-01T01:19:53.260ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
50202025-03-01T01:19:53.262ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
50212025-03-01T01:19:53.263ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
50222025-03-01T01:19:53.263ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 47.961007ms iteration = 11 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
50232025-03-01T01:19:53.263ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
50242025-03-01T01:19:53.263ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
50252025-03-01T01:19:53.264ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
50262025-03-01T01:19:53.264ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
50272025-03-01T01:19:53.264ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 49.448598ms iteration = 6 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
50282025-03-01T01:19:53.265ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50292025-03-01T01:19:53.265ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50302025-03-01T01:19:53.266ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50312025-03-01T01:19:53.268ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
50322025-03-01T01:19:53.268ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50332025-03-01T01:19:53.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50342025-03-01T01:19:53.269ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
50352025-03-01T01:19:53.269ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
50362025-03-01T01:19:53.269ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
50372025-03-01T01:19:53.269ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
50382025-03-01T01:19:53.269ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
50392025-03-01T01:19:53.270ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 55.156943ms iteration = 11 status = {"errors":[],"garbage_collect_requested":[]}
50402025-03-01T01:19:53.270ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7, lookup_type: ById(8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7) } result = Ok(())
50412025-03-01T01:19:53.271ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50422025-03-01T01:19:53.271ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50432025-03-01T01:19:53.275ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50442025-03-01T01:19:53.276ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
50452025-03-01T01:19:53.277ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
50462025-03-01T01:19:53.279ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
50472025-03-01T01:19:53.279ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
50482025-03-01T01:19:53.280ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
50492025-03-01T01:19:53.282ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 67.379113ms iteration = 11 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
50502025-03-01T01:19:53.292ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
50512025-03-01T01:19:53.293ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
50522025-03-01T01:19:53.294ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
50532025-03-01T01:19:53.294ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
50542025-03-01T01:19:53.295ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
50552025-03-01T01:19:53.295ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
50562025-03-01T01:19:53.295ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
50572025-03-01T01:19:53.295ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
50582025-03-01T01:19:53.295ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
50592025-03-01T01:19:53.296ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
50602025-03-01T01:19:53.296ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
50612025-03-01T01:19:53.296ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 81.293656ms iteration = 6 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
50622025-03-01T01:19:53.297ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 82.044391ms iteration = 31 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
50632025-03-01T01:19:53.297ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
50642025-03-01T01:19:53.297ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
50652025-03-01T01:19:53.297ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
50662025-03-01T01:19:53.297ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
50672025-03-01T01:19:53.302ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
50682025-03-01T01:19:53.302ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
50692025-03-01T01:19:53.302ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
50702025-03-01T01:19:53.302ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
50712025-03-01T01:19:53.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
50722025-03-01T01:19:53.303ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50732025-03-01T01:19:53.304ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
50742025-03-01T01:19:53.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
50752025-03-01T01:19:53.305ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
50762025-03-01T01:19:53.305ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
50772025-03-01T01:19:53.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
50782025-03-01T01:19:53.306ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 original_time_created = 2025-03-01 01:14:50.436545 UTC target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 time_created = 2025-03-01 01:14:50.436545 UTC
50792025-03-01T01:19:53.306ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 91.462584ms iteration = 31 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7","time_created":"2025-03-01T01:14:50.436545Z"}
50802025-03-01T01:19:53.306ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
50812025-03-01T01:19:53.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
50822025-03-01T01:19:53.313ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
50832025-03-01T01:19:53.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
50842025-03-01T01:19:53.314ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
50852025-03-01T01:19:53.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
50862025-03-01T01:19:53.328ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
50872025-03-01T01:19:53.354ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
50882025-03-01T01:19:53.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
50892025-03-01T01:19:53.441ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
50902025-03-01T01:19:53.519ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
50912025-03-01T01:19:53.519ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
50922025-03-01T01:19:53.520ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c8956d9e-2f2a-4c57-83b9-943372c8ed3a", "content-length": "26", "date": "Sat, 01 Mar 2025 01:19:53 GMT"} })
50932025-03-01T01:19:53.520ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
50942025-03-01T01:19:53.522ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
50952025-03-01T01:19:53.533ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1162 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 zone_address = fd00:1122:3344:101::2
50962025-03-01T01:19:53.533ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
50972025-03-01T01:19:53.533ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "dd13f63c-5128-4e1d-a3d8-5ffd72fe1251", "content-length": "26", "date": "Sat, 01 Mar 2025 01:19:53 GMT"} })
50982025-03-01T01:19:53.533ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1167 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
50992025-03-01T01:19:53.536ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66
51002025-03-01T01:19:53.544ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
51012025-03-01T01:19:53.545ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "92a9b6ba-4f5c-4c45-9857-1b01dec06e88", "date": "Sat, 01 Mar 2025 01:19:53 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
51022025-03-01T01:19:53.545ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
51032025-03-01T01:19:53.547ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "2f87745b-4e86-4bef-989a-11b0710e20f3", "date": "Sat, 01 Mar 2025 01:19:53 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
51042025-03-01T01:19:53.547ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
51052025-03-01T01:19:53.547ZINFOnexus (BackgroundTasks): VPC route manager sled 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
51062025-03-01T01:19:53.547ZDEBGnexus (BackgroundTasks): client request SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
51072025-03-01T01:19:53.547ZDEBGnexus (BackgroundTasks): client response SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "5f0db191-cb43-4750-93cc-30a7a7af0a04", "content-length": "372", "date": "Sat, 01 Mar 2025 01:19:53 GMT"} })
51082025-03-01T01:19:53.547ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
51092025-03-01T01:19:53.548ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
51102025-03-01T01:19:53.551ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
51112025-03-01T01:19:53.551ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 336.210679ms iteration = 8 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
51122025-03-01T01:19:53.552ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51132025-03-01T01:19:53.556ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
51142025-03-01T01:19:53.556ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
51152025-03-01T01:19:53.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
51162025-03-01T01:19:53.562ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51172025-03-01T01:19:53.565ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
51182025-03-01T01:19:53.565ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
51192025-03-01T01:19:53.565ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
51202025-03-01T01:19:53.568ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
51212025-03-01T01:19:53.569ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
51222025-03-01T01:19:53.590ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
51232025-03-01T01:19:53.590ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
51242025-03-01T01:19:53.590ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9975d73d-5d92-4760-888c-9240bf1f906c", "content-length": "26", "date": "Sat, 01 Mar 2025 01:19:53 GMT"} })
51252025-03-01T01:19:53.590ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
51262025-03-01T01:19:53.596ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
51272025-03-01T01:19:53.608ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51282025-03-01T01:19:53.608ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
51292025-03-01T01:19:53.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
51302025-03-01T01:19:53.609ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
51312025-03-01T01:19:53.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
51322025-03-01T01:19:53.610ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 395.059107ms iteration = 11 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
51332025-03-01T01:19:53.614ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
51342025-03-01T01:19:53.614ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
51352025-03-01T01:19:53.614ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 399.535089ms iteration = 11 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
51362025-03-01T01:19:53.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
51372025-03-01T01:19:53.616ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51382025-03-01T01:19:53.616ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
51392025-03-01T01:19:53.616ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
51402025-03-01T01:19:53.616ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 401.154462ms iteration = 11 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
51412025-03-01T01:19:53.617ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51422025-03-01T01:19:53.619ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
51432025-03-01T01:19:53.619ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
51442025-03-01T01:19:53.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
51452025-03-01T01:19:53.621ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
51462025-03-01T01:19:53.621ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
51472025-03-01T01:19:53.621ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
51482025-03-01T01:19:53.623ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51492025-03-01T01:19:53.625ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
51502025-03-01T01:19:53.625ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = cce65e3e-6c86-4cdd-98ad-9a38c98082e8 dns_zone_name = oxide.test found_so_far = 0 version = 2
51512025-03-01T01:19:53.625ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
51522025-03-01T01:19:53.625ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
51532025-03-01T01:19:53.625ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
51542025-03-01T01:19:53.626ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
51552025-03-01T01:19:53.626ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
51562025-03-01T01:19:53.626ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51572025-03-01T01:19:53.630ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
51582025-03-01T01:19:53.630ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
51592025-03-01T01:19:53.630ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
51602025-03-01T01:19:53.634ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = cce65e3e-6c86-4cdd-98ad-9a38c98082e8 dns_zone_name = oxide.test found_so_far = 1 version = 2
51612025-03-01T01:19:53.634ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
51622025-03-01T01:19:53.634ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-03-01 01:14:54.679503 UTC dns_group = external generation = 2
51632025-03-01T01:19:53.634ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51642025-03-01T01:19:53.634ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 418.939134ms iteration = 6 status = {"generation":2}
51652025-03-01T01:19:53.638ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 3471264f-127e-4a25-bc10-2e8249e8d70a, lookup_type: ById(3471264f-127e-4a25-bc10-2e8249e8d70a) } result = Ok(())
51662025-03-01T01:19:53.638ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
51672025-03-01T01:19:53.638ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
51682025-03-01T01:19:53.644ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
51692025-03-01T01:19:53.644ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
51702025-03-01T01:19:53.645ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 430.189334ms iteration = 11 status = 0
51712025-03-01T01:19:53.646ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51722025-03-01T01:19:53.649ZDEBGnexus (BackgroundTasks): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
51732025-03-01T01:19:53.649ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
51742025-03-01T01:19:53.649ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
51752025-03-01T01:19:53.649ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
51762025-03-01T01:19:53.650ZDEBGnexus (BackgroundTasks): client request SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
51772025-03-01T01:19:53.657ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
51782025-03-01T01:19:53.657ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
51792025-03-01T01:19:53.659ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51802025-03-01T01:19:53.660ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51812025-03-01T01:19:53.661ZDEBGnexus (BackgroundTasks): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
51822025-03-01T01:19:53.661ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
51832025-03-01T01:19:53.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
51842025-03-01T01:19:53.664ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
51852025-03-01T01:19:53.664ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
51862025-03-01T01:19:53.664ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
51872025-03-01T01:19:53.664ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
51882025-03-01T01:19:53.665ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 449.935106ms iteration = 11 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
51892025-03-01T01:19:53.665ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
51902025-03-01T01:19:53.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
51912025-03-01T01:19:53.667ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
51922025-03-01T01:19:53.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
51932025-03-01T01:19:53.669ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
51942025-03-01T01:19:53.669ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 0a9e4b5c-53a1-4f0a-8849-98a8b1852af3 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
51952025-03-01T01:19:53.669ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
51962025-03-01T01:19:53.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
51972025-03-01T01:19:53.673ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-03-01T01:14:49.537343Z, time_modified: 2025-03-01T01:14:49.537343Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 1682a303-6254-452b-b4cf-160ed9dc3fc9, db_silo: Silo { identity: SiloIdentity { id: 1682a303-6254-452b-b4cf-160ed9dc3fc9, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-03-01T01:14:54.631650Z, time_modified: 2025-03-01T01:14:54.631650Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "851c0b739689cfb98a2e401e6047fa98e9fcc283d9fc3f660bd69842a9c06be9" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 1682a303-6254-452b-b4cf-160ed9dc3fc9, db_silo: Silo { identity: SiloIdentity { id: 1682a303-6254-452b-b4cf-160ed9dc3fc9, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-03-01T01:14:54.631650Z, time_modified: 2025-03-01T01:14:54.631650Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "851c0b739689cfb98a2e401e6047fa98e9fcc283d9fc3f660bd69842a9c06be9" }] }) }
51982025-03-01T01:19:53.673ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 458.168594ms iteration = 6 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"1682a303-6254-452b-b4cf-160ed9dc3fc9","tls_certs":["851c0b739689cfb98a2e401e6047fa98e9fcc283d9fc3f660bd69842a9c06be9"]}},"default_endpoint":{"silo_id":"1682a303-6254-452b-b4cf-160ed9dc3fc9","tls_certs":["851c0b739689cfb98a2e401e6047fa98e9fcc283d9fc3f660bd69842a9c06be9"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
51992025-03-01T01:19:53.673ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
52002025-03-01T01:19:53.673ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
52012025-03-01T01:19:53.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
52022025-03-01T01:19:53.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
52032025-03-01T01:19:53.674ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
52042025-03-01T01:19:53.676ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52052025-03-01T01:19:53.678ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52062025-03-01T01:19:53.678ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52072025-03-01T01:19:53.680ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
52082025-03-01T01:19:53.680ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
52092025-03-01T01:19:53.680ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
52102025-03-01T01:19:53.681ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
52112025-03-01T01:19:53.681ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
52122025-03-01T01:19:53.681ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
52132025-03-01T01:19:53.682ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
52142025-03-01T01:19:53.682ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
52152025-03-01T01:19:53.682ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
52162025-03-01T01:19:53.684ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 0a9e4b5c-53a1-4f0a-8849-98a8b1852af3 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
52172025-03-01T01:19:53.684ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
52182025-03-01T01:19:53.684ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-03-01 01:14:53.460216 UTC dns_group = internal generation = 1
52192025-03-01T01:19:53.684ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 469.217769ms iteration = 6 status = {"generation":1}
52202025-03-01T01:19:53.685ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
52212025-03-01T01:19:53.685ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
52222025-03-01T01:19:53.688ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
52232025-03-01T01:19:53.689ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
52242025-03-01T01:19:53.690ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
52252025-03-01T01:19:53.691ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
52262025-03-01T01:19:53.693ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
52272025-03-01T01:19:53.693ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
52282025-03-01T01:19:53.695ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
52292025-03-01T01:19:53.695ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
52302025-03-01T01:19:53.696ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 481.09036ms iteration = 11 status = {}
52312025-03-01T01:19:53.696ZDEBGnexus (BackgroundTasks): client request SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = tuf_artifact_replication body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/artifacts
52322025-03-01T01:19:53.697ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
52332025-03-01T01:19:53.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
52342025-03-01T01:19:53.698ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 483.338076ms iteration = 12 status = {"physical_disks_added":0}
52352025-03-01T01:19:53.698ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52362025-03-01T01:19:53.704ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
52372025-03-01T01:19:53.704ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
52382025-03-01T01:19:53.704ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
52392025-03-01T01:19:53.706ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
52402025-03-01T01:19:53.706ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
52412025-03-01T01:19:53.708ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
52422025-03-01T01:19:53.708ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
52432025-03-01T01:19:53.710ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
52442025-03-01T01:19:53.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
52452025-03-01T01:19:53.716ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
52462025-03-01T01:19:53.717ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
52472025-03-01T01:19:53.718ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
52482025-03-01T01:19:53.718ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
52492025-03-01T01:19:53.720ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
52502025-03-01T01:19:53.720ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
52512025-03-01T01:19:53.722ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52522025-03-01T01:19:53.724ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
52532025-03-01T01:19:53.724ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "bf7eb6dd-c459-4f54-8754-937d44f260c2", "content-length": "2", "date": "Sat, 01 Mar 2025 01:19:53 GMT"} })
52542025-03-01T01:19:53.724ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52552025-03-01T01:19:53.725ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
52562025-03-01T01:19:53.725ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
52572025-03-01T01:19:53.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
52582025-03-01T01:19:53.726ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
52592025-03-01T01:19:53.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
52602025-03-01T01:19:53.727ZDEBGnexus (BackgroundTasks): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
52612025-03-01T01:19:53.727ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
52622025-03-01T01:19:53.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
52632025-03-01T01:19:53.727ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
52642025-03-01T01:19:53.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
52652025-03-01T01:19:53.728ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 513.757146ms iteration = 11 status = null
52662025-03-01T01:19:53.729ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
52672025-03-01T01:19:53.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
52682025-03-01T01:19:53.732ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
52692025-03-01T01:19:53.732ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 517.607143ms iteration = 6 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
52702025-03-01T01:19:53.733ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
52712025-03-01T01:19:53.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
52722025-03-01T01:19:53.734ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52732025-03-01T01:19:53.738ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
52742025-03-01T01:19:53.738ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
52752025-03-01T01:19:53.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
52762025-03-01T01:19:53.741ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52772025-03-01T01:19:53.744ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
52782025-03-01T01:19:53.744ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
52792025-03-01T01:19:53.744ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
52802025-03-01T01:19:53.750ZDEBGnexus (BackgroundTasks): client response SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "de1654cf-93c1-40c2-99db-a1aa80d906bf", "date": "Sat, 01 Mar 2025 01:19:53 GMT"} })
52812025-03-01T01:19:53.750ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
52822025-03-01T01:19:53.750ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
52832025-03-01T01:19:53.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
52842025-03-01T01:19:53.750ZDEBGnexus (BackgroundTasks): client response SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = tuf_artifact_replication result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/artifacts", status: 200, headers: {"content-type": "application/json", "x-request-id": "c740c081-17bc-418d-a573-65e18afd0421", "content-length": "2", "date": "Sat, 01 Mar 2025 01:19:53 GMT"} })
52852025-03-01T01:19:53.750ZINFOnexus (BackgroundTasks): Successfully got artifact list background_task = tuf_artifact_replication file = nexus/src/app/background/tasks/tuf_artifact_replication.rs:619 sled = http://[fd00:1122:3344:101::1]:12345
52862025-03-01T01:19:53.750ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "e4b1f107-0ee3-4ee0-967b-e68a8bd5e1ab", "date": "Sat, 01 Mar 2025 01:19:53 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
52872025-03-01T01:19:53.750ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
52882025-03-01T01:19:53.752ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
52892025-03-01T01:19:53.753ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
52902025-03-01T01:19:53.753ZDEBGnexus (BackgroundTasks): activation complete background_task = tuf_artifact_replication elapsed = 538.134773ms iteration = 2 status = {"last_run_counters":{"copy_err":0,"copy_ok":0,"delete_err":0,"delete_ok":0,"list_err":0,"list_ok":1,"put_err":0,"put_ok":0},"lifetime_counters":{"copy_err":0,"copy_ok":0,"delete_err":0,"delete_ok":0,"list_err":0,"list_ok":2,"put_err":0,"put_ok":0},"local_repos":0,"request_debug_ringbuf":[{"operation":"list","target_sled":"3471264f-127e-4a25-bc10-2e8249e8d70a","time":"2025-03-01T01:14:53.612860610Z"},{"operation":"list","target_sled":"3471264f-127e-4a25-bc10-2e8249e8d70a","time":"2025-03-01T01:19:53.750515495Z"}]}
52912025-03-01T01:19:53.754ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "b840d825-c3e1-45e8-9bff-49d10358cdee", "date": "Sat, 01 Mar 2025 01:19:53 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
52922025-03-01T01:19:53.754ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
52932025-03-01T01:19:53.756ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "075addab-f5b7-468b-b2e2-abe8d7397338", "date": "Sat, 01 Mar 2025 01:19:53 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
52942025-03-01T01:19:53.756ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
52952025-03-01T01:19:53.756ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
52962025-03-01T01:19:53.756ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
52972025-03-01T01:19:53.758ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
52982025-03-01T01:19:53.758ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 543.001471ms iteration = 8 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
52992025-03-01T01:19:53.759ZINFOnexus (BackgroundTasks): VPC route manager sled 3471264f-127e-4a25-bc10-2e8249e8d70a push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
53002025-03-01T01:19:53.759ZDEBGnexus (BackgroundTasks): client request SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
53012025-03-01T01:19:53.759ZDEBGnexus (BackgroundTasks): client response SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "e908aad8-4a9d-4fdb-9269-52b0f95e2519", "date": "Sat, 01 Mar 2025 01:19:53 GMT"} })
53022025-03-01T01:19:53.761ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 546.461912ms iteration = 11 status = {}
53032025-03-01T01:19:53.765ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
53042025-03-01T01:19:53.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
53052025-03-01T01:19:53.765ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53062025-03-01T01:19:53.767ZDEBGnexus (BackgroundTasks): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
53072025-03-01T01:19:53.767ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
53082025-03-01T01:19:53.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
53092025-03-01T01:19:53.820ZDEBGnexus (BackgroundTasks): client request SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
53102025-03-01T01:19:53.820ZDEBGnexus (BackgroundTasks): client response SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "2e2fcb57-f4f3-4f79-80f9-cae45757e6dd", "content-length": "691", "date": "Sat, 01 Mar 2025 01:19:53 GMT"} })
53112025-03-01T01:19:53.820ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
53122025-03-01T01:19:53.820ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
53132025-03-01T01:19:53.820ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
53142025-03-01T01:19:53.822ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 607.788701ms iteration = 11 status = {}
53152025-03-01T01:19:53.823ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
53162025-03-01T01:19:53.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
53172025-03-01T01:19:53.824ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53182025-03-01T01:19:53.825ZDEBGnexus (BackgroundTasks): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
53192025-03-01T01:19:53.825ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
53202025-03-01T01:19:53.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
53212025-03-01T01:19:53.828ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
53222025-03-01T01:19:53.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
53232025-03-01T01:19:53.829ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53242025-03-01T01:19:53.830ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53252025-03-01T01:19:53.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53262025-03-01T01:19:53.831ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
53272025-03-01T01:19:53.831ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
53282025-03-01T01:19:53.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
53292025-03-01T01:19:53.832ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 7f9c3c14-58c5-473f-8692-6376be44401e, rack_id: 4854cb88-dfba-4609-8f9d-72aac08cef66, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(cb10d0c6-a704-4231-b148-4f9ae21a03f8) } rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 switch_location = Switch0
53302025-03-01T01:19:53.832ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53312025-03-01T01:19:53.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53322025-03-01T01:19:53.833ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53332025-03-01T01:19:53.834ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
53342025-03-01T01:19:53.834ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
53352025-03-01T01:19:53.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
53362025-03-01T01:19:53.839ZINFOnexus (BackgroundTasks): ensured all Crucible datasets present in inventory have database records background_task = blueprint_rendezvous file = nexus/reconfigurator/rendezvous/src/crucible_dataset.rs:113 num_already_exist = 9 num_inserted = 0 num_not_in_inventory = 0
53372025-03-01T01:19:53.841ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_rendezvous elapsed = 624.628174ms iteration = 3 status = {"blueprint_id":"8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7","inventory_collection_id":"604327b1-d744-4ec6-ab1e-d73a3fc09ea9","stats":{"crucible_dataset":{"num_already_exist":9,"num_inserted":0,"num_not_in_inventory":0},"debug_dataset":{"num_already_exist":9,"num_already_tombstoned":0,"num_inserted":0,"num_not_in_inventory":0,"num_tombstoned":0}}}
53382025-03-01T01:19:53.842ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
53392025-03-01T01:19:53.843ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "9ebbb250-723f-43ec-bdfc-5d99c2e3d2b8", "content-length": "134", "date": "Sat, 01 Mar 2025 01:19:53 GMT"} })
53402025-03-01T01:19:53.843ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
53412025-03-01T01:19:53.843ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = cb10d0c6-a704-4231-b148-4f9ae21a03f8
53422025-03-01T01:19:53.843ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
53432025-03-01T01:19:53.843ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
53442025-03-01T01:19:53.843ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
53452025-03-01T01:19:53.843ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
53462025-03-01T01:19:53.843ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
53472025-03-01T01:19:53.843ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
53482025-03-01T01:19:53.843ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
53492025-03-01T01:19:53.843ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
53502025-03-01T01:19:53.843ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66
53512025-03-01T01:19:53.843ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53522025-03-01T01:19:53.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53532025-03-01T01:19:53.845ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
53542025-03-01T01:19:53.845ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "dd704952-0299-4c06-b163-6434eff7cb45", "content-length": "2", "date": "Sat, 01 Mar 2025 01:19:53 GMT"} })
53552025-03-01T01:19:53.845ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
53562025-03-01T01:19:53.845ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "94be3c61-ef32-4ac7-88c2-367e53fb1944", "content-length": "52", "date": "Sat, 01 Mar 2025 01:19:53 GMT"} })
53572025-03-01T01:19:53.845ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 switch_location = Switch0
53582025-03-01T01:19:53.845ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
53592025-03-01T01:19:53.849ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53602025-03-01T01:19:53.853ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
53612025-03-01T01:19:53.853ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
53622025-03-01T01:19:53.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
53632025-03-01T01:19:53.857ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
53642025-03-01T01:19:53.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
53652025-03-01T01:19:53.859ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
53662025-03-01T01:19:53.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
53672025-03-01T01:19:53.860ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
53682025-03-01T01:19:53.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
53692025-03-01T01:19:53.862ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
53702025-03-01T01:19:53.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
53712025-03-01T01:19:53.864ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
53722025-03-01T01:19:53.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
53732025-03-01T01:19:53.892ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
53742025-03-01T01:19:53.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
53752025-03-01T01:19:53.894ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
53762025-03-01T01:19:53.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
53772025-03-01T01:19:53.896ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53782025-03-01T01:19:53.899ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
53792025-03-01T01:19:53.899ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
53802025-03-01T01:19:53.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
53812025-03-01T01:19:53.901ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
53822025-03-01T01:19:53.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
53832025-03-01T01:19:53.902ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
53842025-03-01T01:19:53.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
53852025-03-01T01:19:53.903ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53862025-03-01T01:19:53.907ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
53872025-03-01T01:19:53.907ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
53882025-03-01T01:19:53.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
53892025-03-01T01:19:53.913ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("external-dns"): [NetworkInterface { id: 2a869d60-39e8-4bdc-8d02-111de31939c0, kind: Service { id: 2e37f4af-57dc-468e-80e3-cf2aea2ffdc8 }, name: Name("external-dns-2e37f4af-57dc-468e-80e3-cf2aea2ffdc8"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 253, 67])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6758d14d-4902-4627-81d2-7dad7e53fa1b, kind: Service { id: 5f6eb3bd-0126-40e0-98ef-ee33df084158 }, name: Name("external-dns-5f6eb3bd-0126-40e0-98ef-ee33df084158"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 249, 39])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("nexus"): [NetworkInterface { id: 300c1ff3-79a6-4732-8c05-98761eb20b54, kind: Service { id: 2787d512-9167-42df-aaa9-77fdf2945e21 }, name: Name("nexus-2787d512-9167-42df-aaa9-77fdf2945e21"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 202, 80])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 406c5523-104c-4a97-b243-5d6f7c1d545c, kind: Service { id: 67b03f4e-4cbd-4843-9cd9-647f610abcfc }, name: Name("nexus-67b03f4e-4cbd-4843-9cd9-647f610abcfc"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 240, 110])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 846bca27-d2f4-4703-8203-b5fe6f2c25c0, kind: Service { id: e72cb471-220b-4fe2-ad51-f1274aedd6cc }, name: Name("nexus-e72cb471-220b-4fe2-ad51-f1274aedd6cc"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 180, 221])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })], Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })]} vpc_interfaces = {}
53902025-03-01T01:19:53.914ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
53912025-03-01T01:19:53.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
53922025-03-01T01:19:53.915ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53932025-03-01T01:19:53.917ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
53942025-03-01T01:19:53.917ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
53952025-03-01T01:19:53.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
53962025-03-01T01:19:53.919ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
53972025-03-01T01:19:53.921ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 2a869d60-39e8-4bdc-8d02-111de31939c0, kind: Service { id: 2e37f4af-57dc-468e-80e3-cf2aea2ffdc8 }, name: Name("external-dns-2e37f4af-57dc-468e-80e3-cf2aea2ffdc8"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 253, 67])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6758d14d-4902-4627-81d2-7dad7e53fa1b, kind: Service { id: 5f6eb3bd-0126-40e0-98ef-ee33df084158 }, name: Name("external-dns-5f6eb3bd-0126-40e0-98ef-ee33df084158"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 249, 39])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 300c1ff3-79a6-4732-8c05-98761eb20b54, kind: Service { id: 2787d512-9167-42df-aaa9-77fdf2945e21 }, name: Name("nexus-2787d512-9167-42df-aaa9-77fdf2945e21"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 202, 80])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 406c5523-104c-4a97-b243-5d6f7c1d545c, kind: Service { id: 67b03f4e-4cbd-4843-9cd9-647f610abcfc }, name: Name("nexus-67b03f4e-4cbd-4843-9cd9-647f610abcfc"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 240, 110])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 846bca27-d2f4-4703-8203-b5fe6f2c25c0, kind: Service { id: e72cb471-220b-4fe2-ad51-f1274aedd6cc }, name: Name("nexus-e72cb471-220b-4fe2-ad51-f1274aedd6cc"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 180, 221])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
53982025-03-01T01:19:53.921ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
53992025-03-01T01:19:53.943ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "e2fc20e1-8ed8-46d2-9445-e18b8a5effde", "date": "Sat, 01 Mar 2025 01:19:53 GMT"} })
54002025-03-01T01:19:53.943ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 switch = Switch0
54012025-03-01T01:19:53.943ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
54022025-03-01T01:19:53.943ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "704996bd-71fe-4e92-ae68-bec84c28a258", "content-length": "682", "date": "Sat, 01 Mar 2025 01:19:53 GMT"} })
54032025-03-01T01:19:53.943ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54042025-03-01T01:19:53.944ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54052025-03-01T01:19:53.947ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54062025-03-01T01:19:53.947ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54072025-03-01T01:19:53.950ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54082025-03-01T01:19:53.951ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54092025-03-01T01:19:53.952ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54102025-03-01T01:19:53.953ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54112025-03-01T01:19:53.966ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 752.05921ms iteration = 11 status = {}
54122025-03-01T01:19:54.053ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: 3471264f-127e-4a25-bc10-2e8249e8d70a, time_created: 2025-03-01T01:14:51.548737Z, time_modified: 2025-03-01T01:14:51.548737Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: 4854cb88-dfba-4609-8f9d-72aac08cef66, is_scrimlet: true, serial_number: "sock", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)), repo_depot_port: SqlU16(12348) }]
54132025-03-01T01:19:54.053ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
54142025-03-01T01:19:54.053ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
54152025-03-01T01:19:54.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
54162025-03-01T01:19:54.055ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
54172025-03-01T01:19:54.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
54182025-03-01T01:19:54.057ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54192025-03-01T01:19:54.060ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: 3471264f-127e-4a25-bc10-2e8249e8d70a, lookup_type: ById(3471264f-127e-4a25-bc10-2e8249e8d70a) } result = Ok(())
54202025-03-01T01:19:54.090ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
54212025-03-01T01:19:54.090ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "7f27313d-e497-4a74-a116-c02c3834f643", "date": "Sat, 01 Mar 2025 01:19:53 GMT"} })
54222025-03-01T01:19:54.093ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
54232025-03-01T01:19:54.093ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 877.905704ms
54242025-03-01T01:19:54.093ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 877.915834ms iteration = 2 status = {}
54252025-03-01T01:19:54.171ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 3233dff0-7aaf-484e-b5f7-771951c402ac roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
54262025-03-01T01:19:54.171ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 3233dff0-7aaf-484e-b5f7-771951c402ac resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
54272025-03-01T01:19:54.173ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2210 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 3233dff0-7aaf-484e-b5f7-771951c402ac response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
54282025-03-01T01:19:55.191ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = d59b8bbc-a63a-4b5d-a9c1-02eae79c7252 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
54292025-03-01T01:19:55.191ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = d59b8bbc-a63a-4b5d-a9c1-02eae79c7252 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
54302025-03-01T01:19:55.193ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2433 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = d59b8bbc-a63a-4b5d-a9c1-02eae79c7252 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
54312025-03-01T01:19:56.214ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = f2a4a50f-6c4b-4488-92d2-73d6a45be603 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
54322025-03-01T01:19:56.214ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = f2a4a50f-6c4b-4488-92d2-73d6a45be603 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
54332025-03-01T01:19:56.217ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3045 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = f2a4a50f-6c4b-4488-92d2-73d6a45be603 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
54342025-03-01T01:19:57.236ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = ab2db1a0-fcb2-4876-874f-e08c6f28281d roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
54352025-03-01T01:19:57.236ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = ab2db1a0-fcb2-4876-874f-e08c6f28281d resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
54362025-03-01T01:19:57.239ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2781 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = ab2db1a0-fcb2-4876-874f-e08c6f28281d response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
54372025-03-01T01:19:57.414ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 304 local_addr = [fd00:1122:3344:101::c]:34357 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = 2a005be8-c6fb-4ebe-be8a-b4652ee6262e response_code = 200 uri = /67b03f4e-4cbd-4843-9cd9-647f610abcfc
54382025-03-01T01:19:58.258ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 0e97fb70-1ec9-41bc-89c1-64f2858d8d7c roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
54392025-03-01T01:19:58.258ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 0e97fb70-1ec9-41bc-89c1-64f2858d8d7c resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
54402025-03-01T01:19:58.260ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1929 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 0e97fb70-1ec9-41bc-89c1-64f2858d8d7c response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
54412025-03-01T01:19:59.279ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 54610989-62eb-40ef-924c-afaf1cd7168e roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
54422025-03-01T01:19:59.280ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 54610989-62eb-40ef-924c-afaf1cd7168e resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
54432025-03-01T01:19:59.281ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2249 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 54610989-62eb-40ef-924c-afaf1cd7168e response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
54442025-03-01T01:20:00.301ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 5a570d4c-7173-4252-ad97-557e543c6799 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
54452025-03-01T01:20:00.301ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 5a570d4c-7173-4252-ad97-557e543c6799 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
54462025-03-01T01:20:00.303ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2237 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 5a570d4c-7173-4252-ad97-557e543c6799 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
54472025-03-01T01:20:01.323ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 06b69692-434b-4467-945a-ad3aaf4d9063 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
54482025-03-01T01:20:01.324ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 06b69692-434b-4467-945a-ad3aaf4d9063 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
54492025-03-01T01:20:01.326ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2206 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 06b69692-434b-4467-945a-ad3aaf4d9063 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
54502025-03-01T01:20:02.346ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 929db67e-f045-4fa1-86b7-6b54ab533eea roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
54512025-03-01T01:20:02.346ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 929db67e-f045-4fa1-86b7-6b54ab533eea resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
54522025-03-01T01:20:02.348ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2020 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 929db67e-f045-4fa1-86b7-6b54ab533eea response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
54532025-03-01T01:20:03.214ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 32 reason = Timeout
54542025-03-01T01:20:03.214ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 32 reason = Timeout
54552025-03-01T01:20:03.214ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54562025-03-01T01:20:03.214ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
54572025-03-01T01:20:03.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54582025-03-01T01:20:03.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
54592025-03-01T01:20:03.216ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54602025-03-01T01:20:03.218ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
54612025-03-01T01:20:03.218ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54622025-03-01T01:20:03.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54632025-03-01T01:20:03.220ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54642025-03-01T01:20:03.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54652025-03-01T01:20:03.222ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54662025-03-01T01:20:03.224ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7, lookup_type: ById(8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7) } result = Ok(())
54672025-03-01T01:20:03.224ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54682025-03-01T01:20:03.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54692025-03-01T01:20:03.236ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 original_time_created = 2025-03-01 01:14:50.436545 UTC target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 time_created = 2025-03-01 01:14:50.436545 UTC
54702025-03-01T01:20:03.236ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.736763ms iteration = 32 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7","time_created":"2025-03-01T01:14:50.436545Z"}
54712025-03-01T01:20:03.244ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
54722025-03-01T01:20:03.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
54732025-03-01T01:20:03.275ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 60.8728ms iteration = 32 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
54742025-03-01T01:20:03.368ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = bb220d05-7e0b-44f6-9ada-411d1ed61321 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
54752025-03-01T01:20:03.368ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = bb220d05-7e0b-44f6-9ada-411d1ed61321 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
54762025-03-01T01:20:03.370ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1787 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = bb220d05-7e0b-44f6-9ada-411d1ed61321 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
54772025-03-01T01:20:04.389ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = f9f5004c-1539-45da-abcb-c9675b138d7d roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
54782025-03-01T01:20:04.389ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = f9f5004c-1539-45da-abcb-c9675b138d7d resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
54792025-03-01T01:20:04.391ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2294 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = f9f5004c-1539-45da-abcb-c9675b138d7d response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
54802025-03-01T01:20:05.412ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 624a2af5-0672-40a0-afca-c9d9d62ac736 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
54812025-03-01T01:20:05.412ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 624a2af5-0672-40a0-afca-c9d9d62ac736 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
54822025-03-01T01:20:05.414ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2318 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 624a2af5-0672-40a0-afca-c9d9d62ac736 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
54832025-03-01T01:20:06.435ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 4dfee182-e81d-40e2-a9b9-baaadc587dca roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
54842025-03-01T01:20:06.435ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 4dfee182-e81d-40e2-a9b9-baaadc587dca resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
54852025-03-01T01:20:06.437ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2174 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 4dfee182-e81d-40e2-a9b9-baaadc587dca response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
54862025-03-01T01:20:07.415ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 339 local_addr = [fd00:1122:3344:101::c]:34357 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = 2f0b823e-ace5-4c6c-8bc6-d252c91da9de response_code = 200 uri = /67b03f4e-4cbd-4843-9cd9-647f610abcfc
54872025-03-01T01:20:07.456ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = a72700fc-852d-4bab-9cd9-f1b2f5bd532e roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
54882025-03-01T01:20:07.457ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = a72700fc-852d-4bab-9cd9-f1b2f5bd532e resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
54892025-03-01T01:20:07.458ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1829 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = a72700fc-852d-4bab-9cd9-f1b2f5bd532e response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
54902025-03-01T01:20:08.479ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = bc1765e0-5bec-4d3d-94e3-b61a8c606700 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
54912025-03-01T01:20:08.479ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = bc1765e0-5bec-4d3d-94e3-b61a8c606700 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
54922025-03-01T01:20:08.481ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1921 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = bc1765e0-5bec-4d3d-94e3-b61a8c606700 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
54932025-03-01T01:20:09.500ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 6ce5356f-c6ba-4ede-917e-d3388c7e860a roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
54942025-03-01T01:20:09.500ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 6ce5356f-c6ba-4ede-917e-d3388c7e860a resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
54952025-03-01T01:20:09.502ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1889 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 6ce5356f-c6ba-4ede-917e-d3388c7e860a response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
54962025-03-01T01:20:10.522ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 21230b12-ca94-4091-8c11-96354a9de6f3 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
54972025-03-01T01:20:10.522ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 21230b12-ca94-4091-8c11-96354a9de6f3 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
54982025-03-01T01:20:10.524ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2287 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 21230b12-ca94-4091-8c11-96354a9de6f3 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
54992025-03-01T01:20:11.544ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 1c440562-5a5a-4e6f-9d8b-8cc138930c55 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
55002025-03-01T01:20:11.544ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 1c440562-5a5a-4e6f-9d8b-8cc138930c55 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
55012025-03-01T01:20:11.546ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2084 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 1c440562-5a5a-4e6f-9d8b-8cc138930c55 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
55022025-03-01T01:20:12.565ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 9d6d6221-8750-4a0d-8e3a-db85101f45e7 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
55032025-03-01T01:20:12.565ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 9d6d6221-8750-4a0d-8e3a-db85101f45e7 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
55042025-03-01T01:20:12.567ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2151 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 9d6d6221-8750-4a0d-8e3a-db85101f45e7 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
55052025-03-01T01:20:13.214ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 33 reason = Timeout
55062025-03-01T01:20:13.214ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55072025-03-01T01:20:13.214ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 33 reason = Timeout
55082025-03-01T01:20:13.214ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
55092025-03-01T01:20:13.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55102025-03-01T01:20:13.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
55112025-03-01T01:20:13.216ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55122025-03-01T01:20:13.218ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
55132025-03-01T01:20:13.218ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55142025-03-01T01:20:13.218ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55152025-03-01T01:20:13.220ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55162025-03-01T01:20:13.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55172025-03-01T01:20:13.221ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55182025-03-01T01:20:13.224ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7, lookup_type: ById(8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7) } result = Ok(())
55192025-03-01T01:20:13.224ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55202025-03-01T01:20:13.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55212025-03-01T01:20:13.236ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 original_time_created = 2025-03-01 01:14:50.436545 UTC target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 time_created = 2025-03-01 01:14:50.436545 UTC
55222025-03-01T01:20:13.236ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.258203ms iteration = 33 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7","time_created":"2025-03-01T01:14:50.436545Z"}
55232025-03-01T01:20:13.248ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
55242025-03-01T01:20:13.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
55252025-03-01T01:20:13.249ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 35.602865ms iteration = 33 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
55262025-03-01T01:20:13.586ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 5ad1bed2-d0c9-4d51-893e-dbfa1c08f080 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
55272025-03-01T01:20:13.586ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 5ad1bed2-d0c9-4d51-893e-dbfa1c08f080 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
55282025-03-01T01:20:13.588ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1812 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 5ad1bed2-d0c9-4d51-893e-dbfa1c08f080 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
55292025-03-01T01:20:14.607ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 7f3bc063-afcf-4377-9909-28e9a493cbb6 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
55302025-03-01T01:20:14.608ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 7f3bc063-afcf-4377-9909-28e9a493cbb6 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
55312025-03-01T01:20:14.609ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2159 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 7f3bc063-afcf-4377-9909-28e9a493cbb6 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
55322025-03-01T01:20:15.629ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 2f267fee-d13d-4768-880b-061a153f2c5f roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
55332025-03-01T01:20:15.630ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 2f267fee-d13d-4768-880b-061a153f2c5f resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
55342025-03-01T01:20:15.632ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2664 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 2f267fee-d13d-4768-880b-061a153f2c5f response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
55352025-03-01T01:20:16.652ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 3b8a1a5b-57c3-4161-a7c6-b80697004376 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
55362025-03-01T01:20:16.652ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 3b8a1a5b-57c3-4161-a7c6-b80697004376 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
55372025-03-01T01:20:16.654ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2217 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 3b8a1a5b-57c3-4161-a7c6-b80697004376 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
55382025-03-01T01:20:17.415ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 324 local_addr = [fd00:1122:3344:101::c]:34357 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = b85101b4-a0cb-4791-993c-0a0d56377c30 response_code = 200 uri = /67b03f4e-4cbd-4843-9cd9-647f610abcfc
55392025-03-01T01:20:17.673ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c4d4bc69-7d3c-4eaf-8473-a7888f238ecf roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
55402025-03-01T01:20:17.673ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c4d4bc69-7d3c-4eaf-8473-a7888f238ecf resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
55412025-03-01T01:20:17.675ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2265 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c4d4bc69-7d3c-4eaf-8473-a7888f238ecf response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
55422025-03-01T01:20:18.694ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 8b61b8ca-fa56-469e-b952-918593360b39 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
55432025-03-01T01:20:18.694ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 8b61b8ca-fa56-469e-b952-918593360b39 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
55442025-03-01T01:20:18.696ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1882 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 8b61b8ca-fa56-469e-b952-918593360b39 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
55452025-03-01T01:20:19.717ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 5f763178-b3bc-4ff1-acdf-293b794f57db roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
55462025-03-01T01:20:19.717ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 5f763178-b3bc-4ff1-acdf-293b794f57db resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
55472025-03-01T01:20:19.719ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2329 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 5f763178-b3bc-4ff1-acdf-293b794f57db response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
55482025-03-01T01:20:20.738ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 39a50f8c-19d9-4866-92c7-c592e5c46931 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
55492025-03-01T01:20:20.738ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 39a50f8c-19d9-4866-92c7-c592e5c46931 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
55502025-03-01T01:20:20.740ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2565 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 39a50f8c-19d9-4866-92c7-c592e5c46931 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
55512025-03-01T01:20:21.760ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 812f4c9f-78bb-4b97-9b5c-5d4f154f8102 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
55522025-03-01T01:20:21.761ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 812f4c9f-78bb-4b97-9b5c-5d4f154f8102 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
55532025-03-01T01:20:21.763ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2302 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 812f4c9f-78bb-4b97-9b5c-5d4f154f8102 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
55542025-03-01T01:20:22.784ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = e9691cdc-392b-46e7-ad47-f9dfae1038ce roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
55552025-03-01T01:20:22.784ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = e9691cdc-392b-46e7-ad47-f9dfae1038ce resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
55562025-03-01T01:20:22.786ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2340 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = e9691cdc-392b-46e7-ad47-f9dfae1038ce response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
55572025-03-01T01:20:23.214ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 12 reason = Timeout
55582025-03-01T01:20:23.214ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
55592025-03-01T01:20:23.214ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 12 reason = Timeout
55602025-03-01T01:20:23.214ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 34 reason = Timeout
55612025-03-01T01:20:23.214ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
55622025-03-01T01:20:23.214ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
55632025-03-01T01:20:23.214ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 12 reason = Timeout
55642025-03-01T01:20:23.214ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 12 reason = Timeout
55652025-03-01T01:20:23.214ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
55662025-03-01T01:20:23.214ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
55672025-03-01T01:20:23.214ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 12 reason = Timeout
55682025-03-01T01:20:23.214ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 13 reason = Timeout
55692025-03-01T01:20:23.214ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
55702025-03-01T01:20:23.214ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 12 reason = Timeout
55712025-03-01T01:20:23.214ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
55722025-03-01T01:20:23.214ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
55732025-03-01T01:20:23.214ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
55742025-03-01T01:20:23.214ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 12 reason = Timeout
55752025-03-01T01:20:23.214ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 12 reason = Timeout
55762025-03-01T01:20:23.214ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55772025-03-01T01:20:23.214ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 12 reason = Timeout
55782025-03-01T01:20:23.214ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 12 reason = Timeout
55792025-03-01T01:20:23.214ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 12 reason = Timeout
55802025-03-01T01:20:23.214ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
55812025-03-01T01:20:23.214ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
55822025-03-01T01:20:23.214ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
55832025-03-01T01:20:23.214ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 12 reason = Timeout
55842025-03-01T01:20:23.214ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
55852025-03-01T01:20:23.214ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 12 reason = Timeout
55862025-03-01T01:20:23.214ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
55872025-03-01T01:20:23.214ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 12 reason = Timeout
55882025-03-01T01:20:23.214ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 12 reason = Timeout
55892025-03-01T01:20:23.214ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
55902025-03-01T01:20:23.214ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
55912025-03-01T01:20:23.214ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
55922025-03-01T01:20:23.214ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 34 reason = Timeout
55932025-03-01T01:20:23.214ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55942025-03-01T01:20:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
55952025-03-01T01:20:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
55962025-03-01T01:20:23.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
55972025-03-01T01:20:23.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
55982025-03-01T01:20:23.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
55992025-03-01T01:20:23.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
56002025-03-01T01:20:23.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
56012025-03-01T01:20:23.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
56022025-03-01T01:20:23.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
56032025-03-01T01:20:23.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56042025-03-01T01:20:23.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
56052025-03-01T01:20:23.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
56062025-03-01T01:20:23.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
56072025-03-01T01:20:23.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56082025-03-01T01:20:23.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
56092025-03-01T01:20:23.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
56102025-03-01T01:20:23.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
56112025-03-01T01:20:23.216ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
56122025-03-01T01:20:23.216ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56132025-03-01T01:20:23.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
56142025-03-01T01:20:23.218ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.852838ms iteration = 12 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
56152025-03-01T01:20:23.219ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
56162025-03-01T01:20:23.219ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
56172025-03-01T01:20:23.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
56182025-03-01T01:20:23.225ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1233, tv_nsec: 912825969 } })
56192025-03-01T01:20:23.225ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56202025-03-01T01:20:23.225ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1154
56212025-03-01T01:20:23.230ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
56222025-03-01T01:20:23.230ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
56232025-03-01T01:20:23.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
56242025-03-01T01:20:23.230ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1233, tv_nsec: 918331581 } })
56252025-03-01T01:20:23.230ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1154
56262025-03-01T01:20:23.232ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56272025-03-01T01:20:23.233ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56282025-03-01T01:20:23.236ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
56292025-03-01T01:20:23.236ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
56302025-03-01T01:20:23.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
56312025-03-01T01:20:23.237ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
56322025-03-01T01:20:23.237ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56332025-03-01T01:20:23.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56342025-03-01T01:20:23.243ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
56352025-03-01T01:20:23.244ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
56362025-03-01T01:20:23.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
56372025-03-01T01:20:23.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
56382025-03-01T01:20:23.244ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56392025-03-01T01:20:23.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56402025-03-01T01:20:23.246ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56412025-03-01T01:20:23.250ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
56422025-03-01T01:20:23.250ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 35.792019ms iteration = 12 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
56432025-03-01T01:20:23.250ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7, lookup_type: ById(8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7) } result = Ok(())
56442025-03-01T01:20:23.250ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56452025-03-01T01:20:23.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56462025-03-01T01:20:23.253ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
56472025-03-01T01:20:23.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
56482025-03-01T01:20:23.264ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 original_time_created = 2025-03-01 01:14:50.436545 UTC target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 time_created = 2025-03-01 01:14:50.436545 UTC
56492025-03-01T01:20:23.264ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 49.223662ms iteration = 34 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7","time_created":"2025-03-01T01:14:50.436545Z"}
56502025-03-01T01:20:23.267ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
56512025-03-01T01:20:23.267ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
56522025-03-01T01:20:23.267ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
56532025-03-01T01:20:23.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
56542025-03-01T01:20:23.270ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
56552025-03-01T01:20:23.270ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
56562025-03-01T01:20:23.270ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
56572025-03-01T01:20:23.270ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
56582025-03-01T01:20:23.270ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
56592025-03-01T01:20:23.271ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
56602025-03-01T01:20:23.272ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
56612025-03-01T01:20:23.272ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 57.94376ms iteration = 12 status = {"errors":[],"garbage_collect_requested":[]}
56622025-03-01T01:20:23.272ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
56632025-03-01T01:20:23.274ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
56642025-03-01T01:20:23.275ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
56652025-03-01T01:20:23.275ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
56662025-03-01T01:20:23.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
56672025-03-01T01:20:23.275ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ba69db29-18f0-45da-bfdb-218681fe1493", "content-length": "26", "date": "Sat, 01 Mar 2025 01:20:23 GMT"} })
56682025-03-01T01:20:23.275ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
56692025-03-01T01:20:23.277ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
56702025-03-01T01:20:23.277ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
56712025-03-01T01:20:23.277ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 62.548004ms iteration = 34 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
56722025-03-01T01:20:23.277ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5a133695-5efd-4cec-9846-e0195ebde372", "content-length": "26", "date": "Sat, 01 Mar 2025 01:20:23 GMT"} })
56732025-03-01T01:20:23.277ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
56742025-03-01T01:20:23.277ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
56752025-03-01T01:20:23.278ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
56762025-03-01T01:20:23.279ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56772025-03-01T01:20:23.280ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56782025-03-01T01:20:23.281ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
56792025-03-01T01:20:23.281ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
56802025-03-01T01:20:23.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
56812025-03-01T01:20:23.281ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
56822025-03-01T01:20:23.281ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
56832025-03-01T01:20:23.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
56842025-03-01T01:20:23.283ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56852025-03-01T01:20:23.285ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
56862025-03-01T01:20:23.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
56872025-03-01T01:20:23.286ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
56882025-03-01T01:20:23.286ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
56892025-03-01T01:20:23.287ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
56902025-03-01T01:20:23.289ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 74.475797ms iteration = 12 status = {"errors":[],"finish_invoked_ok":[]}
56912025-03-01T01:20:23.291ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
56922025-03-01T01:20:23.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
56932025-03-01T01:20:23.291ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56942025-03-01T01:20:23.294ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
56952025-03-01T01:20:23.294ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
56962025-03-01T01:20:23.294ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
56972025-03-01T01:20:23.294ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56982025-03-01T01:20:23.298ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
56992025-03-01T01:20:23.298ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57002025-03-01T01:20:23.298ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57012025-03-01T01:20:23.301ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1233, tv_nsec: 988871728 } })
57022025-03-01T01:20:23.301ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1154 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66
57032025-03-01T01:20:23.309ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
57042025-03-01T01:20:23.309ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
57052025-03-01T01:20:23.309ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 95.110518ms iteration = 12 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
57062025-03-01T01:20:23.310ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 96.193299ms iteration = 12 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
57072025-03-01T01:20:23.324ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57082025-03-01T01:20:23.326ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 112.204156ms iteration = 12 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
57092025-03-01T01:20:23.327ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 3471264f-127e-4a25-bc10-2e8249e8d70a, lookup_type: ById(3471264f-127e-4a25-bc10-2e8249e8d70a) } result = Ok(())
57102025-03-01T01:20:23.327ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
57112025-03-01T01:20:23.327ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
57122025-03-01T01:20:23.329ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 114.756787ms iteration = 12 status = 0
57132025-03-01T01:20:23.329ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 115.101385ms iteration = 12 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
57142025-03-01T01:20:23.333ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
57152025-03-01T01:20:23.333ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
57162025-03-01T01:20:23.352ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
57172025-03-01T01:20:23.353ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
57182025-03-01T01:20:23.357ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
57192025-03-01T01:20:23.357ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "1b140b11-8b27-4a44-952b-9c7605cc8fe4", "content-length": "2", "date": "Sat, 01 Mar 2025 01:20:22 GMT"} })
57202025-03-01T01:20:23.359ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
57212025-03-01T01:20:23.359ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
57222025-03-01T01:20:23.361ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 146.75817ms iteration = 12 status = {}
57232025-03-01T01:20:23.368ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1162 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 zone_address = fd00:1122:3344:101::2
57242025-03-01T01:20:23.368ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
57252025-03-01T01:20:23.369ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "54970e20-ef9c-4099-bbc6-469611e480cf", "content-length": "26", "date": "Sat, 01 Mar 2025 01:20:23 GMT"} })
57262025-03-01T01:20:23.369ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1167 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
57272025-03-01T01:20:23.370ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66
57282025-03-01T01:20:23.378ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57292025-03-01T01:20:23.381ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
57302025-03-01T01:20:23.381ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
57312025-03-01T01:20:23.382ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
57322025-03-01T01:20:23.419ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
57332025-03-01T01:20:23.419ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 205.24387ms iteration = 12 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
57342025-03-01T01:20:23.424ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 209.508608ms iteration = 13 status = {"physical_disks_added":0}
57352025-03-01T01:20:23.437ZINFOnexus (BackgroundTasks): VPC route manager sled 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
57362025-03-01T01:20:23.437ZDEBGnexus (BackgroundTasks): client request SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
57372025-03-01T01:20:23.456ZDEBGnexus (BackgroundTasks): client response SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "1f9fb875-bb58-41cf-a94a-b05b89ba2844", "content-length": "372", "date": "Sat, 01 Mar 2025 01:20:23 GMT"} })
57382025-03-01T01:20:23.456ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
57392025-03-01T01:20:23.457ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
57402025-03-01T01:20:23.467ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 252.600875ms iteration = 12 status = null
57412025-03-01T01:20:23.482ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
57422025-03-01T01:20:23.482ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
57432025-03-01T01:20:23.509ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
57442025-03-01T01:20:23.509ZDEBGnexus (BackgroundTasks): client request SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
57452025-03-01T01:20:23.509ZDEBGnexus (BackgroundTasks): client response SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "99161905-a9f0-4d36-9074-2668754294ba", "date": "Sat, 01 Mar 2025 01:20:23 GMT"} })
57462025-03-01T01:20:23.509ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
57472025-03-01T01:20:23.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
57482025-03-01T01:20:23.511ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57492025-03-01T01:20:23.511ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
57502025-03-01T01:20:23.511ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57512025-03-01T01:20:23.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
57522025-03-01T01:20:23.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57532025-03-01T01:20:23.513ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
57542025-03-01T01:20:23.513ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
57552025-03-01T01:20:23.513ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
57562025-03-01T01:20:23.514ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 7f9c3c14-58c5-473f-8692-6376be44401e, rack_id: 4854cb88-dfba-4609-8f9d-72aac08cef66, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(cb10d0c6-a704-4231-b148-4f9ae21a03f8) } rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 switch_location = Switch0
57572025-03-01T01:20:23.514ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57582025-03-01T01:20:23.514ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57592025-03-01T01:20:23.515ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
57602025-03-01T01:20:23.515ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
57612025-03-01T01:20:23.521ZINFOnexus (BackgroundTasks): VPC route manager sled 3471264f-127e-4a25-bc10-2e8249e8d70a push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
57622025-03-01T01:20:23.521ZDEBGnexus (BackgroundTasks): client request SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
57632025-03-01T01:20:23.521ZDEBGnexus (BackgroundTasks): client response SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "42048e6c-269a-4086-9dc5-1133859e1e06", "date": "Sat, 01 Mar 2025 01:20:23 GMT"} })
57642025-03-01T01:20:23.523ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 308.673938ms iteration = 12 status = {}
57652025-03-01T01:20:23.529ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
57662025-03-01T01:20:23.529ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "fb77d160-b60d-48e1-9c88-2f19bc2aaa6c", "content-length": "134", "date": "Sat, 01 Mar 2025 01:20:23 GMT"} })
57672025-03-01T01:20:23.529ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
57682025-03-01T01:20:23.529ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = cb10d0c6-a704-4231-b148-4f9ae21a03f8
57692025-03-01T01:20:23.529ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
57702025-03-01T01:20:23.529ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
57712025-03-01T01:20:23.529ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
57722025-03-01T01:20:23.529ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
57732025-03-01T01:20:23.529ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
57742025-03-01T01:20:23.529ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
57752025-03-01T01:20:23.530ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
57762025-03-01T01:20:23.530ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
57772025-03-01T01:20:23.530ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66
57782025-03-01T01:20:23.530ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57792025-03-01T01:20:23.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57802025-03-01T01:20:23.532ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
57812025-03-01T01:20:23.532ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "df0f269f-d8f4-4f85-8909-b6919a6f4bea", "content-length": "2", "date": "Sat, 01 Mar 2025 01:20:23 GMT"} })
57822025-03-01T01:20:23.532ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
57832025-03-01T01:20:23.532ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "17c6def7-0c47-41ea-9e8a-99c43acc173d", "content-length": "52", "date": "Sat, 01 Mar 2025 01:20:23 GMT"} })
57842025-03-01T01:20:23.532ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 switch_location = Switch0
57852025-03-01T01:20:23.533ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
57862025-03-01T01:20:23.543ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57872025-03-01T01:20:23.545ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
57882025-03-01T01:20:23.545ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
57892025-03-01T01:20:23.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
57902025-03-01T01:20:23.633ZDEBGnexus (BackgroundTasks): client request SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
57912025-03-01T01:20:23.638ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "21701e31-eb2c-44b7-8928-75f453eacb84", "date": "Sat, 01 Mar 2025 01:20:23 GMT"} })
57922025-03-01T01:20:23.638ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 switch = Switch0
57932025-03-01T01:20:23.638ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
57942025-03-01T01:20:23.638ZDEBGnexus (BackgroundTasks): client response SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "cf6f182a-ea51-46c7-9660-d1d26bc54c45", "content-length": "691", "date": "Sat, 01 Mar 2025 01:20:23 GMT"} })
57952025-03-01T01:20:23.638ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
57962025-03-01T01:20:23.638ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
57972025-03-01T01:20:23.638ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
57982025-03-01T01:20:23.638ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "b7502c45-a2b4-4bbc-a949-8030fda33e34", "content-length": "682", "date": "Sat, 01 Mar 2025 01:20:23 GMT"} })
57992025-03-01T01:20:23.638ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58002025-03-01T01:20:23.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58012025-03-01T01:20:23.640ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 425.670011ms iteration = 12 status = {}
58022025-03-01T01:20:23.645ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58032025-03-01T01:20:23.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58042025-03-01T01:20:23.649ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58052025-03-01T01:20:23.649ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58062025-03-01T01:20:23.651ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58072025-03-01T01:20:23.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58082025-03-01T01:20:23.657ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 443.172638ms iteration = 12 status = {}
58092025-03-01T01:20:23.830ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = ad0e5e47-416b-4ccd-bb94-99c1d35be00d roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
58102025-03-01T01:20:23.831ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = ad0e5e47-416b-4ccd-bb94-99c1d35be00d resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
58112025-03-01T01:20:23.832ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2389 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = ad0e5e47-416b-4ccd-bb94-99c1d35be00d response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
58122025-03-01T01:20:24.850ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = f95a89d8-cfae-4094-a949-ee2f22680db6 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
58132025-03-01T01:20:24.850ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = f95a89d8-cfae-4094-a949-ee2f22680db6 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
58142025-03-01T01:20:24.853ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2511 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = f95a89d8-cfae-4094-a949-ee2f22680db6 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
58152025-03-01T01:20:25.872ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = faefc1b4-98c3-47ca-b0a6-62aab248d46d roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
58162025-03-01T01:20:25.872ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = faefc1b4-98c3-47ca-b0a6-62aab248d46d resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
58172025-03-01T01:20:25.874ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2102 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = faefc1b4-98c3-47ca-b0a6-62aab248d46d response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
58182025-03-01T01:20:26.893ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = e6f4939e-71d2-40c2-be2b-9ea9d780e1a7 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
58192025-03-01T01:20:26.893ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = e6f4939e-71d2-40c2-be2b-9ea9d780e1a7 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
58202025-03-01T01:20:26.895ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2075 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = e6f4939e-71d2-40c2-be2b-9ea9d780e1a7 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
58212025-03-01T01:20:27.414ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 316 local_addr = [fd00:1122:3344:101::c]:34357 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = 6aa029ec-7032-44c8-9ee4-e38d4823e8f6 response_code = 200 uri = /67b03f4e-4cbd-4843-9cd9-647f610abcfc
58222025-03-01T01:20:27.915ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 2f21c485-9c5b-4491-ad81-e7d6b66c5ae6 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
58232025-03-01T01:20:27.915ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 2f21c485-9c5b-4491-ad81-e7d6b66c5ae6 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
58242025-03-01T01:20:27.917ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1897 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 2f21c485-9c5b-4491-ad81-e7d6b66c5ae6 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
58252025-03-01T01:20:28.936ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = b0b234b7-5139-4034-8192-1fbb02ec8d7f roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
58262025-03-01T01:20:28.937ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = b0b234b7-5139-4034-8192-1fbb02ec8d7f resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
58272025-03-01T01:20:28.939ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2298 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = b0b234b7-5139-4034-8192-1fbb02ec8d7f response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
58282025-03-01T01:20:29.958ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = bff28553-b58e-4026-8790-743f4b98a2ba roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
58292025-03-01T01:20:29.959ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = bff28553-b58e-4026-8790-743f4b98a2ba resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
58302025-03-01T01:20:29.961ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2176 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = bff28553-b58e-4026-8790-743f4b98a2ba response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
58312025-03-01T01:20:30.979ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 0d01bc45-6f2e-4ac4-a8fb-00c34d998e09 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
58322025-03-01T01:20:30.979ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 0d01bc45-6f2e-4ac4-a8fb-00c34d998e09 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
58332025-03-01T01:20:30.981ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2377 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 0d01bc45-6f2e-4ac4-a8fb-00c34d998e09 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
58342025-03-01T01:20:32.002ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = d1cbfad5-56c4-419f-b01f-def8bf298c12 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
58352025-03-01T01:20:32.002ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = d1cbfad5-56c4-419f-b01f-def8bf298c12 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
58362025-03-01T01:20:32.003ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1543 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = d1cbfad5-56c4-419f-b01f-def8bf298c12 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
58372025-03-01T01:20:33.023ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = cc8b9ecf-2c81-424b-9ad2-2cbef387497c roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
58382025-03-01T01:20:33.024ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = cc8b9ecf-2c81-424b-9ad2-2cbef387497c resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
58392025-03-01T01:20:33.025ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2147 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = cc8b9ecf-2c81-424b-9ad2-2cbef387497c response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
58402025-03-01T01:20:33.214ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 35 reason = Timeout
58412025-03-01T01:20:33.214ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 35 reason = Timeout
58422025-03-01T01:20:33.215ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58432025-03-01T01:20:33.215ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
58442025-03-01T01:20:33.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
58452025-03-01T01:20:33.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58462025-03-01T01:20:33.217ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58472025-03-01T01:20:33.220ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
58482025-03-01T01:20:33.220ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58492025-03-01T01:20:33.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58502025-03-01T01:20:33.223ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58512025-03-01T01:20:33.223ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58522025-03-01T01:20:33.225ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58532025-03-01T01:20:33.227ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7, lookup_type: ById(8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7) } result = Ok(())
58542025-03-01T01:20:33.227ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58552025-03-01T01:20:33.228ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58562025-03-01T01:20:33.240ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 original_time_created = 2025-03-01 01:14:50.436545 UTC target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 time_created = 2025-03-01 01:14:50.436545 UTC
58572025-03-01T01:20:33.240ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 25.312516ms iteration = 35 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7","time_created":"2025-03-01T01:14:50.436545Z"}
58582025-03-01T01:20:33.250ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
58592025-03-01T01:20:33.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
58602025-03-01T01:20:33.278ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 63.738348ms iteration = 35 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
58612025-03-01T01:20:34.045ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 49fcf7c3-4466-4842-96ad-67e3008b5fac roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
58622025-03-01T01:20:34.046ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 49fcf7c3-4466-4842-96ad-67e3008b5fac resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
58632025-03-01T01:20:34.048ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2632 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 49fcf7c3-4466-4842-96ad-67e3008b5fac response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
58642025-03-01T01:20:35.068ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = b33b7616-bd4e-4ffc-8d47-abb8d031a516 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
58652025-03-01T01:20:35.068ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = b33b7616-bd4e-4ffc-8d47-abb8d031a516 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
58662025-03-01T01:20:35.070ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2428 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = b33b7616-bd4e-4ffc-8d47-abb8d031a516 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
58672025-03-01T01:20:36.090ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = a2c781c3-10a6-43b2-8290-8c3c0e34613a roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
58682025-03-01T01:20:36.090ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = a2c781c3-10a6-43b2-8290-8c3c0e34613a resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
58692025-03-01T01:20:36.092ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2335 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = a2c781c3-10a6-43b2-8290-8c3c0e34613a response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
58702025-03-01T01:20:37.113ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = f44d9bc2-36c1-4a54-bc47-f6b7b30aee0a roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
58712025-03-01T01:20:37.113ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = f44d9bc2-36c1-4a54-bc47-f6b7b30aee0a resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
58722025-03-01T01:20:37.115ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2117 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = f44d9bc2-36c1-4a54-bc47-f6b7b30aee0a response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
58732025-03-01T01:20:37.414ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 319 local_addr = [fd00:1122:3344:101::c]:34357 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = 25cdec17-a4dd-4a07-b5f6-5a8ae4208c43 response_code = 200 uri = /67b03f4e-4cbd-4843-9cd9-647f610abcfc
58742025-03-01T01:20:38.134ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 5dfb1b97-6b27-42a1-a8fc-3a98eb63427b roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
58752025-03-01T01:20:38.134ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 5dfb1b97-6b27-42a1-a8fc-3a98eb63427b resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
58762025-03-01T01:20:38.136ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2259 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 5dfb1b97-6b27-42a1-a8fc-3a98eb63427b response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
58772025-03-01T01:20:39.157ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 6dba99d3-93fb-43d5-9e5f-560bfd15c56c roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
58782025-03-01T01:20:39.157ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 6dba99d3-93fb-43d5-9e5f-560bfd15c56c resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
58792025-03-01T01:20:39.159ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2269 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 6dba99d3-93fb-43d5-9e5f-560bfd15c56c response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
58802025-03-01T01:20:40.181ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c043f07b-2790-4a3d-9771-f02593cd063f roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
58812025-03-01T01:20:40.181ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c043f07b-2790-4a3d-9771-f02593cd063f resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
58822025-03-01T01:20:40.183ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2025 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c043f07b-2790-4a3d-9771-f02593cd063f response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
58832025-03-01T01:20:41.202ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 419fe953-6b79-4fc5-8af5-a20aa75f51ca roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
58842025-03-01T01:20:41.203ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 419fe953-6b79-4fc5-8af5-a20aa75f51ca resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
58852025-03-01T01:20:41.204ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2104 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 419fe953-6b79-4fc5-8af5-a20aa75f51ca response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
58862025-03-01T01:20:42.225ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 5dd66d30-066a-4a38-9264-6e86f4c64de0 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
58872025-03-01T01:20:42.225ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 5dd66d30-066a-4a38-9264-6e86f4c64de0 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
58882025-03-01T01:20:42.227ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2572 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 5dd66d30-066a-4a38-9264-6e86f4c64de0 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
58892025-03-01T01:20:43.215ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 36 reason = Timeout
58902025-03-01T01:20:43.215ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 36 reason = Timeout
58912025-03-01T01:20:43.215ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58922025-03-01T01:20:43.215ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
58932025-03-01T01:20:43.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58942025-03-01T01:20:43.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
58952025-03-01T01:20:43.217ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58962025-03-01T01:20:43.219ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
58972025-03-01T01:20:43.219ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58982025-03-01T01:20:43.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58992025-03-01T01:20:43.220ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59002025-03-01T01:20:43.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59012025-03-01T01:20:43.222ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59022025-03-01T01:20:43.225ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7, lookup_type: ById(8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7) } result = Ok(())
59032025-03-01T01:20:43.225ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59042025-03-01T01:20:43.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59052025-03-01T01:20:43.234ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 original_time_created = 2025-03-01 01:14:50.436545 UTC target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 time_created = 2025-03-01 01:14:50.436545 UTC
59062025-03-01T01:20:43.234ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.697551ms iteration = 36 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7","time_created":"2025-03-01T01:14:50.436545Z"}
59072025-03-01T01:20:43.244ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
59082025-03-01T01:20:43.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
59092025-03-01T01:20:43.245ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.612924ms iteration = 36 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
59102025-03-01T01:20:43.247ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = d1749095-e4ed-4eb7-b330-7914cad4ae55 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
59112025-03-01T01:20:43.247ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = d1749095-e4ed-4eb7-b330-7914cad4ae55 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
59122025-03-01T01:20:43.249ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1664 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = d1749095-e4ed-4eb7-b330-7914cad4ae55 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
59132025-03-01T01:20:44.270ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 492e0861-5951-47ac-8714-d7767ee41d28 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
59142025-03-01T01:20:44.270ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 492e0861-5951-47ac-8714-d7767ee41d28 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
59152025-03-01T01:20:44.272ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2126 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 492e0861-5951-47ac-8714-d7767ee41d28 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
59162025-03-01T01:20:45.293ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 863b4c6d-dbed-4c4f-9762-ffd040cbaf1b roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
59172025-03-01T01:20:45.293ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 863b4c6d-dbed-4c4f-9762-ffd040cbaf1b resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
59182025-03-01T01:20:45.294ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1891 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 863b4c6d-dbed-4c4f-9762-ffd040cbaf1b response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
59192025-03-01T01:20:46.314ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 84cdd35a-b697-4c11-a43b-9d2b7ceb3ba9 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
59202025-03-01T01:20:46.314ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 84cdd35a-b697-4c11-a43b-9d2b7ceb3ba9 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
59212025-03-01T01:20:46.316ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2441 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 84cdd35a-b697-4c11-a43b-9d2b7ceb3ba9 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
59222025-03-01T01:20:47.336ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = f9c9dd95-30cf-4c86-9957-0ef077435375 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
59232025-03-01T01:20:47.336ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = f9c9dd95-30cf-4c86-9957-0ef077435375 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
59242025-03-01T01:20:47.338ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1868 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = f9c9dd95-30cf-4c86-9957-0ef077435375 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
59252025-03-01T01:20:47.414ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 313 local_addr = [fd00:1122:3344:101::c]:34357 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = 9bac18d0-bd2f-4613-9943-31a2fc90071f response_code = 200 uri = /67b03f4e-4cbd-4843-9cd9-647f610abcfc
59262025-03-01T01:20:48.359ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 2e2de2d0-d8d2-40ac-8c27-64523f26d523 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
59272025-03-01T01:20:48.359ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 2e2de2d0-d8d2-40ac-8c27-64523f26d523 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
59282025-03-01T01:20:48.361ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2146 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 2e2de2d0-d8d2-40ac-8c27-64523f26d523 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
59292025-03-01T01:20:49.380ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 48eafee7-37a9-4c65-acc1-0ea54ca2e456 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
59302025-03-01T01:20:49.381ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 48eafee7-37a9-4c65-acc1-0ea54ca2e456 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
59312025-03-01T01:20:49.382ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2244 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 48eafee7-37a9-4c65-acc1-0ea54ca2e456 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
59322025-03-01T01:20:50.402ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 5fde1983-d22d-4f9e-9646-99817cf4530b roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
59332025-03-01T01:20:50.402ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 5fde1983-d22d-4f9e-9646-99817cf4530b resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
59342025-03-01T01:20:50.403ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1900 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 5fde1983-d22d-4f9e-9646-99817cf4530b response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
59352025-03-01T01:20:51.424ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = fe20fb6d-bd22-46a3-8a54-17fe152d5a88 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
59362025-03-01T01:20:51.424ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = fe20fb6d-bd22-46a3-8a54-17fe152d5a88 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
59372025-03-01T01:20:51.425ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1928 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = fe20fb6d-bd22-46a3-8a54-17fe152d5a88 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
59382025-03-01T01:20:52.407ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61177 req_id = d73c306e-9dbf-43f1-931d-877d97c7f3ba roles = RoleSet { roles: {} } uri = /metrics/collectors/d77aa5d6-e6f9-4845-b1d4-57f91a3621e6/producers?sort_by=id_ascending
59392025-03-01T01:20:52.407ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61177 req_id = d73c306e-9dbf-43f1-931d-877d97c7f3ba resource = Database result = Ok(()) uri = /metrics/collectors/d77aa5d6-e6f9-4845-b1d4-57f91a3621e6/producers?sort_by=id_ascending
59402025-03-01T01:20:52.409ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2463 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61177 req_id = d73c306e-9dbf-43f1-931d-877d97c7f3ba response_code = 200 uri = /metrics/collectors/d77aa5d6-e6f9-4845-b1d4-57f91a3621e6/producers?sort_by=id_ascending
59412025-03-01T01:20:52.410ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61177 req_id = 57fcbbd9-886d-4349-b9cd-6a4c71d53cdc roles = RoleSet { roles: {} } uri = /metrics/collectors/d77aa5d6-e6f9-4845-b1d4-57f91a3621e6/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYmI0ODUwMS0zYzRlLTRkNDQtODgyMy1mOTc1ZTg2OTFmZmYifX0%3D
59422025-03-01T01:20:52.410ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61177 req_id = 57fcbbd9-886d-4349-b9cd-6a4c71d53cdc resource = Database result = Ok(()) uri = /metrics/collectors/d77aa5d6-e6f9-4845-b1d4-57f91a3621e6/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYmI0ODUwMS0zYzRlLTRkNDQtODgyMy1mOTc1ZTg2OTFmZmYifX0%3D
59432025-03-01T01:20:52.412ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2451 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61177 req_id = 57fcbbd9-886d-4349-b9cd-6a4c71d53cdc response_code = 200 uri = /metrics/collectors/d77aa5d6-e6f9-4845-b1d4-57f91a3621e6/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYmI0ODUwMS0zYzRlLTRkNDQtODgyMy1mOTc1ZTg2OTFmZmYifX0%3D
59442025-03-01T01:20:52.446ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 752224e3-5e0e-4747-8b6e-40a4280f28a8 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
59452025-03-01T01:20:52.447ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 752224e3-5e0e-4747-8b6e-40a4280f28a8 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
59462025-03-01T01:20:52.448ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2209 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 752224e3-5e0e-4747-8b6e-40a4280f28a8 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
59472025-03-01T01:20:53.215ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 9 reason = Timeout
59482025-03-01T01:20:53.215ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 13 reason = Timeout
59492025-03-01T01:20:53.215ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
59502025-03-01T01:20:53.215ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 13 reason = Timeout
59512025-03-01T01:20:53.215ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 8 reason = Timeout
59522025-03-01T01:20:53.215ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7
59532025-03-01T01:20:53.215ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 13 reason = Timeout
59542025-03-01T01:20:53.215ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 14.08\u{b5}s iteration = 8 status = {"enabled":false,"target_id":"8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7"}
59552025-03-01T01:20:53.215ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59562025-03-01T01:20:53.215ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
59572025-03-01T01:20:53.215ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 37 reason = Timeout
59582025-03-01T01:20:53.215ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
59592025-03-01T01:20:53.215ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 13 reason = Timeout
59602025-03-01T01:20:53.215ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59612025-03-01T01:20:53.215ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
59622025-03-01T01:20:53.215ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 7 reason = Timeout
59632025-03-01T01:20:53.215ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 7 reason = Timeout
59642025-03-01T01:20:53.215ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
59652025-03-01T01:20:53.215ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
59662025-03-01T01:20:53.215ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 7 reason = Timeout
59672025-03-01T01:20:53.215ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 7 reason = Timeout
59682025-03-01T01:20:53.215ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
59692025-03-01T01:20:53.215ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 13 reason = Timeout
59702025-03-01T01:20:53.215ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
59712025-03-01T01:20:53.215ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 7 reason = Timeout
59722025-03-01T01:20:53.215ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-03-01 01:10:53.215182841 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
59732025-03-01T01:20:53.215ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 13 reason = Timeout
59742025-03-01T01:20:53.215ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
59752025-03-01T01:20:53.215ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 9 reason = Timeout
59762025-03-01T01:20:53.215ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
59772025-03-01T01:20:53.215ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 7 reason = Timeout
59782025-03-01T01:20:53.215ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
59792025-03-01T01:20:53.215ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 13 reason = Timeout
59802025-03-01T01:20:53.215ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
59812025-03-01T01:20:53.215ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 7 reason = Timeout
59822025-03-01T01:20:53.215ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
59832025-03-01T01:20:53.215ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 7 reason = Timeout
59842025-03-01T01:20:53.215ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
59852025-03-01T01:20:53.215ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
59862025-03-01T01:20:53.215ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 14 reason = Timeout
59872025-03-01T01:20:53.215ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
59882025-03-01T01:20:53.215ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 13 reason = Timeout
59892025-03-01T01:20:53.215ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
59902025-03-01T01:20:53.215ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 13 reason = Timeout
59912025-03-01T01:20:53.215ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
59922025-03-01T01:20:53.215ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
59932025-03-01T01:20:53.215ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 37 reason = Timeout
59942025-03-01T01:20:53.215ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
59952025-03-01T01:20:53.215ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 13 reason = Timeout
59962025-03-01T01:20:53.215ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
59972025-03-01T01:20:53.215ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 13 reason = Timeout
59982025-03-01T01:20:53.215ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
59992025-03-01T01:20:53.215ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 13 reason = Timeout
60002025-03-01T01:20:53.215ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
60012025-03-01T01:20:53.215ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 4 reason = Timeout
60022025-03-01T01:20:53.215ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 13 reason = Timeout
60032025-03-01T01:20:53.215ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
60042025-03-01T01:20:53.215ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
60052025-03-01T01:20:53.215ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 13 reason = Timeout
60062025-03-01T01:20:53.215ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 7 reason = Timeout
60072025-03-01T01:20:53.215ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
60082025-03-01T01:20:53.215ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 7 reason = Timeout
60092025-03-01T01:20:53.215ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 13 reason = Timeout
60102025-03-01T01:20:53.215ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
60112025-03-01T01:20:53.215ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
60122025-03-01T01:20:53.215ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
60132025-03-01T01:20:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
60142025-03-01T01:20:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
60152025-03-01T01:20:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
60162025-03-01T01:20:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60172025-03-01T01:20:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60182025-03-01T01:20:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
60192025-03-01T01:20:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
60202025-03-01T01:20:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
60212025-03-01T01:20:53.215ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("3a9b8294-d9f3-4130-a669-e74c6f1f65a0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("450e8d93-9ed3-4721-9fe9-42521f60bc93.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a4f72c78-99c6-478d-b490-f7d8793d4173.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("a4f72c78-99c6-478d-b490-f7d8793d4173.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1263, tv_nsec: 903512779 } })
60222025-03-01T01:20:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
60232025-03-01T01:20:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
60242025-03-01T01:20:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
60252025-03-01T01:20:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
60262025-03-01T01:20:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
60272025-03-01T01:20:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
60282025-03-01T01:20:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
60292025-03-01T01:20:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
60302025-03-01T01:20:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
60312025-03-01T01:20:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
60322025-03-01T01:20:53.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
60332025-03-01T01:20:53.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
60342025-03-01T01:20:53.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
60352025-03-01T01:20:53.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
60362025-03-01T01:20:53.216ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2e37f4af-57dc-468e-80e3-cf2aea2ffdc8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5f6eb3bd-0126-40e0-98ef-ee33df084158.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("5f6eb3bd-0126-40e0-98ef-ee33df084158.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1263, tv_nsec: 903652962 } })
60372025-03-01T01:20:53.216ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
60382025-03-01T01:20:53.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
60392025-03-01T01:20:53.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
60402025-03-01T01:20:53.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
60412025-03-01T01:20:53.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
60422025-03-01T01:20:53.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
60432025-03-01T01:20:53.216ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
60442025-03-01T01:20:53.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
60452025-03-01T01:20:53.216ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
60462025-03-01T01:20:53.216ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
60472025-03-01T01:20:53.216ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.300167ms iteration = 7 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
60482025-03-01T01:20:53.216ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
60492025-03-01T01:20:53.216ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.345198ms iteration = 7 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
60502025-03-01T01:20:53.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
60512025-03-01T01:20:53.216ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
60522025-03-01T01:20:53.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
60532025-03-01T01:20:53.218ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60542025-03-01T01:20:53.218ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1263, tv_nsec: 906479509 } })
60552025-03-01T01:20:53.218ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60562025-03-01T01:20:53.219ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1154
60572025-03-01T01:20:53.219ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60582025-03-01T01:20:53.219ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.795407ms iteration = 13 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
60592025-03-01T01:20:53.220ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
60602025-03-01T01:20:53.220ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60612025-03-01T01:20:53.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60622025-03-01T01:20:53.221ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
60632025-03-01T01:20:53.221ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
60642025-03-01T01:20:53.221ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
60652025-03-01T01:20:53.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
60662025-03-01T01:20:53.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
60672025-03-01T01:20:53.221ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
60682025-03-01T01:20:53.221ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
60692025-03-01T01:20:53.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
60702025-03-01T01:20:53.222ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
60712025-03-01T01:20:53.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
60722025-03-01T01:20:53.223ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 8.323289ms iteration = 7 status = {"errors":[],"found_port_ok":[]}
60732025-03-01T01:20:53.225ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-03-01 01:10:53.215182841 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
60742025-03-01T01:20:53.225ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 10.155867ms iteration = 7 status = {"expiration":"2025-03-01T01:10:53.215182841Z","pruned":[]}
60752025-03-01T01:20:53.225ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60762025-03-01T01:20:53.227ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60772025-03-01T01:20:53.227ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
60782025-03-01T01:20:53.228ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
60792025-03-01T01:20:53.228ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
60802025-03-01T01:20:53.228ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
60812025-03-01T01:20:53.228ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
60822025-03-01T01:20:53.230ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
60832025-03-01T01:20:53.230ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
60842025-03-01T01:20:53.231ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
60852025-03-01T01:20:53.232ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60862025-03-01T01:20:53.233ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1263, tv_nsec: 920884083 } })
60872025-03-01T01:20:53.233ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1154
60882025-03-01T01:20:53.234ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
60892025-03-01T01:20:53.234ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
60902025-03-01T01:20:53.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
60912025-03-01T01:20:53.238ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60922025-03-01T01:20:53.241ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
60932025-03-01T01:20:53.242ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
60942025-03-01T01:20:53.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
60952025-03-01T01:20:53.251ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1263, tv_nsec: 938655135 } })
60962025-03-01T01:20:53.251ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1154 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66
60972025-03-01T01:20:53.261ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60982025-03-01T01:20:53.264ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 48.849886ms iteration = 13 status = {"errors":[],"garbage_collect_requested":[]}
60992025-03-01T01:20:53.265ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
61002025-03-01T01:20:53.265ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61012025-03-01T01:20:53.265ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61022025-03-01T01:20:53.267ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
61032025-03-01T01:20:53.267ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
61042025-03-01T01:20:53.267ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
61052025-03-01T01:20:53.267ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
61062025-03-01T01:20:53.267ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 52.596241ms iteration = 13 status = {"errors":[],"finish_invoked_ok":[]}
61072025-03-01T01:20:53.267ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61082025-03-01T01:20:53.268ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61092025-03-01T01:20:53.270ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
61102025-03-01T01:20:53.270ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
61112025-03-01T01:20:53.270ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
61122025-03-01T01:20:53.270ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
61132025-03-01T01:20:53.270ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
61142025-03-01T01:20:53.273ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
61152025-03-01T01:20:53.273ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
61162025-03-01T01:20:53.273ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 58.462931ms iteration = 7 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
61172025-03-01T01:20:53.275ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 60.197347ms iteration = 37 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
61182025-03-01T01:20:53.276ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
61192025-03-01T01:20:53.277ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
61202025-03-01T01:20:53.277ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
61212025-03-01T01:20:53.277ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61222025-03-01T01:20:53.278ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
61232025-03-01T01:20:53.279ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
61242025-03-01T01:20:53.279ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
61252025-03-01T01:20:53.279ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
61262025-03-01T01:20:53.279ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61272025-03-01T01:20:53.280ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61282025-03-01T01:20:53.280ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
61292025-03-01T01:20:53.280ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
61302025-03-01T01:20:53.280ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
61312025-03-01T01:20:53.280ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61322025-03-01T01:20:53.283ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
61332025-03-01T01:20:53.283ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
61342025-03-01T01:20:53.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
61352025-03-01T01:20:53.285ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61362025-03-01T01:20:53.285ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61372025-03-01T01:20:53.285ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
61382025-03-01T01:20:53.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
61392025-03-01T01:20:53.288ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
61402025-03-01T01:20:53.288ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
61412025-03-01T01:20:53.288ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
61422025-03-01T01:20:53.289ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
61432025-03-01T01:20:53.289ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
61442025-03-01T01:20:53.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
61452025-03-01T01:20:53.290ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61462025-03-01T01:20:53.293ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
61472025-03-01T01:20:53.293ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
61482025-03-01T01:20:53.293ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
61492025-03-01T01:20:53.293ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61502025-03-01T01:20:53.293ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
61512025-03-01T01:20:53.293ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
61522025-03-01T01:20:53.296ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
61532025-03-01T01:20:53.296ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
61542025-03-01T01:20:53.296ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
61552025-03-01T01:20:53.297ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61562025-03-01T01:20:53.297ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61572025-03-01T01:20:53.297ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61582025-03-01T01:20:53.300ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
61592025-03-01T01:20:53.300ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
61602025-03-01T01:20:53.300ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
61612025-03-01T01:20:53.300ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
61622025-03-01T01:20:53.300ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
61632025-03-01T01:20:53.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
61642025-03-01T01:20:53.301ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
61652025-03-01T01:20:53.303ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
61662025-03-01T01:20:53.303ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 87.943801ms iteration = 13 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
61672025-03-01T01:20:53.318ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
61682025-03-01T01:20:53.318ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
61692025-03-01T01:20:53.318ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
61702025-03-01T01:20:53.318ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
61712025-03-01T01:20:53.318ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
61722025-03-01T01:20:53.318ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
61732025-03-01T01:20:53.318ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
61742025-03-01T01:20:53.318ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
61752025-03-01T01:20:53.318ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
61762025-03-01T01:20:53.319ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 104.775415ms iteration = 13 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
61772025-03-01T01:20:53.323ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
61782025-03-01T01:20:53.323ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
61792025-03-01T01:20:53.337ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
61802025-03-01T01:20:53.337ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
61812025-03-01T01:20:53.337ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
61822025-03-01T01:20:53.337ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
61832025-03-01T01:20:53.337ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
61842025-03-01T01:20:53.357ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
61852025-03-01T01:20:53.374ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
61862025-03-01T01:20:53.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
61872025-03-01T01:20:53.383ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
61882025-03-01T01:20:53.383ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
61892025-03-01T01:20:53.383ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "af1e5c09-41f9-478c-90e4-cda390741bcb", "content-length": "26", "date": "Sat, 01 Mar 2025 01:20:53 GMT"} })
61902025-03-01T01:20:53.383ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
61912025-03-01T01:20:53.385ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
61922025-03-01T01:20:53.432ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
61932025-03-01T01:20:53.432ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
61942025-03-01T01:20:53.432ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9ed83d52-1089-45c0-b6b6-e67bbcc44b02", "content-length": "26", "date": "Sat, 01 Mar 2025 01:20:53 GMT"} })
61952025-03-01T01:20:53.432ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
61962025-03-01T01:20:53.434ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
61972025-03-01T01:20:53.467ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
61982025-03-01T01:20:53.468ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 2ebb1288-7911-47d0-8aeb-1745aa855e3d roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
61992025-03-01T01:20:53.469ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 2ebb1288-7911-47d0-8aeb-1745aa855e3d resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
62002025-03-01T01:20:53.538ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
62012025-03-01T01:20:53.580ZINFOnexus (BackgroundTasks): VPC route manager sled 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
62022025-03-01T01:20:53.580ZDEBGnexus (BackgroundTasks): client request SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
62032025-03-01T01:20:53.583ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62042025-03-01T01:20:53.586ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7, lookup_type: ById(8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7) } result = Ok(())
62052025-03-01T01:20:53.586ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62062025-03-01T01:20:53.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62072025-03-01T01:20:53.589ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 374.121611ms iteration = 4 status = {"nsuccess":5}
62082025-03-01T01:20:53.590ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1162 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 zone_address = fd00:1122:3344:101::2
62092025-03-01T01:20:53.590ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62102025-03-01T01:20:53.590ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
62112025-03-01T01:20:53.590ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e363e89c-5a9b-42e9-956c-6b6f6615982b", "content-length": "26", "date": "Sat, 01 Mar 2025 01:20:53 GMT"} })
62122025-03-01T01:20:53.590ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1167 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
62132025-03-01T01:20:53.592ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66
62142025-03-01T01:20:53.594ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
62152025-03-01T01:20:53.595ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
62162025-03-01T01:20:53.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
62172025-03-01T01:20:53.598ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 129268 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 2ebb1288-7911-47d0-8aeb-1745aa855e3d response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
62182025-03-01T01:20:53.604ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
62192025-03-01T01:20:53.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
62202025-03-01T01:20:53.605ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
62212025-03-01T01:20:53.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
62222025-03-01T01:20:53.606ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62232025-03-01T01:20:53.608ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 original_time_created = 2025-03-01 01:14:50.436545 UTC target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 time_created = 2025-03-01 01:14:50.436545 UTC
62242025-03-01T01:20:53.608ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 393.072617ms iteration = 37 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7","time_created":"2025-03-01T01:14:50.436545Z"}
62252025-03-01T01:20:53.608ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
62262025-03-01T01:20:53.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
62272025-03-01T01:20:53.609ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
62282025-03-01T01:20:53.609ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
62292025-03-01T01:20:53.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
62302025-03-01T01:20:53.614ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
62312025-03-01T01:20:53.615ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62322025-03-01T01:20:53.615ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 400.749204ms iteration = 13 status = {}
62332025-03-01T01:20:53.616ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "9ed2b155-b812-459b-95f8-39c80e56dcf4", "content-length": "2", "date": "Sat, 01 Mar 2025 01:20:52 GMT"} })
62342025-03-01T01:20:53.617ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
62352025-03-01T01:20:53.617ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
62362025-03-01T01:20:53.617ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
62372025-03-01T01:20:53.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
62382025-03-01T01:20:53.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
62392025-03-01T01:20:53.620ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 404.921819ms iteration = 13 status = null
62402025-03-01T01:20:53.624ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 408.877009ms iteration = 13 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
62412025-03-01T01:20:53.628ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62422025-03-01T01:20:53.631ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
62432025-03-01T01:20:53.631ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
62442025-03-01T01:20:53.631ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
62452025-03-01T01:20:53.631ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
62462025-03-01T01:20:53.632ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
62472025-03-01T01:20:53.632ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
62482025-03-01T01:20:53.632ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 417.023905ms iteration = 7 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
62492025-03-01T01:20:53.633ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62502025-03-01T01:20:53.633ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
62512025-03-01T01:20:53.633ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
62522025-03-01T01:20:53.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
62532025-03-01T01:20:53.635ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62542025-03-01T01:20:53.635ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
62552025-03-01T01:20:53.635ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
62562025-03-01T01:20:53.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
62572025-03-01T01:20:53.637ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
62582025-03-01T01:20:53.637ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
62592025-03-01T01:20:53.638ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
62602025-03-01T01:20:53.639ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
62612025-03-01T01:20:53.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
62622025-03-01T01:20:53.641ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
62632025-03-01T01:20:53.641ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
62642025-03-01T01:20:53.641ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 426.068959ms iteration = 13 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
62652025-03-01T01:20:53.645ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
62662025-03-01T01:20:53.645ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = cce65e3e-6c86-4cdd-98ad-9a38c98082e8 dns_zone_name = oxide.test found_so_far = 0 version = 2
62672025-03-01T01:20:53.645ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
62682025-03-01T01:20:53.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
62692025-03-01T01:20:53.653ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62702025-03-01T01:20:53.655ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 3471264f-127e-4a25-bc10-2e8249e8d70a, lookup_type: ById(3471264f-127e-4a25-bc10-2e8249e8d70a) } result = Ok(())
62712025-03-01T01:20:53.655ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
62722025-03-01T01:20:53.655ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
62732025-03-01T01:20:53.668ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
62742025-03-01T01:20:53.668ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "df0b6545-265a-43f2-9d1f-30d9a4b36b46", "date": "Sat, 01 Mar 2025 01:20:53 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
62752025-03-01T01:20:53.669ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
62762025-03-01T01:20:53.670ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "e08274e7-206c-4e43-ba53-fe42f5aa3982", "date": "Sat, 01 Mar 2025 01:20:53 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
62772025-03-01T01:20:53.670ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
62782025-03-01T01:20:53.672ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "bf5f681d-4b77-4c70-892c-6fbd3b674552", "date": "Sat, 01 Mar 2025 01:20:53 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
62792025-03-01T01:20:53.672ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
62802025-03-01T01:20:53.674ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
62812025-03-01T01:20:53.674ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 459.264696ms iteration = 9 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
62822025-03-01T01:20:53.677ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
62832025-03-01T01:20:53.680ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "e4293292-5205-4fbb-b192-4e6c650b35ef", "date": "Sat, 01 Mar 2025 01:20:53 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
62842025-03-01T01:20:53.680ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
62852025-03-01T01:20:53.682ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "e36b4099-7545-48c4-a14a-b110316cda36", "date": "Sat, 01 Mar 2025 01:20:53 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
62862025-03-01T01:20:53.682ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
62872025-03-01T01:20:53.683ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
62882025-03-01T01:20:53.683ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 468.670687ms iteration = 9 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
62892025-03-01T01:20:53.693ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 478.147161ms iteration = 14 status = {"physical_disks_added":0}
62902025-03-01T01:20:53.697ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
62912025-03-01T01:20:53.697ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 482.113411ms iteration = 7 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
62922025-03-01T01:20:53.700ZDEBGnexus (BackgroundTasks): client response SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "bf9cb328-bb1a-441b-ac3a-ebee8c0285e3", "content-length": "372", "date": "Sat, 01 Mar 2025 01:20:53 GMT"} })
62932025-03-01T01:20:53.700ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62942025-03-01T01:20:53.700ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62952025-03-01T01:20:53.781ZDEBGnexus (BackgroundTasks): client request SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
62962025-03-01T01:20:53.782ZDEBGnexus (BackgroundTasks): client response SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "80fe476c-8f88-4cb5-b7fb-23f0bddfa321", "content-length": "691", "date": "Sat, 01 Mar 2025 01:20:53 GMT"} })
62972025-03-01T01:20:53.782ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
62982025-03-01T01:20:53.782ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
62992025-03-01T01:20:53.782ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
63002025-03-01T01:20:53.783ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
63012025-03-01T01:20:53.783ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 568.283566ms iteration = 13 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
63022025-03-01T01:20:53.783ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 568.267696ms iteration = 13 status = {}
63032025-03-01T01:20:53.784ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63042025-03-01T01:20:53.785ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 570.342828ms iteration = 13 status = 0
63052025-03-01T01:20:53.787ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
63062025-03-01T01:20:53.787ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
63072025-03-01T01:20:53.787ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
63082025-03-01T01:20:53.789ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = cce65e3e-6c86-4cdd-98ad-9a38c98082e8 dns_zone_name = oxide.test found_so_far = 1 version = 2
63092025-03-01T01:20:53.789ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
63102025-03-01T01:20:53.789ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-03-01 01:14:54.679503 UTC dns_group = external generation = 2
63112025-03-01T01:20:53.789ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 574.165926ms iteration = 7 status = {"generation":2}
63122025-03-01T01:20:53.813ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
63132025-03-01T01:20:53.813ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 0a9e4b5c-53a1-4f0a-8849-98a8b1852af3 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
63142025-03-01T01:20:53.813ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
63152025-03-01T01:20:53.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
63162025-03-01T01:20:53.813ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 598.43664ms iteration = 13 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
63172025-03-01T01:20:53.814ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63182025-03-01T01:20:53.817ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-03-01T01:14:49.537343Z, time_modified: 2025-03-01T01:14:49.537343Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 1682a303-6254-452b-b4cf-160ed9dc3fc9, db_silo: Silo { identity: SiloIdentity { id: 1682a303-6254-452b-b4cf-160ed9dc3fc9, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-03-01T01:14:54.631650Z, time_modified: 2025-03-01T01:14:54.631650Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "851c0b739689cfb98a2e401e6047fa98e9fcc283d9fc3f660bd69842a9c06be9" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 1682a303-6254-452b-b4cf-160ed9dc3fc9, db_silo: Silo { identity: SiloIdentity { id: 1682a303-6254-452b-b4cf-160ed9dc3fc9, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-03-01T01:14:54.631650Z, time_modified: 2025-03-01T01:14:54.631650Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "851c0b739689cfb98a2e401e6047fa98e9fcc283d9fc3f660bd69842a9c06be9" }] }) }
63192025-03-01T01:20:53.817ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 601.84783ms iteration = 7 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"1682a303-6254-452b-b4cf-160ed9dc3fc9","tls_certs":["851c0b739689cfb98a2e401e6047fa98e9fcc283d9fc3f660bd69842a9c06be9"]}},"default_endpoint":{"silo_id":"1682a303-6254-452b-b4cf-160ed9dc3fc9","tls_certs":["851c0b739689cfb98a2e401e6047fa98e9fcc283d9fc3f660bd69842a9c06be9"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
63202025-03-01T01:20:53.817ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
63212025-03-01T01:20:53.817ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
63222025-03-01T01:20:53.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
63232025-03-01T01:20:53.819ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 0a9e4b5c-53a1-4f0a-8849-98a8b1852af3 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
63242025-03-01T01:20:53.819ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
63252025-03-01T01:20:53.819ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-03-01 01:14:53.460216 UTC dns_group = internal generation = 1
63262025-03-01T01:20:53.819ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 604.760889ms iteration = 7 status = {"generation":1}
63272025-03-01T01:20:53.839ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
63282025-03-01T01:20:53.839ZDEBGnexus (BackgroundTasks): client request SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
63292025-03-01T01:20:53.839ZDEBGnexus (BackgroundTasks): client response SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "8d44f15b-a15b-4f0d-a2aa-43ab24d88607", "date": "Sat, 01 Mar 2025 01:20:53 GMT"} })
63302025-03-01T01:20:53.839ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
63312025-03-01T01:20:53.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
63322025-03-01T01:20:53.840ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63332025-03-01T01:20:53.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63342025-03-01T01:20:53.842ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
63352025-03-01T01:20:53.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
63362025-03-01T01:20:53.842ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 7f9c3c14-58c5-473f-8692-6376be44401e, rack_id: 4854cb88-dfba-4609-8f9d-72aac08cef66, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(cb10d0c6-a704-4231-b148-4f9ae21a03f8) } rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 switch_location = Switch0
63372025-03-01T01:20:53.842ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63382025-03-01T01:20:53.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63392025-03-01T01:20:53.845ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
63402025-03-01T01:20:53.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
63412025-03-01T01:20:53.848ZINFOnexus (BackgroundTasks): VPC route manager sled 3471264f-127e-4a25-bc10-2e8249e8d70a push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
63422025-03-01T01:20:53.848ZDEBGnexus (BackgroundTasks): client request SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
63432025-03-01T01:20:53.848ZDEBGnexus (BackgroundTasks): client response SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "5256b882-6e93-459f-95ad-30a96f780c44", "date": "Sat, 01 Mar 2025 01:20:53 GMT"} })
63442025-03-01T01:20:53.850ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 635.423664ms iteration = 13 status = {}
63452025-03-01T01:20:53.851ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
63462025-03-01T01:20:53.852ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "2476ce36-0fb4-464d-9239-86281c30b6b0", "content-length": "134", "date": "Sat, 01 Mar 2025 01:20:53 GMT"} })
63472025-03-01T01:20:53.852ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
63482025-03-01T01:20:53.852ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = cb10d0c6-a704-4231-b148-4f9ae21a03f8
63492025-03-01T01:20:53.852ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
63502025-03-01T01:20:53.852ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
63512025-03-01T01:20:53.852ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
63522025-03-01T01:20:53.852ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
63532025-03-01T01:20:53.852ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
63542025-03-01T01:20:53.852ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
63552025-03-01T01:20:53.852ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
63562025-03-01T01:20:53.852ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
63572025-03-01T01:20:53.852ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66
63582025-03-01T01:20:53.852ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63592025-03-01T01:20:53.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63602025-03-01T01:20:53.854ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
63612025-03-01T01:20:53.854ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "45552fb2-408c-4ff3-a20a-facc2bea8bd5", "content-length": "2", "date": "Sat, 01 Mar 2025 01:20:53 GMT"} })
63622025-03-01T01:20:53.854ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
63632025-03-01T01:20:53.855ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "106b739b-8390-46cd-8d77-70e9122a67a1", "content-length": "52", "date": "Sat, 01 Mar 2025 01:20:53 GMT"} })
63642025-03-01T01:20:53.855ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 switch_location = Switch0
63652025-03-01T01:20:53.855ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
63662025-03-01T01:20:53.914ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
63672025-03-01T01:20:53.914ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
63682025-03-01T01:20:53.944ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
63692025-03-01T01:20:53.944ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:49826
63702025-03-01T01:20:53.945ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:49826 req_id = 28d40f4c-bd68-40fa-b568-e3791f9fbc43 roles = RoleSet { roles: {} } uri = /metrics/producers
63712025-03-01T01:20:53.945ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:49826 req_id = 28d40f4c-bd68-40fa-b568-e3791f9fbc43 resource = Database result = Ok(()) uri = /metrics/producers
63722025-03-01T01:20:53.946ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "88faed9b-08bf-43c0-9a65-fe9f9727276e", "date": "Sat, 01 Mar 2025 01:20:53 GMT"} })
63732025-03-01T01:20:53.946ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 switch = Switch0
63742025-03-01T01:20:53.946ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
63752025-03-01T01:20:53.981ZINFOnexus: assigned collector to new producer collector_id = d77aa5d6-e6f9-4845-b1d4-57f91a3621e6 file = nexus/src/app/oximeter.rs:76 producer_id = 67b03f4e-4cbd-4843-9cd9-647f610abcfc
63762025-03-01T01:20:53.981ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 36727 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:49826 req_id = 28d40f4c-bd68-40fa-b568-e3791f9fbc43 response_code = 201 uri = /metrics/producers
63772025-03-01T01:20:53.981ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "28d40f4c-bd68-40fa-b568-e3791f9fbc43", "content-length": "41", "date": "Sat, 01 Mar 2025 01:20:53 GMT"} })
63782025-03-01T01:20:53.983ZDEBGnexus (producer-registration-task): registered with nexus successfully
63792025-03-01T01:20:53.983ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
63802025-03-01T01:20:54.037ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "e1104cc0-b6e9-498d-9d13-3bd151f8711b", "content-length": "682", "date": "Sat, 01 Mar 2025 01:20:53 GMT"} })
63812025-03-01T01:20:54.037ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63822025-03-01T01:20:54.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63832025-03-01T01:20:54.041ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63842025-03-01T01:20:54.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63852025-03-01T01:20:54.044ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63862025-03-01T01:20:54.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63872025-03-01T01:20:54.046ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63882025-03-01T01:20:54.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63892025-03-01T01:20:54.056ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 841.283837ms iteration = 13 status = {}
63902025-03-01T01:20:54.721ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = f7970a59-8b5c-449e-857d-0c53834fe52c roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
63912025-03-01T01:20:54.721ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = f7970a59-8b5c-449e-857d-0c53834fe52c resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
63922025-03-01T01:20:54.723ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2333 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = f7970a59-8b5c-449e-857d-0c53834fe52c response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
63932025-03-01T01:20:55.743ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 8564d389-1f60-4a39-b436-ae3ceaee5e3c roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
63942025-03-01T01:20:55.743ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 8564d389-1f60-4a39-b436-ae3ceaee5e3c resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
63952025-03-01T01:20:55.745ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1989 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 8564d389-1f60-4a39-b436-ae3ceaee5e3c response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
63962025-03-01T01:20:56.766ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c0f23796-c00e-45e6-90d8-787fad63c51e roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
63972025-03-01T01:20:56.766ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c0f23796-c00e-45e6-90d8-787fad63c51e resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
63982025-03-01T01:20:56.767ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1728 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c0f23796-c00e-45e6-90d8-787fad63c51e response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
63992025-03-01T01:20:57.414ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 336 local_addr = [fd00:1122:3344:101::c]:34357 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = 3ad6d23d-22ae-4ddc-8465-4f01b20e50b5 response_code = 200 uri = /67b03f4e-4cbd-4843-9cd9-647f610abcfc
64002025-03-01T01:20:57.787ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 25571818-f3f2-4c77-ac2b-a5e8552cc5c0 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
64012025-03-01T01:20:57.787ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 25571818-f3f2-4c77-ac2b-a5e8552cc5c0 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
64022025-03-01T01:20:57.790ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2703 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 25571818-f3f2-4c77-ac2b-a5e8552cc5c0 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
64032025-03-01T01:20:58.810ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 808e213a-8d77-4ebf-93b7-69854a8497ee roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
64042025-03-01T01:20:58.810ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 808e213a-8d77-4ebf-93b7-69854a8497ee resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
64052025-03-01T01:20:58.812ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2662 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 808e213a-8d77-4ebf-93b7-69854a8497ee response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
64062025-03-01T01:20:59.832ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 075226fe-d089-4e72-a8a0-ddd7648c167e roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
64072025-03-01T01:20:59.833ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 075226fe-d089-4e72-a8a0-ddd7648c167e resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
64082025-03-01T01:20:59.835ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2232 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 075226fe-d089-4e72-a8a0-ddd7648c167e response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
64092025-03-01T01:21:00.854ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 7b2fc3cd-3b41-4bbd-9208-d5acec56936b roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
64102025-03-01T01:21:00.855ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 7b2fc3cd-3b41-4bbd-9208-d5acec56936b resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
64112025-03-01T01:21:00.857ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2124 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 7b2fc3cd-3b41-4bbd-9208-d5acec56936b response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
64122025-03-01T01:21:01.877ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = b9ea2493-a278-4ce0-be42-2639eccc9cfa roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
64132025-03-01T01:21:01.878ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = b9ea2493-a278-4ce0-be42-2639eccc9cfa resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
64142025-03-01T01:21:01.879ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1903 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = b9ea2493-a278-4ce0-be42-2639eccc9cfa response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
64152025-03-01T01:21:02.900ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 1c02a95e-67dc-49d8-badc-4e93a90bc0c4 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
64162025-03-01T01:21:02.900ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 1c02a95e-67dc-49d8-badc-4e93a90bc0c4 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
64172025-03-01T01:21:02.902ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2535 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 1c02a95e-67dc-49d8-badc-4e93a90bc0c4 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
64182025-03-01T01:21:03.214ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 38 reason = Timeout
64192025-03-01T01:21:03.214ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 38 reason = Timeout
64202025-03-01T01:21:03.214ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
64212025-03-01T01:21:03.214ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64222025-03-01T01:21:03.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64232025-03-01T01:21:03.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
64242025-03-01T01:21:03.216ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64252025-03-01T01:21:03.219ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
64262025-03-01T01:21:03.219ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64272025-03-01T01:21:03.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64282025-03-01T01:21:03.220ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64292025-03-01T01:21:03.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64302025-03-01T01:21:03.221ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64312025-03-01T01:21:03.224ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7, lookup_type: ById(8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7) } result = Ok(())
64322025-03-01T01:21:03.224ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64332025-03-01T01:21:03.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64342025-03-01T01:21:03.238ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 original_time_created = 2025-03-01 01:14:50.436545 UTC target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 time_created = 2025-03-01 01:14:50.436545 UTC
64352025-03-01T01:21:03.238ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.193013ms iteration = 38 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7","time_created":"2025-03-01T01:14:50.436545Z"}
64362025-03-01T01:21:03.250ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
64372025-03-01T01:21:03.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
64382025-03-01T01:21:03.252ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 37.360591ms iteration = 38 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
64392025-03-01T01:21:03.924ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = f5073e83-22fb-4920-baff-6e3306b2543b roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
64402025-03-01T01:21:03.924ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = f5073e83-22fb-4920-baff-6e3306b2543b resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
64412025-03-01T01:21:03.926ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2335 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = f5073e83-22fb-4920-baff-6e3306b2543b response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
64422025-03-01T01:21:04.947ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 86bd6cec-d6dc-4d3b-86d2-df336f6a6e32 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
64432025-03-01T01:21:04.947ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 86bd6cec-d6dc-4d3b-86d2-df336f6a6e32 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
64442025-03-01T01:21:04.949ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1915 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 86bd6cec-d6dc-4d3b-86d2-df336f6a6e32 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
64452025-03-01T01:21:05.970ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = ac2fcc79-8258-493a-ae7a-8646c52659c8 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
64462025-03-01T01:21:05.970ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = ac2fcc79-8258-493a-ae7a-8646c52659c8 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
64472025-03-01T01:21:05.971ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1978 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = ac2fcc79-8258-493a-ae7a-8646c52659c8 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
64482025-03-01T01:21:06.991ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 9ef5ef99-29bd-433c-a1ec-931c81177dd6 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
64492025-03-01T01:21:06.991ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 9ef5ef99-29bd-433c-a1ec-931c81177dd6 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
64502025-03-01T01:21:06.993ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2154 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 9ef5ef99-29bd-433c-a1ec-931c81177dd6 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
64512025-03-01T01:21:07.407ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61177 req_id = ec4562e7-50a1-4ad6-80ef-336f5521938b roles = RoleSet { roles: {} } uri = /metrics/collectors/d77aa5d6-e6f9-4845-b1d4-57f91a3621e6/producers?sort_by=id_ascending
64522025-03-01T01:21:07.408ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61177 req_id = ec4562e7-50a1-4ad6-80ef-336f5521938b resource = Database result = Ok(()) uri = /metrics/collectors/d77aa5d6-e6f9-4845-b1d4-57f91a3621e6/producers?sort_by=id_ascending
64532025-03-01T01:21:07.410ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2686 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61177 req_id = ec4562e7-50a1-4ad6-80ef-336f5521938b response_code = 200 uri = /metrics/collectors/d77aa5d6-e6f9-4845-b1d4-57f91a3621e6/producers?sort_by=id_ascending
64542025-03-01T01:21:07.410ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61177 req_id = 1e398e1c-8cba-415b-a865-a28ffb64f662 roles = RoleSet { roles: {} } uri = /metrics/collectors/d77aa5d6-e6f9-4845-b1d4-57f91a3621e6/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYmI0ODUwMS0zYzRlLTRkNDQtODgyMy1mOTc1ZTg2OTFmZmYifX0%3D
64552025-03-01T01:21:07.411ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61177 req_id = 1e398e1c-8cba-415b-a865-a28ffb64f662 resource = Database result = Ok(()) uri = /metrics/collectors/d77aa5d6-e6f9-4845-b1d4-57f91a3621e6/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYmI0ODUwMS0zYzRlLTRkNDQtODgyMy1mOTc1ZTg2OTFmZmYifX0%3D
64562025-03-01T01:21:07.413ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2438 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61177 req_id = 1e398e1c-8cba-415b-a865-a28ffb64f662 response_code = 200 uri = /metrics/collectors/d77aa5d6-e6f9-4845-b1d4-57f91a3621e6/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYmI0ODUwMS0zYzRlLTRkNDQtODgyMy1mOTc1ZTg2OTFmZmYifX0%3D
64572025-03-01T01:21:07.414ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 285 local_addr = [fd00:1122:3344:101::c]:34357 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = 74ffae68-8a11-4c73-8e06-93abb84676a8 response_code = 200 uri = /67b03f4e-4cbd-4843-9cd9-647f610abcfc
64582025-03-01T01:21:08.013ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 763b87b5-54b7-4bf5-b669-32c3b5632f59 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
64592025-03-01T01:21:08.013ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 763b87b5-54b7-4bf5-b669-32c3b5632f59 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
64602025-03-01T01:21:08.015ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2187 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 763b87b5-54b7-4bf5-b669-32c3b5632f59 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
64612025-03-01T01:21:09.036ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = a33fca1c-8795-4155-b9ec-ec9e3ddc5dc0 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
64622025-03-01T01:21:09.036ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = a33fca1c-8795-4155-b9ec-ec9e3ddc5dc0 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
64632025-03-01T01:21:09.037ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1922 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = a33fca1c-8795-4155-b9ec-ec9e3ddc5dc0 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
64642025-03-01T01:21:10.058ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = fcad8365-54d0-4414-b2c9-48c06d206130 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
64652025-03-01T01:21:10.059ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = fcad8365-54d0-4414-b2c9-48c06d206130 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
64662025-03-01T01:21:10.060ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2203 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = fcad8365-54d0-4414-b2c9-48c06d206130 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
64672025-03-01T01:21:11.079ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = fa846c5a-f187-42e8-96ce-2433747595c2 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
64682025-03-01T01:21:11.079ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = fa846c5a-f187-42e8-96ce-2433747595c2 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
64692025-03-01T01:21:11.082ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2646 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = fa846c5a-f187-42e8-96ce-2433747595c2 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
64702025-03-01T01:21:12.101ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 8f93ad90-1619-4e5c-84ff-9e537241857c roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
64712025-03-01T01:21:12.102ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 8f93ad90-1619-4e5c-84ff-9e537241857c resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
64722025-03-01T01:21:12.104ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2469 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 8f93ad90-1619-4e5c-84ff-9e537241857c response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
64732025-03-01T01:21:13.123ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = ee043be3-077b-48f8-9aab-101ccfd65d37 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
64742025-03-01T01:21:13.123ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = ee043be3-077b-48f8-9aab-101ccfd65d37 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
64752025-03-01T01:21:13.125ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2142 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = ee043be3-077b-48f8-9aab-101ccfd65d37 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
64762025-03-01T01:21:13.214ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 39 reason = Timeout
64772025-03-01T01:21:13.214ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 39 reason = Timeout
64782025-03-01T01:21:13.214ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
64792025-03-01T01:21:13.214ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64802025-03-01T01:21:13.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
64812025-03-01T01:21:13.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64822025-03-01T01:21:13.217ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64832025-03-01T01:21:13.219ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
64842025-03-01T01:21:13.219ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64852025-03-01T01:21:13.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64862025-03-01T01:21:13.221ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64872025-03-01T01:21:13.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64882025-03-01T01:21:13.223ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64892025-03-01T01:21:13.225ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7, lookup_type: ById(8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7) } result = Ok(())
64902025-03-01T01:21:13.225ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64912025-03-01T01:21:13.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64922025-03-01T01:21:13.234ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 original_time_created = 2025-03-01 01:14:50.436545 UTC target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 time_created = 2025-03-01 01:14:50.436545 UTC
64932025-03-01T01:21:13.234ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.020348ms iteration = 39 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7","time_created":"2025-03-01T01:14:50.436545Z"}
64942025-03-01T01:21:13.242ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
64952025-03-01T01:21:13.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
64962025-03-01T01:21:13.273ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 59.281198ms iteration = 39 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
64972025-03-01T01:21:14.146ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 82b0d8d8-1ced-42c1-9d1e-9686f2ea5486 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
64982025-03-01T01:21:14.146ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 82b0d8d8-1ced-42c1-9d1e-9686f2ea5486 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
64992025-03-01T01:21:14.147ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1987 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 82b0d8d8-1ced-42c1-9d1e-9686f2ea5486 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
65002025-03-01T01:21:15.168ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 0ce46e0a-9f24-49a1-a493-55dd43f66380 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
65012025-03-01T01:21:15.168ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 0ce46e0a-9f24-49a1-a493-55dd43f66380 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
65022025-03-01T01:21:15.170ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2308 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 0ce46e0a-9f24-49a1-a493-55dd43f66380 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
65032025-03-01T01:21:16.189ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = b083673d-fb23-4955-952c-dfc43add1e49 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
65042025-03-01T01:21:16.190ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = b083673d-fb23-4955-952c-dfc43add1e49 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
65052025-03-01T01:21:16.192ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2292 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = b083673d-fb23-4955-952c-dfc43add1e49 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
65062025-03-01T01:21:17.213ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = ec76c7a9-82f4-4d3a-a47d-d23ccece3ac9 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
65072025-03-01T01:21:17.213ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = ec76c7a9-82f4-4d3a-a47d-d23ccece3ac9 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
65082025-03-01T01:21:17.215ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1880 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = ec76c7a9-82f4-4d3a-a47d-d23ccece3ac9 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
65092025-03-01T01:21:17.415ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 344 local_addr = [fd00:1122:3344:101::c]:34357 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = 7c143b19-c13e-4482-bb28-c7e50ccb8bd2 response_code = 200 uri = /67b03f4e-4cbd-4843-9cd9-647f610abcfc
65102025-03-01T01:21:18.234ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = f3d5f55f-4863-4ec5-a480-c51f4d06a32f roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
65112025-03-01T01:21:18.234ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = f3d5f55f-4863-4ec5-a480-c51f4d06a32f resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
65122025-03-01T01:21:18.235ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1715 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = f3d5f55f-4863-4ec5-a480-c51f4d06a32f response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
65132025-03-01T01:21:19.255ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 7dacb799-9177-4433-aac3-6eeeb43caec4 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
65142025-03-01T01:21:19.255ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 7dacb799-9177-4433-aac3-6eeeb43caec4 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
65152025-03-01T01:21:19.257ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1942 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 7dacb799-9177-4433-aac3-6eeeb43caec4 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
65162025-03-01T01:21:20.276ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 9ece9452-d075-46b0-a059-9877d0b781e6 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
65172025-03-01T01:21:20.276ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 9ece9452-d075-46b0-a059-9877d0b781e6 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
65182025-03-01T01:21:20.278ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2405 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 9ece9452-d075-46b0-a059-9877d0b781e6 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
65192025-03-01T01:21:21.298ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = fbdb1838-8fec-4b6d-9170-a1086f54004b roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
65202025-03-01T01:21:21.298ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = fbdb1838-8fec-4b6d-9170-a1086f54004b resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
65212025-03-01T01:21:21.300ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1849 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = fbdb1838-8fec-4b6d-9170-a1086f54004b response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
65222025-03-01T01:21:22.319ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = ae288e18-9032-43c7-a7b8-5a92ee255a54 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
65232025-03-01T01:21:22.320ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = ae288e18-9032-43c7-a7b8-5a92ee255a54 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
65242025-03-01T01:21:22.322ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2221 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = ae288e18-9032-43c7-a7b8-5a92ee255a54 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
65252025-03-01T01:21:23.214ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 14 reason = Timeout
65262025-03-01T01:21:23.214ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 14 reason = Timeout
65272025-03-01T01:21:23.214ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
65282025-03-01T01:21:23.214ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
65292025-03-01T01:21:23.214ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 40 reason = Timeout
65302025-03-01T01:21:23.214ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
65312025-03-01T01:21:23.214ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 14 reason = Timeout
65322025-03-01T01:21:23.214ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 14 reason = Timeout
65332025-03-01T01:21:23.214ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
65342025-03-01T01:21:23.214ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65352025-03-01T01:21:23.214ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 14 reason = Timeout
65362025-03-01T01:21:23.214ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 14 reason = Timeout
65372025-03-01T01:21:23.214ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
65382025-03-01T01:21:23.214ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
65392025-03-01T01:21:23.214ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 14 reason = Timeout
65402025-03-01T01:21:23.214ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 15 reason = Timeout
65412025-03-01T01:21:23.214ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
65422025-03-01T01:21:23.214ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
65432025-03-01T01:21:23.214ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 14 reason = Timeout
65442025-03-01T01:21:23.214ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
65452025-03-01T01:21:23.214ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 14 reason = Timeout
65462025-03-01T01:21:23.214ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
65472025-03-01T01:21:23.214ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
65482025-03-01T01:21:23.214ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 14 reason = Timeout
65492025-03-01T01:21:23.214ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 14 reason = Timeout
65502025-03-01T01:21:23.214ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
65512025-03-01T01:21:23.214ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 14 reason = Timeout
65522025-03-01T01:21:23.214ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 14 reason = Timeout
65532025-03-01T01:21:23.214ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
65542025-03-01T01:21:23.214ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 14 reason = Timeout
65552025-03-01T01:21:23.214ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
65562025-03-01T01:21:23.214ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
65572025-03-01T01:21:23.214ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 14 reason = Timeout
65582025-03-01T01:21:23.214ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
65592025-03-01T01:21:23.214ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
65602025-03-01T01:21:23.214ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 40 reason = Timeout
65612025-03-01T01:21:23.214ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65622025-03-01T01:21:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
65632025-03-01T01:21:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
65642025-03-01T01:21:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
65652025-03-01T01:21:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65662025-03-01T01:21:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
65672025-03-01T01:21:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
65682025-03-01T01:21:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
65692025-03-01T01:21:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
65702025-03-01T01:21:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
65712025-03-01T01:21:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
65722025-03-01T01:21:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
65732025-03-01T01:21:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
65742025-03-01T01:21:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
65752025-03-01T01:21:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
65762025-03-01T01:21:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
65772025-03-01T01:21:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
65782025-03-01T01:21:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65792025-03-01T01:21:23.216ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65802025-03-01T01:21:23.217ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 2.862709ms iteration = 14 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
65812025-03-01T01:21:23.217ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
65822025-03-01T01:21:23.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
65832025-03-01T01:21:23.218ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65842025-03-01T01:21:23.218ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
65852025-03-01T01:21:23.218ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
65862025-03-01T01:21:23.218ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
65872025-03-01T01:21:23.218ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1293, tv_nsec: 906493149 } })
65882025-03-01T01:21:23.219ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1154
65892025-03-01T01:21:23.219ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
65902025-03-01T01:21:23.219ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65912025-03-01T01:21:23.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65922025-03-01T01:21:23.221ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65932025-03-01T01:21:23.222ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1293, tv_nsec: 909737776 } })
65942025-03-01T01:21:23.222ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1154
65952025-03-01T01:21:23.222ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65962025-03-01T01:21:23.223ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
65972025-03-01T01:21:23.223ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
65982025-03-01T01:21:23.223ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
65992025-03-01T01:21:23.224ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
66002025-03-01T01:21:23.224ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
66012025-03-01T01:21:23.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
66022025-03-01T01:21:23.225ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66032025-03-01T01:21:23.225ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 11.489894ms iteration = 14 status = {"errors":[],"finish_invoked_ok":[]}
66042025-03-01T01:21:23.227ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66052025-03-01T01:21:23.227ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
66062025-03-01T01:21:23.227ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
66072025-03-01T01:21:23.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
66082025-03-01T01:21:23.230ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
66092025-03-01T01:21:23.230ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66102025-03-01T01:21:23.231ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66112025-03-01T01:21:23.231ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 16.809612ms iteration = 40 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
66122025-03-01T01:21:23.233ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
66132025-03-01T01:21:23.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
66142025-03-01T01:21:23.234ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66152025-03-01T01:21:23.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66162025-03-01T01:21:23.235ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66172025-03-01T01:21:23.235ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66182025-03-01T01:21:23.236ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
66192025-03-01T01:21:23.236ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 22.56785ms iteration = 14 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
66202025-03-01T01:21:23.237ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1293, tv_nsec: 924831993 } })
66212025-03-01T01:21:23.237ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1154 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66
66222025-03-01T01:21:23.238ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
66232025-03-01T01:21:23.238ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
66242025-03-01T01:21:23.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
66252025-03-01T01:21:23.239ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7, lookup_type: ById(8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7) } result = Ok(())
66262025-03-01T01:21:23.239ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66272025-03-01T01:21:23.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66282025-03-01T01:21:23.249ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 original_time_created = 2025-03-01 01:14:50.436545 UTC target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 time_created = 2025-03-01 01:14:50.436545 UTC
66292025-03-01T01:21:23.249ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 34.88218ms iteration = 40 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7","time_created":"2025-03-01T01:14:50.436545Z"}
66302025-03-01T01:21:23.252ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
66312025-03-01T01:21:23.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
66322025-03-01T01:21:23.253ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
66332025-03-01T01:21:23.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
66342025-03-01T01:21:23.254ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
66352025-03-01T01:21:23.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
66362025-03-01T01:21:23.256ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 42.070617ms iteration = 14 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
66372025-03-01T01:21:23.256ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
66382025-03-01T01:21:23.256ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
66392025-03-01T01:21:23.256ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
66402025-03-01T01:21:23.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
66412025-03-01T01:21:23.258ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
66422025-03-01T01:21:23.258ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
66432025-03-01T01:21:23.258ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
66442025-03-01T01:21:23.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
66452025-03-01T01:21:23.261ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
66462025-03-01T01:21:23.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
66472025-03-01T01:21:23.263ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 49.248983ms iteration = 14 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
66482025-03-01T01:21:23.263ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66492025-03-01T01:21:23.266ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
66502025-03-01T01:21:23.266ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
66512025-03-01T01:21:23.266ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
66522025-03-01T01:21:23.267ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 53.156943ms iteration = 14 status = {"errors":[],"garbage_collect_requested":[]}
66532025-03-01T01:21:23.268ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
66542025-03-01T01:21:23.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
66552025-03-01T01:21:23.273ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
66562025-03-01T01:21:23.273ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66572025-03-01T01:21:23.273ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
66582025-03-01T01:21:23.275ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
66592025-03-01T01:21:23.275ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
66602025-03-01T01:21:23.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
66612025-03-01T01:21:23.277ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66622025-03-01T01:21:23.279ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
66632025-03-01T01:21:23.279ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
66642025-03-01T01:21:23.279ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
66652025-03-01T01:21:23.281ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
66662025-03-01T01:21:23.281ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 66.806551ms iteration = 14 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
66672025-03-01T01:21:23.292ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
66682025-03-01T01:21:23.292ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
66692025-03-01T01:21:23.292ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0127c8b6-3366-4907-8369-1bb3d384b46a", "content-length": "26", "date": "Sat, 01 Mar 2025 01:21:23 GMT"} })
66702025-03-01T01:21:23.292ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
66712025-03-01T01:21:23.293ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 78.99055ms iteration = 14 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
66722025-03-01T01:21:23.295ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
66732025-03-01T01:21:23.295ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
66742025-03-01T01:21:23.295ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
66752025-03-01T01:21:23.295ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 81.421528ms iteration = 14 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
66762025-03-01T01:21:23.297ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
66772025-03-01T01:21:23.298ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
66782025-03-01T01:21:23.299ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
66792025-03-01T01:21:23.300ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
66802025-03-01T01:21:23.301ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66812025-03-01T01:21:23.301ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
66822025-03-01T01:21:23.301ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
66832025-03-01T01:21:23.302ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "37408d7a-9d74-491e-80bc-53127ee317b1", "content-length": "26", "date": "Sat, 01 Mar 2025 01:21:23 GMT"} })
66842025-03-01T01:21:23.302ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
66852025-03-01T01:21:23.303ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
66862025-03-01T01:21:23.304ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 3471264f-127e-4a25-bc10-2e8249e8d70a, lookup_type: ById(3471264f-127e-4a25-bc10-2e8249e8d70a) } result = Ok(())
66872025-03-01T01:21:23.304ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
66882025-03-01T01:21:23.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
66892025-03-01T01:21:23.333ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 119.27367ms iteration = 15 status = {"physical_disks_added":0}
66902025-03-01T01:21:23.338ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
66912025-03-01T01:21:23.338ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
66922025-03-01T01:21:23.347ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1162 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 zone_address = fd00:1122:3344:101::2
66932025-03-01T01:21:23.347ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
66942025-03-01T01:21:23.349ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0a89a891-1786-4718-a8ca-f23a7d77d768", "content-length": "26", "date": "Sat, 01 Mar 2025 01:21:23 GMT"} })
66952025-03-01T01:21:23.349ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1167 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
66962025-03-01T01:21:23.352ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66
66972025-03-01T01:21:23.388ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c6a296e1-167b-4cce-9d8c-62bd10ae6b98 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
66982025-03-01T01:21:23.388ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c6a296e1-167b-4cce-9d8c-62bd10ae6b98 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
66992025-03-01T01:21:23.400ZINFOnexus (BackgroundTasks): VPC route manager sled 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
67002025-03-01T01:21:23.400ZDEBGnexus (BackgroundTasks): client request SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
67012025-03-01T01:21:23.400ZDEBGnexus (BackgroundTasks): client response SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "217d4b9d-a696-47c2-af23-ecc2811fb61c", "content-length": "372", "date": "Sat, 01 Mar 2025 01:21:23 GMT"} })
67022025-03-01T01:21:23.400ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
67032025-03-01T01:21:23.403ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
67042025-03-01T01:21:23.404ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 190.291576ms iteration = 14 status = 0
67052025-03-01T01:21:23.409ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 21331 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c6a296e1-167b-4cce-9d8c-62bd10ae6b98 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
67062025-03-01T01:21:23.416ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
67072025-03-01T01:21:23.417ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
67082025-03-01T01:21:23.418ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 204.425944ms iteration = 14 status = {}
67092025-03-01T01:21:23.423ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67102025-03-01T01:21:23.426ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
67112025-03-01T01:21:23.426ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
67122025-03-01T01:21:23.426ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
67132025-03-01T01:21:23.426ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
67142025-03-01T01:21:23.426ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "6d029d51-61c6-4f5b-afd0-d509ee45c933", "content-length": "2", "date": "Sat, 01 Mar 2025 01:21:22 GMT"} })
67152025-03-01T01:21:23.427ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67162025-03-01T01:21:23.427ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
67172025-03-01T01:21:23.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
67182025-03-01T01:21:23.429ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
67192025-03-01T01:21:23.429ZDEBGnexus (BackgroundTasks): client request SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
67202025-03-01T01:21:23.429ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
67212025-03-01T01:21:23.429ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
67222025-03-01T01:21:23.429ZDEBGnexus (BackgroundTasks): client response SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "d68f97d6-f878-4850-848b-931caa6364f3", "date": "Sat, 01 Mar 2025 01:21:23 GMT"} })
67232025-03-01T01:21:23.429ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
67242025-03-01T01:21:23.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
67252025-03-01T01:21:23.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
67262025-03-01T01:21:23.430ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 216.014731ms iteration = 14 status = null
67272025-03-01T01:21:23.432ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
67282025-03-01T01:21:23.432ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
67292025-03-01T01:21:23.436ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
67302025-03-01T01:21:23.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
67312025-03-01T01:21:23.440ZINFOnexus (BackgroundTasks): VPC route manager sled 3471264f-127e-4a25-bc10-2e8249e8d70a push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
67322025-03-01T01:21:23.440ZDEBGnexus (BackgroundTasks): client request SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
67332025-03-01T01:21:23.441ZDEBGnexus (BackgroundTasks): client response SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "62f48fb9-c55e-4973-82e0-a5ff49e6da37", "date": "Sat, 01 Mar 2025 01:21:23 GMT"} })
67342025-03-01T01:21:23.443ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 229.377872ms iteration = 14 status = {}
67352025-03-01T01:21:23.509ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67362025-03-01T01:21:23.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67372025-03-01T01:21:23.512ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 7f9c3c14-58c5-473f-8692-6376be44401e, rack_id: 4854cb88-dfba-4609-8f9d-72aac08cef66, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(cb10d0c6-a704-4231-b148-4f9ae21a03f8) } rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 switch_location = Switch0
67382025-03-01T01:21:23.512ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67392025-03-01T01:21:23.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67402025-03-01T01:21:23.528ZDEBGnexus (BackgroundTasks): client request SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
67412025-03-01T01:21:23.529ZDEBGnexus (BackgroundTasks): client response SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "959f9cc0-b2fa-472a-93c5-69c2b0e9877e", "content-length": "691", "date": "Sat, 01 Mar 2025 01:21:23 GMT"} })
67422025-03-01T01:21:23.529ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
67432025-03-01T01:21:23.529ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
67442025-03-01T01:21:23.529ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
67452025-03-01T01:21:23.530ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 316.294293ms iteration = 14 status = {}
67462025-03-01T01:21:23.538ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
67472025-03-01T01:21:23.539ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "d2780493-ba40-4f44-aacd-a9d97dd556fd", "content-length": "134", "date": "Sat, 01 Mar 2025 01:21:22 GMT"} })
67482025-03-01T01:21:23.539ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
67492025-03-01T01:21:23.539ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = cb10d0c6-a704-4231-b148-4f9ae21a03f8
67502025-03-01T01:21:23.539ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
67512025-03-01T01:21:23.539ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
67522025-03-01T01:21:23.539ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
67532025-03-01T01:21:23.539ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
67542025-03-01T01:21:23.539ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
67552025-03-01T01:21:23.539ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
67562025-03-01T01:21:23.539ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
67572025-03-01T01:21:23.539ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
67582025-03-01T01:21:23.539ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66
67592025-03-01T01:21:23.539ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67602025-03-01T01:21:23.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67612025-03-01T01:21:23.542ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
67622025-03-01T01:21:23.542ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "9d3fd2ae-2935-4657-9b4e-deab146dda85", "content-length": "2", "date": "Sat, 01 Mar 2025 01:21:22 GMT"} })
67632025-03-01T01:21:23.542ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
67642025-03-01T01:21:23.542ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "988ce2f0-9c21-472d-a1cd-dc1dfaf9c36b", "content-length": "52", "date": "Sat, 01 Mar 2025 01:21:22 GMT"} })
67652025-03-01T01:21:23.542ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 switch_location = Switch0
67662025-03-01T01:21:23.542ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
67672025-03-01T01:21:23.647ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "cde2b9c8-9375-421c-8f7c-0f1feccbd509", "date": "Sat, 01 Mar 2025 01:21:23 GMT"} })
67682025-03-01T01:21:23.647ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 switch = Switch0
67692025-03-01T01:21:23.647ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
67702025-03-01T01:21:23.648ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "c3141eac-6c8a-43c6-9b0a-094c450b99e2", "content-length": "682", "date": "Sat, 01 Mar 2025 01:21:23 GMT"} })
67712025-03-01T01:21:23.648ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67722025-03-01T01:21:23.648ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67732025-03-01T01:21:23.652ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67742025-03-01T01:21:23.652ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67752025-03-01T01:21:23.655ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67762025-03-01T01:21:23.655ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67772025-03-01T01:21:23.657ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67782025-03-01T01:21:23.657ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67792025-03-01T01:21:23.664ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 450.224962ms iteration = 14 status = {}
67802025-03-01T01:21:24.435ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = e06bbe6c-5596-4619-aa30-3d1b87f8b24f roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
67812025-03-01T01:21:24.436ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = e06bbe6c-5596-4619-aa30-3d1b87f8b24f resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
67822025-03-01T01:21:24.437ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2248 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = e06bbe6c-5596-4619-aa30-3d1b87f8b24f response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
67832025-03-01T01:21:25.458ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = b28c28ca-99f4-46db-ae2b-d3b3fd2e1579 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
67842025-03-01T01:21:25.458ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = b28c28ca-99f4-46db-ae2b-d3b3fd2e1579 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
67852025-03-01T01:21:25.460ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1959 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = b28c28ca-99f4-46db-ae2b-d3b3fd2e1579 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
67862025-03-01T01:21:26.479ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = e9d4bb61-c7a9-4128-9581-174c0f89837f roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
67872025-03-01T01:21:26.480ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = e9d4bb61-c7a9-4128-9581-174c0f89837f resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
67882025-03-01T01:21:26.482ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2139 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = e9d4bb61-c7a9-4128-9581-174c0f89837f response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
67892025-03-01T01:21:27.414ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 374 local_addr = [fd00:1122:3344:101::c]:34357 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = 4f6657e7-5a58-4a54-a84e-bda6a08a50d9 response_code = 200 uri = /67b03f4e-4cbd-4843-9cd9-647f610abcfc
67902025-03-01T01:21:27.502ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = baa83b2d-e7a1-4082-8734-a5541955325e roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
67912025-03-01T01:21:27.502ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = baa83b2d-e7a1-4082-8734-a5541955325e resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
67922025-03-01T01:21:27.503ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1809 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = baa83b2d-e7a1-4082-8734-a5541955325e response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
67932025-03-01T01:21:28.522ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 169f9c1e-504d-4f13-8402-c5a439ecf715 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
67942025-03-01T01:21:28.523ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 169f9c1e-504d-4f13-8402-c5a439ecf715 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
67952025-03-01T01:21:28.525ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2337 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 169f9c1e-504d-4f13-8402-c5a439ecf715 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
67962025-03-01T01:21:29.544ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 44b6fda0-2a96-4668-9a81-3d2d1c6ccc49 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
67972025-03-01T01:21:29.544ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 44b6fda0-2a96-4668-9a81-3d2d1c6ccc49 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
67982025-03-01T01:21:29.546ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2394 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 44b6fda0-2a96-4668-9a81-3d2d1c6ccc49 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
67992025-03-01T01:21:30.567ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 7014ecb4-3e93-4f2f-b366-b0e0c95f71f1 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
68002025-03-01T01:21:30.568ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 7014ecb4-3e93-4f2f-b366-b0e0c95f71f1 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
68012025-03-01T01:21:30.570ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2320 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 7014ecb4-3e93-4f2f-b366-b0e0c95f71f1 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
68022025-03-01T01:21:31.589ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 2b711cda-7712-4776-87b0-b67275b2adbb roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
68032025-03-01T01:21:31.589ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 2b711cda-7712-4776-87b0-b67275b2adbb resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
68042025-03-01T01:21:31.591ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2429 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 2b711cda-7712-4776-87b0-b67275b2adbb response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
68052025-03-01T01:21:32.610ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 699bdc96-1c82-44cb-a1ee-9458b65e3b0b roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
68062025-03-01T01:21:32.610ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 699bdc96-1c82-44cb-a1ee-9458b65e3b0b resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
68072025-03-01T01:21:32.612ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1843 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 699bdc96-1c82-44cb-a1ee-9458b65e3b0b response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
68082025-03-01T01:21:33.214ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 41 reason = Timeout
68092025-03-01T01:21:33.214ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 41 reason = Timeout
68102025-03-01T01:21:33.214ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
68112025-03-01T01:21:33.214ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68122025-03-01T01:21:33.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
68132025-03-01T01:21:33.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68142025-03-01T01:21:33.216ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68152025-03-01T01:21:33.219ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
68162025-03-01T01:21:33.219ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68172025-03-01T01:21:33.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68182025-03-01T01:21:33.221ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68192025-03-01T01:21:33.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68202025-03-01T01:21:33.222ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68212025-03-01T01:21:33.225ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7, lookup_type: ById(8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7) } result = Ok(())
68222025-03-01T01:21:33.225ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68232025-03-01T01:21:33.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68242025-03-01T01:21:33.237ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 original_time_created = 2025-03-01 01:14:50.436545 UTC target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 time_created = 2025-03-01 01:14:50.436545 UTC
68252025-03-01T01:21:33.237ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.799204ms iteration = 41 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7","time_created":"2025-03-01T01:14:50.436545Z"}
68262025-03-01T01:21:33.243ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
68272025-03-01T01:21:33.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
68282025-03-01T01:21:33.277ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 62.933342ms iteration = 41 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
68292025-03-01T01:21:33.632ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = b342692e-75b1-4776-a689-879b5cf0bcb5 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
68302025-03-01T01:21:33.632ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = b342692e-75b1-4776-a689-879b5cf0bcb5 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
68312025-03-01T01:21:33.634ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2040 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = b342692e-75b1-4776-a689-879b5cf0bcb5 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
68322025-03-01T01:21:34.654ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = e54fb2f8-680f-42a5-9f49-e0e88c0e18d9 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
68332025-03-01T01:21:34.654ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = e54fb2f8-680f-42a5-9f49-e0e88c0e18d9 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
68342025-03-01T01:21:34.656ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2595 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = e54fb2f8-680f-42a5-9f49-e0e88c0e18d9 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
68352025-03-01T01:21:35.676ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 584b2a6a-2076-4d43-b77a-3ef44ee08b83 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
68362025-03-01T01:21:35.676ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 584b2a6a-2076-4d43-b77a-3ef44ee08b83 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
68372025-03-01T01:21:35.679ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2478 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 584b2a6a-2076-4d43-b77a-3ef44ee08b83 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
68382025-03-01T01:21:36.699ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c6db4066-cf7b-4b3d-aefd-1c752d8790f7 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
68392025-03-01T01:21:36.700ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c6db4066-cf7b-4b3d-aefd-1c752d8790f7 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
68402025-03-01T01:21:36.701ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1876 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c6db4066-cf7b-4b3d-aefd-1c752d8790f7 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
68412025-03-01T01:21:37.407ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61177 req_id = 05b2f13c-166a-49b7-98c1-1a49aa74e012 roles = RoleSet { roles: {} } uri = /metrics/collectors/d77aa5d6-e6f9-4845-b1d4-57f91a3621e6/producers?sort_by=id_ascending
68422025-03-01T01:21:37.408ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61177 req_id = 05b2f13c-166a-49b7-98c1-1a49aa74e012 resource = Database result = Ok(()) uri = /metrics/collectors/d77aa5d6-e6f9-4845-b1d4-57f91a3621e6/producers?sort_by=id_ascending
68432025-03-01T01:21:37.410ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3202 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61177 req_id = 05b2f13c-166a-49b7-98c1-1a49aa74e012 response_code = 200 uri = /metrics/collectors/d77aa5d6-e6f9-4845-b1d4-57f91a3621e6/producers?sort_by=id_ascending
68442025-03-01T01:21:37.411ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61177 req_id = b19f84c9-9354-4990-804c-eed92c19d6e4 roles = RoleSet { roles: {} } uri = /metrics/collectors/d77aa5d6-e6f9-4845-b1d4-57f91a3621e6/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYmI0ODUwMS0zYzRlLTRkNDQtODgyMy1mOTc1ZTg2OTFmZmYifX0%3D
68452025-03-01T01:21:37.411ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61177 req_id = b19f84c9-9354-4990-804c-eed92c19d6e4 resource = Database result = Ok(()) uri = /metrics/collectors/d77aa5d6-e6f9-4845-b1d4-57f91a3621e6/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYmI0ODUwMS0zYzRlLTRkNDQtODgyMy1mOTc1ZTg2OTFmZmYifX0%3D
68462025-03-01T01:21:37.413ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2578 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61177 req_id = b19f84c9-9354-4990-804c-eed92c19d6e4 response_code = 200 uri = /metrics/collectors/d77aa5d6-e6f9-4845-b1d4-57f91a3621e6/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYmI0ODUwMS0zYzRlLTRkNDQtODgyMy1mOTc1ZTg2OTFmZmYifX0%3D
68472025-03-01T01:21:37.414ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 317 local_addr = [fd00:1122:3344:101::c]:34357 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = 49537d79-931c-4ef1-bba2-252871e1b2e7 response_code = 200 uri = /67b03f4e-4cbd-4843-9cd9-647f610abcfc
68482025-03-01T01:21:37.720ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 8f80b1f4-b4c2-4a00-b15c-fef836e6bc1e roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
68492025-03-01T01:21:37.720ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 8f80b1f4-b4c2-4a00-b15c-fef836e6bc1e resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
68502025-03-01T01:21:37.722ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1934 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 8f80b1f4-b4c2-4a00-b15c-fef836e6bc1e response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
68512025-03-01T01:21:38.742ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 7b49d108-c657-4c66-994b-f481556f85eb roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
68522025-03-01T01:21:38.742ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 7b49d108-c657-4c66-994b-f481556f85eb resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
68532025-03-01T01:21:38.744ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2167 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 7b49d108-c657-4c66-994b-f481556f85eb response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
68542025-03-01T01:21:39.763ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 762cdca8-13bd-42be-a446-229f0260c4c7 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
68552025-03-01T01:21:39.763ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 762cdca8-13bd-42be-a446-229f0260c4c7 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
68562025-03-01T01:21:39.765ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2095 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 762cdca8-13bd-42be-a446-229f0260c4c7 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
68572025-03-01T01:21:40.784ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = a81377da-8703-4cf2-9089-e4cd7016658a roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
68582025-03-01T01:21:40.784ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = a81377da-8703-4cf2-9089-e4cd7016658a resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
68592025-03-01T01:21:40.789ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 5318 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = a81377da-8703-4cf2-9089-e4cd7016658a response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
68602025-03-01T01:21:41.810ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 6dd69851-2da4-417d-86cc-e1663ecdde74 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
68612025-03-01T01:21:41.810ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 6dd69851-2da4-417d-86cc-e1663ecdde74 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
68622025-03-01T01:21:41.812ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2062 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 6dd69851-2da4-417d-86cc-e1663ecdde74 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
68632025-03-01T01:21:42.831ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = bbe29d3f-3709-4ec2-9943-a2c8cd828035 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
68642025-03-01T01:21:42.832ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = bbe29d3f-3709-4ec2-9943-a2c8cd828035 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
68652025-03-01T01:21:42.834ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2621 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = bbe29d3f-3709-4ec2-9943-a2c8cd828035 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
68662025-03-01T01:21:43.214ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 42 reason = Timeout
68672025-03-01T01:21:43.214ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
68682025-03-01T01:21:43.214ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 42 reason = Timeout
68692025-03-01T01:21:43.214ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68702025-03-01T01:21:43.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
68712025-03-01T01:21:43.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68722025-03-01T01:21:43.216ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
68732025-03-01T01:21:43.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
68742025-03-01T01:21:43.217ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68752025-03-01T01:21:43.218ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.90357ms iteration = 42 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
68762025-03-01T01:21:43.219ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
68772025-03-01T01:21:43.219ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68782025-03-01T01:21:43.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68792025-03-01T01:21:43.221ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68802025-03-01T01:21:43.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68812025-03-01T01:21:43.223ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68822025-03-01T01:21:43.225ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7, lookup_type: ById(8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7) } result = Ok(())
68832025-03-01T01:21:43.225ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68842025-03-01T01:21:43.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68852025-03-01T01:21:43.234ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 original_time_created = 2025-03-01 01:14:50.436545 UTC target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 time_created = 2025-03-01 01:14:50.436545 UTC
68862025-03-01T01:21:43.234ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.342005ms iteration = 42 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7","time_created":"2025-03-01T01:14:50.436545Z"}
68872025-03-01T01:21:43.854ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 85e89ee4-4883-4d2d-abdb-f29b2c4fee05 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
68882025-03-01T01:21:43.854ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 85e89ee4-4883-4d2d-abdb-f29b2c4fee05 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
68892025-03-01T01:21:43.856ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2061 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 85e89ee4-4883-4d2d-abdb-f29b2c4fee05 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
68902025-03-01T01:21:44.875ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 60f785e5-1543-4e2a-9e13-e500b3f55278 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
68912025-03-01T01:21:44.876ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 60f785e5-1543-4e2a-9e13-e500b3f55278 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
68922025-03-01T01:21:44.877ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1956 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 60f785e5-1543-4e2a-9e13-e500b3f55278 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
68932025-03-01T01:21:45.897ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c664f5f8-1e4f-41c9-b7f4-92b2f3bee345 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
68942025-03-01T01:21:45.897ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c664f5f8-1e4f-41c9-b7f4-92b2f3bee345 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
68952025-03-01T01:21:45.899ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2336 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c664f5f8-1e4f-41c9-b7f4-92b2f3bee345 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
68962025-03-01T01:21:46.918ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = a0941136-d1e3-4e02-86a3-405c76273b03 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
68972025-03-01T01:21:46.919ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = a0941136-d1e3-4e02-86a3-405c76273b03 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
68982025-03-01T01:21:46.920ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2155 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = a0941136-d1e3-4e02-86a3-405c76273b03 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
68992025-03-01T01:21:47.415ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 394 local_addr = [fd00:1122:3344:101::c]:34357 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = 58c4d78a-6447-47c4-a186-f6f2fc16c7fa response_code = 200 uri = /67b03f4e-4cbd-4843-9cd9-647f610abcfc
69002025-03-01T01:21:47.940ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 678f0e85-54c6-4ecc-b5eb-ed04c3cfa7f9 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
69012025-03-01T01:21:47.941ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 678f0e85-54c6-4ecc-b5eb-ed04c3cfa7f9 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
69022025-03-01T01:21:47.943ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2636 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 678f0e85-54c6-4ecc-b5eb-ed04c3cfa7f9 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
69032025-03-01T01:21:48.963ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = ab69e334-4298-4f16-a77f-a9c82e1ffb4c roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
69042025-03-01T01:21:48.963ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = ab69e334-4298-4f16-a77f-a9c82e1ffb4c resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
69052025-03-01T01:21:48.965ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1480 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = ab69e334-4298-4f16-a77f-a9c82e1ffb4c response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
69062025-03-01T01:21:49.984ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = dd8f59a0-dbce-4b75-ae60-0222f74242ee roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
69072025-03-01T01:21:49.985ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = dd8f59a0-dbce-4b75-ae60-0222f74242ee resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
69082025-03-01T01:21:49.986ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2124 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = dd8f59a0-dbce-4b75-ae60-0222f74242ee response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
69092025-03-01T01:21:51.006ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = a9d8aa91-6bcc-4f6e-ad3f-8c694834f93b roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
69102025-03-01T01:21:51.006ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = a9d8aa91-6bcc-4f6e-ad3f-8c694834f93b resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
69112025-03-01T01:21:51.008ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2149 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = a9d8aa91-6bcc-4f6e-ad3f-8c694834f93b response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
69122025-03-01T01:21:52.028ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 7db95b27-2d07-4069-812b-f1de5b155721 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
69132025-03-01T01:21:52.029ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 7db95b27-2d07-4069-812b-f1de5b155721 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
69142025-03-01T01:21:52.030ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2038 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 7db95b27-2d07-4069-812b-f1de5b155721 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
69152025-03-01T01:21:53.049ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = b5f832b4-bb10-49a5-96bc-f41dd5a14e85 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
69162025-03-01T01:21:53.049ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = b5f832b4-bb10-49a5-96bc-f41dd5a14e85 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
69172025-03-01T01:21:53.051ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1926 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = b5f832b4-bb10-49a5-96bc-f41dd5a14e85 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
69182025-03-01T01:21:53.214ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 10 reason = Timeout
69192025-03-01T01:21:53.214ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 15 reason = Timeout
69202025-03-01T01:21:53.214ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
69212025-03-01T01:21:53.214ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 9 reason = Timeout
69222025-03-01T01:21:53.214ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 15 reason = Timeout
69232025-03-01T01:21:53.214ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7
69242025-03-01T01:21:53.214ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
69252025-03-01T01:21:53.214ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 20.01\u{b5}s iteration = 9 status = {"enabled":false,"target_id":"8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7"}
69262025-03-01T01:21:53.214ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 15 reason = Timeout
69272025-03-01T01:21:53.214ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 43 reason = Timeout
69282025-03-01T01:21:53.214ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
69292025-03-01T01:21:53.214ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
69302025-03-01T01:21:53.214ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
69312025-03-01T01:21:53.214ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69322025-03-01T01:21:53.214ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 15 reason = Timeout
69332025-03-01T01:21:53.214ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 15 reason = Timeout
69342025-03-01T01:21:53.214ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
69352025-03-01T01:21:53.214ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 8 reason = Timeout
69362025-03-01T01:21:53.214ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-03-01 01:11:53.214426557 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
69372025-03-01T01:21:53.214ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 8 reason = Timeout
69382025-03-01T01:21:53.214ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
69392025-03-01T01:21:53.214ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 15 reason = Timeout
69402025-03-01T01:21:53.214ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
69412025-03-01T01:21:53.214ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
69422025-03-01T01:21:53.214ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 15 reason = Timeout
69432025-03-01T01:21:53.214ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69442025-03-01T01:21:53.214ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
69452025-03-01T01:21:53.214ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 15 reason = Timeout
69462025-03-01T01:21:53.214ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
69472025-03-01T01:21:53.214ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 8 reason = Timeout
69482025-03-01T01:21:53.214ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 15 reason = Timeout
69492025-03-01T01:21:53.214ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
69502025-03-01T01:21:53.214ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 8 reason = Timeout
69512025-03-01T01:21:53.214ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
69522025-03-01T01:21:53.214ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 8 reason = Timeout
69532025-03-01T01:21:53.214ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
69542025-03-01T01:21:53.214ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
69552025-03-01T01:21:53.214ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 8 reason = Timeout
69562025-03-01T01:21:53.214ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
69572025-03-01T01:21:53.214ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 15 reason = Timeout
69582025-03-01T01:21:53.214ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
69592025-03-01T01:21:53.214ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 10 reason = Timeout
69602025-03-01T01:21:53.214ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 15 reason = Timeout
69612025-03-01T01:21:53.214ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
69622025-03-01T01:21:53.214ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 8 reason = Timeout
69632025-03-01T01:21:53.214ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 8 reason = Timeout
69642025-03-01T01:21:53.214ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
69652025-03-01T01:21:53.214ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 15 reason = Timeout
69662025-03-01T01:21:53.214ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
69672025-03-01T01:21:53.214ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 16 reason = Timeout
69682025-03-01T01:21:53.214ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
69692025-03-01T01:21:53.214ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 43 reason = Timeout
69702025-03-01T01:21:53.214ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 15 reason = Timeout
69712025-03-01T01:21:53.214ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
69722025-03-01T01:21:53.214ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
69732025-03-01T01:21:53.214ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 8 reason = Timeout
69742025-03-01T01:21:53.214ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
69752025-03-01T01:21:53.214ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
69762025-03-01T01:21:53.214ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 15 reason = Timeout
69772025-03-01T01:21:53.214ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
69782025-03-01T01:21:53.214ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 8 reason = Timeout
69792025-03-01T01:21:53.214ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 15 reason = Timeout
69802025-03-01T01:21:53.214ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
69812025-03-01T01:21:53.214ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
69822025-03-01T01:21:53.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
69832025-03-01T01:21:53.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
69842025-03-01T01:21:53.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69852025-03-01T01:21:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
69862025-03-01T01:21:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
69872025-03-01T01:21:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69882025-03-01T01:21:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
69892025-03-01T01:21:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
69902025-03-01T01:21:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
69912025-03-01T01:21:53.215ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2e37f4af-57dc-468e-80e3-cf2aea2ffdc8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5f6eb3bd-0126-40e0-98ef-ee33df084158.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("5f6eb3bd-0126-40e0-98ef-ee33df084158.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1323, tv_nsec: 902848506 } })
69922025-03-01T01:21:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
69932025-03-01T01:21:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
69942025-03-01T01:21:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
69952025-03-01T01:21:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
69962025-03-01T01:21:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
69972025-03-01T01:21:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
69982025-03-01T01:21:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
69992025-03-01T01:21:53.215ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("3a9b8294-d9f3-4130-a669-e74c6f1f65a0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("450e8d93-9ed3-4721-9fe9-42521f60bc93.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a4f72c78-99c6-478d-b490-f7d8793d4173.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("a4f72c78-99c6-478d-b490-f7d8793d4173.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1323, tv_nsec: 902969738 } })
70002025-03-01T01:21:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
70012025-03-01T01:21:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
70022025-03-01T01:21:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
70032025-03-01T01:21:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
70042025-03-01T01:21:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
70052025-03-01T01:21:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
70062025-03-01T01:21:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
70072025-03-01T01:21:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
70082025-03-01T01:21:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
70092025-03-01T01:21:53.215ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
70102025-03-01T01:21:53.215ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.117422ms iteration = 8 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
70112025-03-01T01:21:53.215ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
70122025-03-01T01:21:53.215ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.158444ms iteration = 8 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
70132025-03-01T01:21:53.217ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1323, tv_nsec: 905305465 } })
70142025-03-01T01:21:53.217ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1154
70152025-03-01T01:21:53.218ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.715766ms iteration = 15 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
70162025-03-01T01:21:53.218ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70172025-03-01T01:21:53.218ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
70182025-03-01T01:21:53.218ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
70192025-03-01T01:21:53.218ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
70202025-03-01T01:21:53.218ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70212025-03-01T01:21:53.218ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
70222025-03-01T01:21:53.219ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70232025-03-01T01:21:53.219ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70242025-03-01T01:21:53.220ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-03-01 01:11:53.214426557 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
70252025-03-01T01:21:53.220ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 5.611075ms iteration = 8 status = {"expiration":"2025-03-01T01:11:53.214426557Z","pruned":[]}
70262025-03-01T01:21:53.222ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
70272025-03-01T01:21:53.222ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70282025-03-01T01:21:53.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70292025-03-01T01:21:53.222ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
70302025-03-01T01:21:53.222ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
70312025-03-01T01:21:53.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
70322025-03-01T01:21:53.222ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
70332025-03-01T01:21:53.222ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
70342025-03-01T01:21:53.222ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
70352025-03-01T01:21:53.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
70362025-03-01T01:21:53.222ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
70372025-03-01T01:21:53.223ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
70382025-03-01T01:21:53.223ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
70392025-03-01T01:21:53.223ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
70402025-03-01T01:21:53.224ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70412025-03-01T01:21:53.225ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1323, tv_nsec: 913661346 } })
70422025-03-01T01:21:53.226ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
70432025-03-01T01:21:53.226ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
70442025-03-01T01:21:53.226ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1154
70452025-03-01T01:21:53.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
70462025-03-01T01:21:53.227ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
70472025-03-01T01:21:53.227ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 13.385222ms iteration = 15 status = {"errors":[],"garbage_collect_requested":[]}
70482025-03-01T01:21:53.228ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 13.631638ms iteration = 8 status = {"errors":[],"found_port_ok":[]}
70492025-03-01T01:21:53.228ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
70502025-03-01T01:21:53.228ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70512025-03-01T01:21:53.229ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
70522025-03-01T01:21:53.229ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
70532025-03-01T01:21:53.230ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70542025-03-01T01:21:53.230ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
70552025-03-01T01:21:53.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
70562025-03-01T01:21:53.231ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
70572025-03-01T01:21:53.231ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
70582025-03-01T01:21:53.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
70592025-03-01T01:21:53.233ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
70602025-03-01T01:21:53.233ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
70612025-03-01T01:21:53.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
70622025-03-01T01:21:53.234ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70632025-03-01T01:21:53.236ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
70642025-03-01T01:21:53.236ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
70652025-03-01T01:21:53.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
70662025-03-01T01:21:53.238ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70672025-03-01T01:21:53.239ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
70682025-03-01T01:21:53.239ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
70692025-03-01T01:21:53.239ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
70702025-03-01T01:21:53.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
70712025-03-01T01:21:53.239ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70722025-03-01T01:21:53.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70732025-03-01T01:21:53.240ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
70742025-03-01T01:21:53.240ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
70752025-03-01T01:21:53.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
70762025-03-01T01:21:53.242ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70772025-03-01T01:21:53.242ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70782025-03-01T01:21:53.243ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
70792025-03-01T01:21:53.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
70802025-03-01T01:21:53.244ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1323, tv_nsec: 932140392 } })
70812025-03-01T01:21:53.244ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
70822025-03-01T01:21:53.244ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
70832025-03-01T01:21:53.244ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1154 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66
70842025-03-01T01:21:53.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
70852025-03-01T01:21:53.245ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
70862025-03-01T01:21:53.246ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.688325ms iteration = 43 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
70872025-03-01T01:21:53.246ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70882025-03-01T01:21:53.247ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
70892025-03-01T01:21:53.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
70902025-03-01T01:21:53.248ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
70912025-03-01T01:21:53.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
70922025-03-01T01:21:53.249ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
70932025-03-01T01:21:53.250ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
70942025-03-01T01:21:53.250ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
70952025-03-01T01:21:53.250ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
70962025-03-01T01:21:53.250ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
70972025-03-01T01:21:53.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
70982025-03-01T01:21:53.251ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70992025-03-01T01:21:53.253ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71002025-03-01T01:21:53.253ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71012025-03-01T01:21:53.253ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71022025-03-01T01:21:53.254ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7, lookup_type: ById(8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7) } result = Ok(())
71032025-03-01T01:21:53.254ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71042025-03-01T01:21:53.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71052025-03-01T01:21:53.256ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
71062025-03-01T01:21:53.256ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
71072025-03-01T01:21:53.256ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
71082025-03-01T01:21:53.256ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 41.813031ms iteration = 8 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
71092025-03-01T01:21:53.256ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
71102025-03-01T01:21:53.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
71112025-03-01T01:21:53.257ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
71122025-03-01T01:21:53.257ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
71132025-03-01T01:21:53.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
71142025-03-01T01:21:53.259ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
71152025-03-01T01:21:53.259ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
71162025-03-01T01:21:53.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
71172025-03-01T01:21:53.261ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
71182025-03-01T01:21:53.261ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = cce65e3e-6c86-4cdd-98ad-9a38c98082e8 dns_zone_name = oxide.test found_so_far = 0 version = 2
71192025-03-01T01:21:53.261ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
71202025-03-01T01:21:53.261ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
71212025-03-01T01:21:53.264ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71222025-03-01T01:21:53.269ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
71232025-03-01T01:21:53.269ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
71242025-03-01T01:21:53.270ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
71252025-03-01T01:21:53.271ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = cce65e3e-6c86-4cdd-98ad-9a38c98082e8 dns_zone_name = oxide.test found_so_far = 1 version = 2
71262025-03-01T01:21:53.271ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
71272025-03-01T01:21:53.271ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-03-01 01:14:54.679503 UTC dns_group = external generation = 2
71282025-03-01T01:21:53.271ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 57.232535ms iteration = 8 status = {"generation":2}
71292025-03-01T01:21:53.272ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 57.828318ms iteration = 15 status = {"errors":[],"finish_invoked_ok":[]}
71302025-03-01T01:21:53.272ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
71312025-03-01T01:21:53.273ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
71322025-03-01T01:21:53.281ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
71332025-03-01T01:21:53.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
71342025-03-01T01:21:53.283ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
71352025-03-01T01:21:53.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
71362025-03-01T01:21:53.285ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 original_time_created = 2025-03-01 01:14:50.436545 UTC target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 time_created = 2025-03-01 01:14:50.436545 UTC
71372025-03-01T01:21:53.285ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 70.930585ms iteration = 43 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7","time_created":"2025-03-01T01:14:50.436545Z"}
71382025-03-01T01:21:53.290ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
71392025-03-01T01:21:53.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
71402025-03-01T01:21:53.293ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71412025-03-01T01:21:53.295ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 81.054872ms iteration = 15 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
71422025-03-01T01:21:53.295ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
71432025-03-01T01:21:53.295ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
71442025-03-01T01:21:53.295ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
71452025-03-01T01:21:53.295ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
71462025-03-01T01:21:53.296ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
71472025-03-01T01:21:53.297ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71482025-03-01T01:21:53.297ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 3471264f-127e-4a25-bc10-2e8249e8d70a, lookup_type: ById(3471264f-127e-4a25-bc10-2e8249e8d70a) } result = Ok(())
71492025-03-01T01:21:53.297ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
71502025-03-01T01:21:53.297ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
71512025-03-01T01:21:53.297ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
71522025-03-01T01:21:53.298ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
71532025-03-01T01:21:53.299ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
71542025-03-01T01:21:53.299ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 84.702235ms iteration = 15 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
71552025-03-01T01:21:53.300ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 85.672935ms iteration = 15 status = 0
71562025-03-01T01:21:53.300ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71572025-03-01T01:21:53.301ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
71582025-03-01T01:21:53.301ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
71592025-03-01T01:21:53.301ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 86.576224ms iteration = 8 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
71602025-03-01T01:21:53.301ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
71612025-03-01T01:21:53.301ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
71622025-03-01T01:21:53.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
71632025-03-01T01:21:53.303ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
71642025-03-01T01:21:53.303ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
71652025-03-01T01:21:53.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
71662025-03-01T01:21:53.305ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
71672025-03-01T01:21:53.305ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 90.749668ms iteration = 15 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
71682025-03-01T01:21:53.307ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
71692025-03-01T01:21:53.307ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
71702025-03-01T01:21:53.307ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 92.745489ms iteration = 15 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
71712025-03-01T01:21:53.312ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
71722025-03-01T01:21:53.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
71732025-03-01T01:21:53.314ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71742025-03-01T01:21:53.316ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
71752025-03-01T01:21:53.316ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
71762025-03-01T01:21:53.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
71772025-03-01T01:21:53.317ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
71782025-03-01T01:21:53.317ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
71792025-03-01T01:21:53.319ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 104.984099ms iteration = 16 status = {"physical_disks_added":0}
71802025-03-01T01:21:53.319ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 105.228414ms iteration = 15 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
71812025-03-01T01:21:53.324ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 109.320257ms iteration = 15 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
71822025-03-01T01:21:53.324ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
71832025-03-01T01:21:53.324ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
71842025-03-01T01:21:53.336ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
71852025-03-01T01:21:53.336ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 0a9e4b5c-53a1-4f0a-8849-98a8b1852af3 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
71862025-03-01T01:21:53.336ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
71872025-03-01T01:21:53.336ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
71882025-03-01T01:21:53.337ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71892025-03-01T01:21:53.340ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
71902025-03-01T01:21:53.340ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
71912025-03-01T01:21:53.340ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
71922025-03-01T01:21:53.344ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 0a9e4b5c-53a1-4f0a-8849-98a8b1852af3 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
71932025-03-01T01:21:53.344ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
71942025-03-01T01:21:53.344ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-03-01 01:14:53.460216 UTC dns_group = internal generation = 1
71952025-03-01T01:21:53.344ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 129.61005ms iteration = 8 status = {"generation":1}
71962025-03-01T01:21:53.350ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
71972025-03-01T01:21:53.365ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-03-01T01:14:49.537343Z, time_modified: 2025-03-01T01:14:49.537343Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 1682a303-6254-452b-b4cf-160ed9dc3fc9, db_silo: Silo { identity: SiloIdentity { id: 1682a303-6254-452b-b4cf-160ed9dc3fc9, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-03-01T01:14:54.631650Z, time_modified: 2025-03-01T01:14:54.631650Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "851c0b739689cfb98a2e401e6047fa98e9fcc283d9fc3f660bd69842a9c06be9" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 1682a303-6254-452b-b4cf-160ed9dc3fc9, db_silo: Silo { identity: SiloIdentity { id: 1682a303-6254-452b-b4cf-160ed9dc3fc9, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-03-01T01:14:54.631650Z, time_modified: 2025-03-01T01:14:54.631650Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "851c0b739689cfb98a2e401e6047fa98e9fcc283d9fc3f660bd69842a9c06be9" }] }) }
71982025-03-01T01:21:53.365ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 150.627678ms iteration = 8 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"1682a303-6254-452b-b4cf-160ed9dc3fc9","tls_certs":["851c0b739689cfb98a2e401e6047fa98e9fcc283d9fc3f660bd69842a9c06be9"]}},"default_endpoint":{"silo_id":"1682a303-6254-452b-b4cf-160ed9dc3fc9","tls_certs":["851c0b739689cfb98a2e401e6047fa98e9fcc283d9fc3f660bd69842a9c06be9"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
71992025-03-01T01:21:53.371ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
72002025-03-01T01:21:53.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
72012025-03-01T01:21:53.393ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
72022025-03-01T01:21:53.393ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
72032025-03-01T01:21:53.393ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4261c30d-0b2e-4dfe-ad59-369dbd1d64af", "content-length": "26", "date": "Sat, 01 Mar 2025 01:21:53 GMT"} })
72042025-03-01T01:21:53.393ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
72052025-03-01T01:21:53.396ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
72062025-03-01T01:21:53.397ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
72072025-03-01T01:21:53.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
72082025-03-01T01:21:53.414ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
72092025-03-01T01:21:53.414ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 199.662617ms iteration = 8 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
72102025-03-01T01:21:53.423ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1162 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 zone_address = fd00:1122:3344:101::2
72112025-03-01T01:21:53.423ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
72122025-03-01T01:21:53.423ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "eecaa6fa-5d0d-4cac-a31c-4789feea13da", "content-length": "26", "date": "Sat, 01 Mar 2025 01:21:53 GMT"} })
72132025-03-01T01:21:53.424ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1167 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
72142025-03-01T01:21:53.427ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66
72152025-03-01T01:21:53.547ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
72162025-03-01T01:21:53.547ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "9cda3dae-df44-4324-89c5-735198f046ae", "date": "Sat, 01 Mar 2025 01:21:53 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
72172025-03-01T01:21:53.547ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
72182025-03-01T01:21:53.548ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "57917c98-b49e-411b-afee-cfcc0282e339", "date": "Sat, 01 Mar 2025 01:21:53 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
72192025-03-01T01:21:53.548ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
72202025-03-01T01:21:53.549ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
72212025-03-01T01:21:53.549ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 335.457594ms iteration = 10 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
72222025-03-01T01:21:53.568ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
72232025-03-01T01:21:53.571ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
72242025-03-01T01:21:53.571ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "6268b13e-9526-4a23-b9bf-b3396bb64d17", "content-length": "2", "date": "Sat, 01 Mar 2025 01:21:52 GMT"} })
72252025-03-01T01:21:53.572ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
72262025-03-01T01:21:53.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
72272025-03-01T01:21:53.601ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
72282025-03-01T01:21:53.601ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
72292025-03-01T01:21:53.601ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "867b9989-dd38-4219-8e67-0a68cad7ee21", "content-length": "26", "date": "Sat, 01 Mar 2025 01:21:53 GMT"} })
72302025-03-01T01:21:53.601ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
72312025-03-01T01:21:53.603ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
72322025-03-01T01:21:53.712ZINFOnexus (BackgroundTasks): VPC route manager sled 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
72332025-03-01T01:21:53.712ZDEBGnexus (BackgroundTasks): client request SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
72342025-03-01T01:21:53.712ZDEBGnexus (BackgroundTasks): client response SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "e8d2d831-6c56-430f-a007-229602ece2b2", "content-length": "372", "date": "Sat, 01 Mar 2025 01:21:53 GMT"} })
72352025-03-01T01:21:53.712ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
72362025-03-01T01:21:53.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72372025-03-01T01:21:53.714ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72382025-03-01T01:21:53.714ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 500.028746ms iteration = 15 status = null
72392025-03-01T01:21:53.715ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
72402025-03-01T01:21:53.715ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
72412025-03-01T01:21:53.716ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
72422025-03-01T01:21:53.717ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72432025-03-01T01:21:53.719ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
72442025-03-01T01:21:53.719ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
72452025-03-01T01:21:53.719ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
72462025-03-01T01:21:53.724ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 510.618362ms iteration = 15 status = {}
72472025-03-01T01:21:53.761ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
72482025-03-01T01:21:53.761ZDEBGnexus (BackgroundTasks): client request SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
72492025-03-01T01:21:53.761ZDEBGnexus (BackgroundTasks): client response SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "1c2baf4c-563c-42fa-b887-ec86e7be9c46", "date": "Sat, 01 Mar 2025 01:21:53 GMT"} })
72502025-03-01T01:21:53.761ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
72512025-03-01T01:21:53.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72522025-03-01T01:21:53.763ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
72532025-03-01T01:21:53.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72542025-03-01T01:21:53.766ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
72552025-03-01T01:21:53.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72562025-03-01T01:21:53.768ZINFOnexus (BackgroundTasks): VPC route manager sled 3471264f-127e-4a25-bc10-2e8249e8d70a push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
72572025-03-01T01:21:53.768ZDEBGnexus (BackgroundTasks): client request SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
72582025-03-01T01:21:53.769ZDEBGnexus (BackgroundTasks): client response SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "45ccc4dd-cf47-40da-80f1-97a9fff33b26", "date": "Sat, 01 Mar 2025 01:21:53 GMT"} })
72592025-03-01T01:21:53.770ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 556.281271ms iteration = 15 status = {}
72602025-03-01T01:21:53.794ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
72612025-03-01T01:21:53.805ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72622025-03-01T01:21:53.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72632025-03-01T01:21:53.807ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 7f9c3c14-58c5-473f-8692-6376be44401e, rack_id: 4854cb88-dfba-4609-8f9d-72aac08cef66, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(cb10d0c6-a704-4231-b148-4f9ae21a03f8) } rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 switch_location = Switch0
72642025-03-01T01:21:53.807ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72652025-03-01T01:21:53.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72662025-03-01T01:21:53.879ZDEBGnexus (BackgroundTasks): client request SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
72672025-03-01T01:21:53.886ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
72682025-03-01T01:21:53.886ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "d9c34b0c-1abb-456f-a6d0-aed7a31775ef", "content-length": "134", "date": "Sat, 01 Mar 2025 01:21:53 GMT"} })
72692025-03-01T01:21:53.886ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
72702025-03-01T01:21:53.886ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = cb10d0c6-a704-4231-b148-4f9ae21a03f8
72712025-03-01T01:21:53.887ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
72722025-03-01T01:21:53.887ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
72732025-03-01T01:21:53.887ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
72742025-03-01T01:21:53.887ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
72752025-03-01T01:21:53.887ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
72762025-03-01T01:21:53.887ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
72772025-03-01T01:21:53.887ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
72782025-03-01T01:21:53.887ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
72792025-03-01T01:21:53.887ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66
72802025-03-01T01:21:53.887ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72812025-03-01T01:21:53.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72822025-03-01T01:21:53.889ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
72832025-03-01T01:21:53.889ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "d89f5831-ff9c-4da7-9b67-04b1449572ae", "content-length": "2", "date": "Sat, 01 Mar 2025 01:21:53 GMT"} })
72842025-03-01T01:21:53.889ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
72852025-03-01T01:21:53.889ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "30561afd-859c-4788-a6d0-c4267d5c17a1", "content-length": "52", "date": "Sat, 01 Mar 2025 01:21:53 GMT"} })
72862025-03-01T01:21:53.889ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 switch_location = Switch0
72872025-03-01T01:21:53.889ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
72882025-03-01T01:21:53.893ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
72892025-03-01T01:21:53.894ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "7d2f8c21-94c8-4a39-b0f2-eb5eee5db028", "date": "Sat, 01 Mar 2025 01:21:53 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
72902025-03-01T01:21:53.894ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
72912025-03-01T01:21:53.895ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "3b94d359-5844-4fd8-ac07-96d4db9960a3", "date": "Sat, 01 Mar 2025 01:21:53 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
72922025-03-01T01:21:53.895ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
72932025-03-01T01:21:53.897ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "aeae445d-3271-4fa1-bd5a-ae0ec558578d", "date": "Sat, 01 Mar 2025 01:21:53 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
72942025-03-01T01:21:53.897ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
72952025-03-01T01:21:53.898ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
72962025-03-01T01:21:53.898ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 684.3517ms iteration = 10 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
72972025-03-01T01:21:53.962ZDEBGnexus (BackgroundTasks): client response SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "71f77e82-ae5e-47d7-9746-c169589005dc", "content-length": "691", "date": "Sat, 01 Mar 2025 01:21:53 GMT"} })
72982025-03-01T01:21:53.962ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
72992025-03-01T01:21:53.962ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
73002025-03-01T01:21:53.962ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
73012025-03-01T01:21:53.963ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 748.964007ms iteration = 15 status = {}
73022025-03-01T01:21:54.058ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "1ea6c7eb-885e-4740-937b-e13e49852b26", "date": "Sat, 01 Mar 2025 01:21:53 GMT"} })
73032025-03-01T01:21:54.058ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 switch = Switch0
73042025-03-01T01:21:54.058ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
73052025-03-01T01:21:54.058ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "f583c0dd-1ada-4744-9323-8e9ee80fdcbc", "content-length": "682", "date": "Sat, 01 Mar 2025 01:21:53 GMT"} })
73062025-03-01T01:21:54.058ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
73072025-03-01T01:21:54.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
73082025-03-01T01:21:54.061ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
73092025-03-01T01:21:54.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
73102025-03-01T01:21:54.064ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
73112025-03-01T01:21:54.064ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
73122025-03-01T01:21:54.066ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
73132025-03-01T01:21:54.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
73142025-03-01T01:21:54.073ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 858.917666ms iteration = 15 status = {}
73152025-03-01T01:21:54.074ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 25a30656-b440-4ad1-b7d7-fde6d534a5f2 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
73162025-03-01T01:21:54.074ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 25a30656-b440-4ad1-b7d7-fde6d534a5f2 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
73172025-03-01T01:21:54.076ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1763 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 25a30656-b440-4ad1-b7d7-fde6d534a5f2 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
73182025-03-01T01:21:55.096ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 7c6e9d1a-21fc-4efb-a259-a47153b7d5a9 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
73192025-03-01T01:21:55.096ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 7c6e9d1a-21fc-4efb-a259-a47153b7d5a9 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
73202025-03-01T01:21:55.098ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2246 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 7c6e9d1a-21fc-4efb-a259-a47153b7d5a9 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
73212025-03-01T01:21:56.118ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 4d657946-a07e-4c94-a3e8-ecb0c6552132 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
73222025-03-01T01:21:56.118ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 4d657946-a07e-4c94-a3e8-ecb0c6552132 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
73232025-03-01T01:21:56.120ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1971 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 4d657946-a07e-4c94-a3e8-ecb0c6552132 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
73242025-03-01T01:21:57.139ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 776482ee-f33b-4f18-97e2-bed1d81ccc8a roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
73252025-03-01T01:21:57.139ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 776482ee-f33b-4f18-97e2-bed1d81ccc8a resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
73262025-03-01T01:21:57.141ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1767 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 776482ee-f33b-4f18-97e2-bed1d81ccc8a response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
73272025-03-01T01:21:57.414ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 322 local_addr = [fd00:1122:3344:101::c]:34357 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = 2d9d5a07-7341-4621-b349-ed8997257236 response_code = 200 uri = /67b03f4e-4cbd-4843-9cd9-647f610abcfc
73282025-03-01T01:21:58.160ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 8a0b52b9-1948-4347-90e1-e92ddaff0e1c roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
73292025-03-01T01:21:58.160ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 8a0b52b9-1948-4347-90e1-e92ddaff0e1c resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
73302025-03-01T01:21:58.164ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3961 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 8a0b52b9-1948-4347-90e1-e92ddaff0e1c response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
73312025-03-01T01:21:59.185ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 38260ed5-048e-4431-88ba-e643073e51a2 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
73322025-03-01T01:21:59.185ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 38260ed5-048e-4431-88ba-e643073e51a2 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
73332025-03-01T01:21:59.187ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2453 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 38260ed5-048e-4431-88ba-e643073e51a2 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
73342025-03-01T01:22:00.207ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 5296488e-1cc7-495a-b847-7893e8a1e3d6 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
73352025-03-01T01:22:00.208ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 5296488e-1cc7-495a-b847-7893e8a1e3d6 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
73362025-03-01T01:22:00.209ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1817 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 5296488e-1cc7-495a-b847-7893e8a1e3d6 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
73372025-03-01T01:22:01.229ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 685aaf9c-bbda-4214-9ec4-7b898ac52ad7 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
73382025-03-01T01:22:01.230ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 685aaf9c-bbda-4214-9ec4-7b898ac52ad7 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
73392025-03-01T01:22:01.231ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2003 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 685aaf9c-bbda-4214-9ec4-7b898ac52ad7 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
73402025-03-01T01:22:02.253ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 4b4255b5-956e-4bce-b7fb-06ae5e1b8aca roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
73412025-03-01T01:22:02.253ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 4b4255b5-956e-4bce-b7fb-06ae5e1b8aca resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
73422025-03-01T01:22:02.254ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1615 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 4b4255b5-956e-4bce-b7fb-06ae5e1b8aca response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
73432025-03-01T01:22:03.214ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 44 reason = Timeout
73442025-03-01T01:22:03.214ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 44 reason = Timeout
73452025-03-01T01:22:03.214ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73462025-03-01T01:22:03.214ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
73472025-03-01T01:22:03.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73482025-03-01T01:22:03.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
73492025-03-01T01:22:03.217ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73502025-03-01T01:22:03.217ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
73512025-03-01T01:22:03.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
73522025-03-01T01:22:03.219ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
73532025-03-01T01:22:03.219ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73542025-03-01T01:22:03.219ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.983121ms iteration = 44 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
73552025-03-01T01:22:03.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73562025-03-01T01:22:03.220ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73572025-03-01T01:22:03.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73582025-03-01T01:22:03.222ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73592025-03-01T01:22:03.225ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7, lookup_type: ById(8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7) } result = Ok(())
73602025-03-01T01:22:03.225ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73612025-03-01T01:22:03.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73622025-03-01T01:22:03.234ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 original_time_created = 2025-03-01 01:14:50.436545 UTC target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 time_created = 2025-03-01 01:14:50.436545 UTC
73632025-03-01T01:22:03.234ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.847375ms iteration = 44 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7","time_created":"2025-03-01T01:14:50.436545Z"}
73642025-03-01T01:22:03.273ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 9b9c0cf2-d61b-43e2-9d3a-6a45268a036e roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
73652025-03-01T01:22:03.273ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 9b9c0cf2-d61b-43e2-9d3a-6a45268a036e resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
73662025-03-01T01:22:03.275ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2177 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 9b9c0cf2-d61b-43e2-9d3a-6a45268a036e response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
73672025-03-01T01:22:04.294ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 68715195-fc3c-4207-9a6c-4fb0a55d74ef roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
73682025-03-01T01:22:04.295ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 68715195-fc3c-4207-9a6c-4fb0a55d74ef resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
73692025-03-01T01:22:04.296ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1951 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 68715195-fc3c-4207-9a6c-4fb0a55d74ef response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
73702025-03-01T01:22:05.316ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = fd5db1cd-4f5e-461c-b52d-ea834ce64cee roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
73712025-03-01T01:22:05.317ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = fd5db1cd-4f5e-461c-b52d-ea834ce64cee resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
73722025-03-01T01:22:05.319ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2253 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = fd5db1cd-4f5e-461c-b52d-ea834ce64cee response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
73732025-03-01T01:22:06.339ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = a03e736f-55f9-4de5-a81e-fc5a4aee8722 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
73742025-03-01T01:22:06.339ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = a03e736f-55f9-4de5-a81e-fc5a4aee8722 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
73752025-03-01T01:22:06.341ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2148 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = a03e736f-55f9-4de5-a81e-fc5a4aee8722 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
73762025-03-01T01:22:07.359ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 1f66e163-1376-4955-a342-46d31d105d55 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
73772025-03-01T01:22:07.360ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 1f66e163-1376-4955-a342-46d31d105d55 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
73782025-03-01T01:22:07.362ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2366 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 1f66e163-1376-4955-a342-46d31d105d55 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
73792025-03-01T01:22:07.407ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61177 req_id = f81d1ce4-517f-4932-b17b-90173dc7f3db roles = RoleSet { roles: {} } uri = /metrics/collectors/d77aa5d6-e6f9-4845-b1d4-57f91a3621e6/producers?sort_by=id_ascending
73802025-03-01T01:22:07.408ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61177 req_id = f81d1ce4-517f-4932-b17b-90173dc7f3db resource = Database result = Ok(()) uri = /metrics/collectors/d77aa5d6-e6f9-4845-b1d4-57f91a3621e6/producers?sort_by=id_ascending
73812025-03-01T01:22:07.410ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2343 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61177 req_id = f81d1ce4-517f-4932-b17b-90173dc7f3db response_code = 200 uri = /metrics/collectors/d77aa5d6-e6f9-4845-b1d4-57f91a3621e6/producers?sort_by=id_ascending
73822025-03-01T01:22:07.410ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61177 req_id = f4f6d55a-d64d-4089-a8ba-26b8b082464e roles = RoleSet { roles: {} } uri = /metrics/collectors/d77aa5d6-e6f9-4845-b1d4-57f91a3621e6/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYmI0ODUwMS0zYzRlLTRkNDQtODgyMy1mOTc1ZTg2OTFmZmYifX0%3D
73832025-03-01T01:22:07.410ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61177 req_id = f4f6d55a-d64d-4089-a8ba-26b8b082464e resource = Database result = Ok(()) uri = /metrics/collectors/d77aa5d6-e6f9-4845-b1d4-57f91a3621e6/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYmI0ODUwMS0zYzRlLTRkNDQtODgyMy1mOTc1ZTg2OTFmZmYifX0%3D
73842025-03-01T01:22:07.412ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2048 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61177 req_id = f4f6d55a-d64d-4089-a8ba-26b8b082464e response_code = 200 uri = /metrics/collectors/d77aa5d6-e6f9-4845-b1d4-57f91a3621e6/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYmI0ODUwMS0zYzRlLTRkNDQtODgyMy1mOTc1ZTg2OTFmZmYifX0%3D
73852025-03-01T01:22:07.414ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 290 local_addr = [fd00:1122:3344:101::c]:34357 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = f916915f-abcd-413b-b68a-16d45f8974da response_code = 200 uri = /67b03f4e-4cbd-4843-9cd9-647f610abcfc
73862025-03-01T01:22:08.381ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = b6530e80-c366-47ad-b802-138902d58bdc roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
73872025-03-01T01:22:08.381ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = b6530e80-c366-47ad-b802-138902d58bdc resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
73882025-03-01T01:22:08.383ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1973 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = b6530e80-c366-47ad-b802-138902d58bdc response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
73892025-03-01T01:22:09.403ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 2f0ef452-c6fe-4eb7-8f77-14b2430276da roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
73902025-03-01T01:22:09.404ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 2f0ef452-c6fe-4eb7-8f77-14b2430276da resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
73912025-03-01T01:22:09.405ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1973 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 2f0ef452-c6fe-4eb7-8f77-14b2430276da response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
73922025-03-01T01:22:10.426ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 64939ee1-35a8-4a8f-a571-cbb674bd2604 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
73932025-03-01T01:22:10.426ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 64939ee1-35a8-4a8f-a571-cbb674bd2604 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
73942025-03-01T01:22:10.428ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2312 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 64939ee1-35a8-4a8f-a571-cbb674bd2604 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
73952025-03-01T01:22:11.448ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = a98bd508-1cb1-4d25-a766-fc7e4bdeb7ba roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
73962025-03-01T01:22:11.449ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = a98bd508-1cb1-4d25-a766-fc7e4bdeb7ba resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
73972025-03-01T01:22:11.450ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2258 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = a98bd508-1cb1-4d25-a766-fc7e4bdeb7ba response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
73982025-03-01T01:22:12.470ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = b0e936d8-2b07-4403-873c-83b66e9b82cf roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
73992025-03-01T01:22:12.471ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = b0e936d8-2b07-4403-873c-83b66e9b82cf resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
74002025-03-01T01:22:12.472ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2181 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = b0e936d8-2b07-4403-873c-83b66e9b82cf response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
74012025-03-01T01:22:13.214ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 45 reason = Timeout
74022025-03-01T01:22:13.214ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 45 reason = Timeout
74032025-03-01T01:22:13.214ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74042025-03-01T01:22:13.214ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
74052025-03-01T01:22:13.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
74062025-03-01T01:22:13.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74072025-03-01T01:22:13.215ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
74082025-03-01T01:22:13.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
74092025-03-01T01:22:13.216ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74102025-03-01T01:22:13.217ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.392599ms iteration = 45 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
74112025-03-01T01:22:13.219ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
74122025-03-01T01:22:13.219ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74132025-03-01T01:22:13.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74142025-03-01T01:22:13.221ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74152025-03-01T01:22:13.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74162025-03-01T01:22:13.223ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74172025-03-01T01:22:13.225ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7, lookup_type: ById(8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7) } result = Ok(())
74182025-03-01T01:22:13.225ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74192025-03-01T01:22:13.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74202025-03-01T01:22:13.234ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 original_time_created = 2025-03-01 01:14:50.436545 UTC target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 time_created = 2025-03-01 01:14:50.436545 UTC
74212025-03-01T01:22:13.234ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.186231ms iteration = 45 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7","time_created":"2025-03-01T01:14:50.436545Z"}
74222025-03-01T01:22:13.492ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = e3af3899-709e-46c2-afe8-bbae8e829df3 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
74232025-03-01T01:22:13.493ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = e3af3899-709e-46c2-afe8-bbae8e829df3 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
74242025-03-01T01:22:13.494ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1737 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = e3af3899-709e-46c2-afe8-bbae8e829df3 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
74252025-03-01T01:22:14.514ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 35ea5b71-3ebb-4069-8ebe-afb246d7811a roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
74262025-03-01T01:22:14.514ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 35ea5b71-3ebb-4069-8ebe-afb246d7811a resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
74272025-03-01T01:22:14.516ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2404 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 35ea5b71-3ebb-4069-8ebe-afb246d7811a response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
74282025-03-01T01:22:15.536ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 50cff576-d5ed-4a2d-ab50-be4ebff08039 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
74292025-03-01T01:22:15.537ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 50cff576-d5ed-4a2d-ab50-be4ebff08039 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
74302025-03-01T01:22:15.538ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2065 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 50cff576-d5ed-4a2d-ab50-be4ebff08039 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
74312025-03-01T01:22:16.558ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 1927333c-0e86-4bc7-a0e5-068bb5c9b4a3 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
74322025-03-01T01:22:16.558ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 1927333c-0e86-4bc7-a0e5-068bb5c9b4a3 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
74332025-03-01T01:22:16.560ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2124 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 1927333c-0e86-4bc7-a0e5-068bb5c9b4a3 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
74342025-03-01T01:22:17.414ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 323 local_addr = [fd00:1122:3344:101::c]:34357 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = 6c127a05-c487-4b8a-842c-99490dab3c7f response_code = 200 uri = /67b03f4e-4cbd-4843-9cd9-647f610abcfc
74352025-03-01T01:22:17.580ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c2acd87c-4b73-4413-8930-09865dd26b6a roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
74362025-03-01T01:22:17.580ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c2acd87c-4b73-4413-8930-09865dd26b6a resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
74372025-03-01T01:22:17.582ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2858 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c2acd87c-4b73-4413-8930-09865dd26b6a response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
74382025-03-01T01:22:18.601ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 2060ba8c-97c3-4359-a670-365490a214c7 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
74392025-03-01T01:22:18.601ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 2060ba8c-97c3-4359-a670-365490a214c7 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
74402025-03-01T01:22:18.603ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1627 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 2060ba8c-97c3-4359-a670-365490a214c7 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
74412025-03-01T01:22:19.623ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 099ccc3f-4d86-4758-aca1-8e98fdeaa0a0 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
74422025-03-01T01:22:19.623ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 099ccc3f-4d86-4758-aca1-8e98fdeaa0a0 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
74432025-03-01T01:22:19.624ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1737 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 099ccc3f-4d86-4758-aca1-8e98fdeaa0a0 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
74442025-03-01T01:22:20.644ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 8d716edf-82e6-4f3f-bcda-f9fe3a2c48a7 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
74452025-03-01T01:22:20.644ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 8d716edf-82e6-4f3f-bcda-f9fe3a2c48a7 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
74462025-03-01T01:22:20.646ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2387 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 8d716edf-82e6-4f3f-bcda-f9fe3a2c48a7 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
74472025-03-01T01:22:21.666ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 67bdb62d-e926-4f4e-a2b2-e1ed0760032c roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
74482025-03-01T01:22:21.666ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 67bdb62d-e926-4f4e-a2b2-e1ed0760032c resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
74492025-03-01T01:22:21.668ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2011 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 67bdb62d-e926-4f4e-a2b2-e1ed0760032c response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
74502025-03-01T01:22:22.407ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61177 req_id = ab02ea0d-feb1-4ca2-ad90-a603b202e0b8 roles = RoleSet { roles: {} } uri = /metrics/collectors/d77aa5d6-e6f9-4845-b1d4-57f91a3621e6/producers?sort_by=id_ascending
74512025-03-01T01:22:22.408ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61177 req_id = ab02ea0d-feb1-4ca2-ad90-a603b202e0b8 resource = Database result = Ok(()) uri = /metrics/collectors/d77aa5d6-e6f9-4845-b1d4-57f91a3621e6/producers?sort_by=id_ascending
74522025-03-01T01:22:22.411ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3578 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61177 req_id = ab02ea0d-feb1-4ca2-ad90-a603b202e0b8 response_code = 200 uri = /metrics/collectors/d77aa5d6-e6f9-4845-b1d4-57f91a3621e6/producers?sort_by=id_ascending
74532025-03-01T01:22:22.411ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61177 req_id = 6153ecbb-a9f3-4ff5-9603-871ca7ea4ed0 roles = RoleSet { roles: {} } uri = /metrics/collectors/d77aa5d6-e6f9-4845-b1d4-57f91a3621e6/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYmI0ODUwMS0zYzRlLTRkNDQtODgyMy1mOTc1ZTg2OTFmZmYifX0%3D
74542025-03-01T01:22:22.412ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61177 req_id = 6153ecbb-a9f3-4ff5-9603-871ca7ea4ed0 resource = Database result = Ok(()) uri = /metrics/collectors/d77aa5d6-e6f9-4845-b1d4-57f91a3621e6/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYmI0ODUwMS0zYzRlLTRkNDQtODgyMy1mOTc1ZTg2OTFmZmYifX0%3D
74552025-03-01T01:22:22.414ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2656 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61177 req_id = 6153ecbb-a9f3-4ff5-9603-871ca7ea4ed0 response_code = 200 uri = /metrics/collectors/d77aa5d6-e6f9-4845-b1d4-57f91a3621e6/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYmI0ODUwMS0zYzRlLTRkNDQtODgyMy1mOTc1ZTg2OTFmZmYifX0%3D
74562025-03-01T01:22:22.687ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 937524fa-d066-4027-a115-70ebd6af3097 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
74572025-03-01T01:22:22.687ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 937524fa-d066-4027-a115-70ebd6af3097 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
74582025-03-01T01:22:22.689ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1948 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 937524fa-d066-4027-a115-70ebd6af3097 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
74592025-03-01T01:22:23.214ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 16 reason = Timeout
74602025-03-01T01:22:23.214ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
74612025-03-01T01:22:23.214ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 16 reason = Timeout
74622025-03-01T01:22:23.214ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
74632025-03-01T01:22:23.214ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 46 reason = Timeout
74642025-03-01T01:22:23.214ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
74652025-03-01T01:22:23.214ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 16 reason = Timeout
74662025-03-01T01:22:23.214ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 16 reason = Timeout
74672025-03-01T01:22:23.214ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
74682025-03-01T01:22:23.214ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
74692025-03-01T01:22:23.214ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 17 reason = Timeout
74702025-03-01T01:22:23.214ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 16 reason = Timeout
74712025-03-01T01:22:23.214ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
74722025-03-01T01:22:23.214ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
74732025-03-01T01:22:23.214ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 16 reason = Timeout
74742025-03-01T01:22:23.214ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
74752025-03-01T01:22:23.214ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 16 reason = Timeout
74762025-03-01T01:22:23.214ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
74772025-03-01T01:22:23.214ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 16 reason = Timeout
74782025-03-01T01:22:23.214ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
74792025-03-01T01:22:23.214ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 16 reason = Timeout
74802025-03-01T01:22:23.214ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
74812025-03-01T01:22:23.214ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
74822025-03-01T01:22:23.214ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 16 reason = Timeout
74832025-03-01T01:22:23.214ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
74842025-03-01T01:22:23.214ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
74852025-03-01T01:22:23.214ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 16 reason = Timeout
74862025-03-01T01:22:23.214ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
74872025-03-01T01:22:23.214ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 16 reason = Timeout
74882025-03-01T01:22:23.214ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
74892025-03-01T01:22:23.214ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 46 reason = Timeout
74902025-03-01T01:22:23.214ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74912025-03-01T01:22:23.214ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 16 reason = Timeout
74922025-03-01T01:22:23.214ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
74932025-03-01T01:22:23.214ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 16 reason = Timeout
74942025-03-01T01:22:23.214ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
74952025-03-01T01:22:23.214ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 16 reason = Timeout
74962025-03-01T01:22:23.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
74972025-03-01T01:22:23.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
74982025-03-01T01:22:23.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
74992025-03-01T01:22:23.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
75002025-03-01T01:22:23.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
75012025-03-01T01:22:23.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
75022025-03-01T01:22:23.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
75032025-03-01T01:22:23.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
75042025-03-01T01:22:23.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
75052025-03-01T01:22:23.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
75062025-03-01T01:22:23.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
75072025-03-01T01:22:23.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
75082025-03-01T01:22:23.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
75092025-03-01T01:22:23.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
75102025-03-01T01:22:23.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75112025-03-01T01:22:23.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
75122025-03-01T01:22:23.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
75132025-03-01T01:22:23.217ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1353, tv_nsec: 905572941 } })
75142025-03-01T01:22:23.217ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1353, tv_nsec: 905595582 } })
75152025-03-01T01:22:23.218ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1154
75162025-03-01T01:22:23.218ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1154
75172025-03-01T01:22:23.218ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 3.499092ms iteration = 16 status = {"errors":[],"garbage_collect_requested":[]}
75182025-03-01T01:22:23.218ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75192025-03-01T01:22:23.218ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.867218ms iteration = 16 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
75202025-03-01T01:22:23.219ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
75212025-03-01T01:22:23.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
75222025-03-01T01:22:23.219ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75232025-03-01T01:22:23.220ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75242025-03-01T01:22:23.220ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
75252025-03-01T01:22:23.220ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
75262025-03-01T01:22:23.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
75272025-03-01T01:22:23.222ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
75282025-03-01T01:22:23.222ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
75292025-03-01T01:22:23.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
75302025-03-01T01:22:23.222ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
75312025-03-01T01:22:23.222ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
75322025-03-01T01:22:23.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
75332025-03-01T01:22:23.222ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75342025-03-01T01:22:23.222ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75352025-03-01T01:22:23.224ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
75362025-03-01T01:22:23.224ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
75372025-03-01T01:22:23.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
75382025-03-01T01:22:23.225ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
75392025-03-01T01:22:23.225ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
75402025-03-01T01:22:23.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
75412025-03-01T01:22:23.226ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
75422025-03-01T01:22:23.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
75432025-03-01T01:22:23.227ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75442025-03-01T01:22:23.227ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75452025-03-01T01:22:23.228ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
75462025-03-01T01:22:23.228ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
75472025-03-01T01:22:23.229ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1353, tv_nsec: 917382442 } })
75482025-03-01T01:22:23.229ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1154 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66
75492025-03-01T01:22:23.230ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
75502025-03-01T01:22:23.230ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
75512025-03-01T01:22:23.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
75522025-03-01T01:22:23.230ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
75532025-03-01T01:22:23.230ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75542025-03-01T01:22:23.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75552025-03-01T01:22:23.232ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
75562025-03-01T01:22:23.233ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75572025-03-01T01:22:23.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
75582025-03-01T01:22:23.233ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 18.798263ms iteration = 16 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
75592025-03-01T01:22:23.236ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
75602025-03-01T01:22:23.236ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
75612025-03-01T01:22:23.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
75622025-03-01T01:22:23.236ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
75632025-03-01T01:22:23.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
75642025-03-01T01:22:23.238ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75652025-03-01T01:22:23.239ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75662025-03-01T01:22:23.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75672025-03-01T01:22:23.241ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
75682025-03-01T01:22:23.241ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
75692025-03-01T01:22:23.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
75702025-03-01T01:22:23.251ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
75712025-03-01T01:22:23.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
75722025-03-01T01:22:23.253ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 38.591696ms iteration = 46 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
75732025-03-01T01:22:23.255ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
75742025-03-01T01:22:23.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
75752025-03-01T01:22:23.261ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
75762025-03-01T01:22:23.261ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
75772025-03-01T01:22:23.261ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
75782025-03-01T01:22:23.261ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
75792025-03-01T01:22:23.263ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 48.58411ms iteration = 16 status = {"errors":[],"finish_invoked_ok":[]}
75802025-03-01T01:22:23.268ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 53.292275ms iteration = 16 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
75812025-03-01T01:22:23.271ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
75822025-03-01T01:22:23.271ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
75832025-03-01T01:22:23.271ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
75842025-03-01T01:22:23.271ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75852025-03-01T01:22:23.271ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
75862025-03-01T01:22:23.273ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
75872025-03-01T01:22:23.273ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
75882025-03-01T01:22:23.273ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 58.867209ms iteration = 16 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
75892025-03-01T01:22:23.273ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
75902025-03-01T01:22:23.274ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7, lookup_type: ById(8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7) } result = Ok(())
75912025-03-01T01:22:23.274ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75922025-03-01T01:22:23.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75932025-03-01T01:22:23.276ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
75942025-03-01T01:22:23.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
75952025-03-01T01:22:23.331ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 116.457262ms iteration = 17 status = {"physical_disks_added":0}
75962025-03-01T01:22:23.353ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1162 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 zone_address = fd00:1122:3344:101::2
75972025-03-01T01:22:23.353ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
75982025-03-01T01:22:23.353ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "af405a64-f400-4f45-a78d-8d5ceb61e0c1", "content-length": "26", "date": "Sat, 01 Mar 2025 01:22:23 GMT"} })
75992025-03-01T01:22:23.353ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1167 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
76002025-03-01T01:22:23.355ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66
76012025-03-01T01:22:23.361ZINFOnexus (BackgroundTasks): VPC route manager sled 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
76022025-03-01T01:22:23.361ZDEBGnexus (BackgroundTasks): client request SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
76032025-03-01T01:22:23.362ZDEBGnexus (BackgroundTasks): client response SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "565e4ff0-e768-4288-9d87-a01488dd21e1", "content-length": "372", "date": "Sat, 01 Mar 2025 01:22:23 GMT"} })
76042025-03-01T01:22:23.362ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
76052025-03-01T01:22:23.362ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
76062025-03-01T01:22:23.363ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76072025-03-01T01:22:23.364ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 149.757861ms iteration = 16 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
76082025-03-01T01:22:23.367ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 3471264f-127e-4a25-bc10-2e8249e8d70a, lookup_type: ById(3471264f-127e-4a25-bc10-2e8249e8d70a) } result = Ok(())
76092025-03-01T01:22:23.367ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
76102025-03-01T01:22:23.367ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
76112025-03-01T01:22:23.370ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 156.0986ms iteration = 16 status = 0
76122025-03-01T01:22:23.389ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
76132025-03-01T01:22:23.389ZDEBGnexus (BackgroundTasks): client request SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
76142025-03-01T01:22:23.389ZDEBGnexus (BackgroundTasks): client response SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "65319c7e-d6a8-4e43-969a-d573e7208a91", "date": "Sat, 01 Mar 2025 01:22:23 GMT"} })
76152025-03-01T01:22:23.389ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
76162025-03-01T01:22:23.390ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
76172025-03-01T01:22:23.392ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
76182025-03-01T01:22:23.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
76192025-03-01T01:22:23.396ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
76202025-03-01T01:22:23.396ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 original_time_created = 2025-03-01 01:14:50.436545 UTC target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 time_created = 2025-03-01 01:14:50.436545 UTC
76212025-03-01T01:22:23.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
76222025-03-01T01:22:23.396ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 181.996217ms iteration = 46 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7","time_created":"2025-03-01T01:14:50.436545Z"}
76232025-03-01T01:22:23.399ZINFOnexus (BackgroundTasks): VPC route manager sled 3471264f-127e-4a25-bc10-2e8249e8d70a push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
76242025-03-01T01:22:23.399ZDEBGnexus (BackgroundTasks): client request SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
76252025-03-01T01:22:23.400ZDEBGnexus (BackgroundTasks): client response SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "aed07dc2-4fc7-4d03-ae14-9cd021305728", "date": "Sat, 01 Mar 2025 01:22:23 GMT"} })
76262025-03-01T01:22:23.402ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 187.206143ms iteration = 16 status = {}
76272025-03-01T01:22:23.409ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
76282025-03-01T01:22:23.409ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
76292025-03-01T01:22:23.409ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
76302025-03-01T01:22:23.409ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
76312025-03-01T01:22:23.411ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76322025-03-01T01:22:23.413ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
76332025-03-01T01:22:23.413ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
76342025-03-01T01:22:23.413ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
76352025-03-01T01:22:23.418ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
76362025-03-01T01:22:23.418ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 203.743501ms iteration = 16 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
76372025-03-01T01:22:23.419ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
76382025-03-01T01:22:23.419ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
76392025-03-01T01:22:23.419ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "418e43a7-882f-41ee-a348-477100de0661", "content-length": "26", "date": "Sat, 01 Mar 2025 01:22:23 GMT"} })
76402025-03-01T01:22:23.419ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
76412025-03-01T01:22:23.421ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
76422025-03-01T01:22:23.421ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
76432025-03-01T01:22:23.421ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
76442025-03-01T01:22:23.423ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76452025-03-01T01:22:23.424ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
76462025-03-01T01:22:23.424ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
76472025-03-01T01:22:23.424ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "65e43c6c-0c60-48b0-82c3-d7c427bff211", "content-length": "26", "date": "Sat, 01 Mar 2025 01:22:23 GMT"} })
76482025-03-01T01:22:23.424ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
76492025-03-01T01:22:23.424ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
76502025-03-01T01:22:23.424ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
76512025-03-01T01:22:23.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
76522025-03-01T01:22:23.426ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
76532025-03-01T01:22:23.426ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76542025-03-01T01:22:23.428ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
76552025-03-01T01:22:23.428ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
76562025-03-01T01:22:23.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
76572025-03-01T01:22:23.452ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
76582025-03-01T01:22:23.452ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
76592025-03-01T01:22:23.452ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 237.278474ms iteration = 16 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
76602025-03-01T01:22:23.503ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
76612025-03-01T01:22:23.503ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "abf6a75f-c490-4591-983c-30cb1f0afb40", "content-length": "2", "date": "Sat, 01 Mar 2025 01:22:22 GMT"} })
76622025-03-01T01:22:23.506ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 291.533229ms iteration = 16 status = {}
76632025-03-01T01:22:23.506ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
76642025-03-01T01:22:23.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
76652025-03-01T01:22:23.508ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 294.002329ms iteration = 16 status = null
76662025-03-01T01:22:23.551ZDEBGnexus (BackgroundTasks): client request SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
76672025-03-01T01:22:23.552ZDEBGnexus (BackgroundTasks): client response SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "cf5519a2-aedd-4a0d-8bb9-1e431ad23e99", "content-length": "691", "date": "Sat, 01 Mar 2025 01:22:23 GMT"} })
76682025-03-01T01:22:23.552ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
76692025-03-01T01:22:23.552ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
76702025-03-01T01:22:23.552ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
76712025-03-01T01:22:23.554ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 339.769741ms iteration = 16 status = {}
76722025-03-01T01:22:23.555ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
76732025-03-01T01:22:23.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
76742025-03-01T01:22:23.557ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 7f9c3c14-58c5-473f-8692-6376be44401e, rack_id: 4854cb88-dfba-4609-8f9d-72aac08cef66, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(cb10d0c6-a704-4231-b148-4f9ae21a03f8) } rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 switch_location = Switch0
76752025-03-01T01:22:23.557ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
76762025-03-01T01:22:23.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
76772025-03-01T01:22:23.568ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
76782025-03-01T01:22:23.568ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "299fcb20-5293-48a2-8fd9-d393db358bf9", "content-length": "134", "date": "Sat, 01 Mar 2025 01:22:22 GMT"} })
76792025-03-01T01:22:23.568ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
76802025-03-01T01:22:23.568ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = cb10d0c6-a704-4231-b148-4f9ae21a03f8
76812025-03-01T01:22:23.568ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
76822025-03-01T01:22:23.568ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
76832025-03-01T01:22:23.569ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
76842025-03-01T01:22:23.569ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
76852025-03-01T01:22:23.569ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
76862025-03-01T01:22:23.569ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
76872025-03-01T01:22:23.569ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
76882025-03-01T01:22:23.569ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
76892025-03-01T01:22:23.569ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66
76902025-03-01T01:22:23.569ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
76912025-03-01T01:22:23.569ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
76922025-03-01T01:22:23.571ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
76932025-03-01T01:22:23.571ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "e9783cc0-5c18-401f-903b-a77fa5f793d2", "content-length": "2", "date": "Sat, 01 Mar 2025 01:22:22 GMT"} })
76942025-03-01T01:22:23.571ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
76952025-03-01T01:22:23.571ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "c2c43dba-8c1b-47f4-ae44-b4b73e306139", "content-length": "52", "date": "Sat, 01 Mar 2025 01:22:22 GMT"} })
76962025-03-01T01:22:23.571ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 switch_location = Switch0
76972025-03-01T01:22:23.571ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
76982025-03-01T01:22:23.673ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "b5b01949-b59d-4dbc-a940-5b32b0a2c3f3", "date": "Sat, 01 Mar 2025 01:22:23 GMT"} })
76992025-03-01T01:22:23.673ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 switch = Switch0
77002025-03-01T01:22:23.673ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
77012025-03-01T01:22:23.673ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "7e3003e0-bd93-48c5-9742-4f7f319afefe", "content-length": "682", "date": "Sat, 01 Mar 2025 01:22:23 GMT"} })
77022025-03-01T01:22:23.673ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
77032025-03-01T01:22:23.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
77042025-03-01T01:22:23.677ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
77052025-03-01T01:22:23.677ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
77062025-03-01T01:22:23.680ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
77072025-03-01T01:22:23.681ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
77082025-03-01T01:22:23.683ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
77092025-03-01T01:22:23.683ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
77102025-03-01T01:22:23.691ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 476.690581ms iteration = 16 status = {}
77112025-03-01T01:22:23.793ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c15975d5-1990-44a1-af8e-914441b509ed roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
77122025-03-01T01:22:23.793ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c15975d5-1990-44a1-af8e-914441b509ed resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
77132025-03-01T01:22:23.796ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2538 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c15975d5-1990-44a1-af8e-914441b509ed response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
77142025-03-01T01:22:24.813ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 4d97fa2e-1815-484e-80a4-e5127d86bb71 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
77152025-03-01T01:22:24.813ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 4d97fa2e-1815-484e-80a4-e5127d86bb71 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
77162025-03-01T01:22:24.815ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2255 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 4d97fa2e-1815-484e-80a4-e5127d86bb71 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
77172025-03-01T01:22:25.834ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 010e102b-b450-4fb6-b6b7-34dfe58dc41b roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
77182025-03-01T01:22:25.835ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 010e102b-b450-4fb6-b6b7-34dfe58dc41b resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
77192025-03-01T01:22:25.837ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2299 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 010e102b-b450-4fb6-b6b7-34dfe58dc41b response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
77202025-03-01T01:22:26.856ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = a80eeb55-0601-4219-8ebb-6e98b31c3662 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
77212025-03-01T01:22:26.857ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = a80eeb55-0601-4219-8ebb-6e98b31c3662 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
77222025-03-01T01:22:26.859ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2441 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = a80eeb55-0601-4219-8ebb-6e98b31c3662 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
77232025-03-01T01:22:27.414ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 388 local_addr = [fd00:1122:3344:101::c]:34357 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = a433d25b-50ad-426c-a5f4-4c4d00d67e04 response_code = 200 uri = /67b03f4e-4cbd-4843-9cd9-647f610abcfc
77242025-03-01T01:22:27.879ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = a878cf80-1216-490f-a4a4-f3c1acad816a roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
77252025-03-01T01:22:27.879ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = a878cf80-1216-490f-a4a4-f3c1acad816a resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
77262025-03-01T01:22:27.881ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2502 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = a878cf80-1216-490f-a4a4-f3c1acad816a response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
77272025-03-01T01:22:28.902ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 9d3afac7-7409-4f10-b3b5-265237cd5193 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
77282025-03-01T01:22:28.903ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 9d3afac7-7409-4f10-b3b5-265237cd5193 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
77292025-03-01T01:22:28.904ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2089 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 9d3afac7-7409-4f10-b3b5-265237cd5193 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
77302025-03-01T01:22:29.924ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = f92c34c4-dbdf-4423-bfb7-a38315b6ca38 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
77312025-03-01T01:22:29.925ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = f92c34c4-dbdf-4423-bfb7-a38315b6ca38 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
77322025-03-01T01:22:29.927ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2868 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = f92c34c4-dbdf-4423-bfb7-a38315b6ca38 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
77332025-03-01T01:22:30.946ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 37d6fe7e-c0f4-408e-a9f5-2e789b1762c4 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
77342025-03-01T01:22:30.947ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 37d6fe7e-c0f4-408e-a9f5-2e789b1762c4 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
77352025-03-01T01:22:30.948ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2221 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 37d6fe7e-c0f4-408e-a9f5-2e789b1762c4 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
77362025-03-01T01:22:31.968ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 71ea49a7-ba5e-481c-b8a4-80d36e1ddcf1 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
77372025-03-01T01:22:31.969ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 71ea49a7-ba5e-481c-b8a4-80d36e1ddcf1 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
77382025-03-01T01:22:31.970ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2184 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 71ea49a7-ba5e-481c-b8a4-80d36e1ddcf1 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
77392025-03-01T01:22:32.991ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 32d86493-091e-475b-83b3-ade348ce097d roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
77402025-03-01T01:22:32.992ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 32d86493-091e-475b-83b3-ade348ce097d resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
77412025-03-01T01:22:32.993ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2128 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 32d86493-091e-475b-83b3-ade348ce097d response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
77422025-03-01T01:22:33.214ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 47 reason = Timeout
77432025-03-01T01:22:33.214ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 47 reason = Timeout
77442025-03-01T01:22:33.214ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
77452025-03-01T01:22:33.214ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77462025-03-01T01:22:33.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
77472025-03-01T01:22:33.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77482025-03-01T01:22:33.216ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77492025-03-01T01:22:33.219ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
77502025-03-01T01:22:33.219ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77512025-03-01T01:22:33.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77522025-03-01T01:22:33.222ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77532025-03-01T01:22:33.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77542025-03-01T01:22:33.224ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77552025-03-01T01:22:33.226ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7, lookup_type: ById(8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7) } result = Ok(())
77562025-03-01T01:22:33.226ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77572025-03-01T01:22:33.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77582025-03-01T01:22:33.239ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 original_time_created = 2025-03-01 01:14:50.436545 UTC target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 time_created = 2025-03-01 01:14:50.436545 UTC
77592025-03-01T01:22:33.239ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.995179ms iteration = 47 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7","time_created":"2025-03-01T01:14:50.436545Z"}
77602025-03-01T01:22:33.244ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
77612025-03-01T01:22:33.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
77622025-03-01T01:22:33.273ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 58.382219ms iteration = 47 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
77632025-03-01T01:22:34.015ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 89996a87-a40d-41de-930a-3512ee2b0ecb roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
77642025-03-01T01:22:34.015ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 89996a87-a40d-41de-930a-3512ee2b0ecb resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
77652025-03-01T01:22:34.017ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2285 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 89996a87-a40d-41de-930a-3512ee2b0ecb response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
77662025-03-01T01:22:35.037ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = b4f97519-bf81-4bc5-bce0-5016a9b5e5b3 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
77672025-03-01T01:22:35.038ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = b4f97519-bf81-4bc5-bce0-5016a9b5e5b3 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
77682025-03-01T01:22:35.039ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1714 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = b4f97519-bf81-4bc5-bce0-5016a9b5e5b3 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
77692025-03-01T01:22:36.059ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 7c370562-6fe6-469f-b66e-09d45449233e roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
77702025-03-01T01:22:36.059ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 7c370562-6fe6-469f-b66e-09d45449233e resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
77712025-03-01T01:22:36.061ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2232 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 7c370562-6fe6-469f-b66e-09d45449233e response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
77722025-03-01T01:22:37.080ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 5518379f-6cc8-4def-93d3-15bf16293e1d roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
77732025-03-01T01:22:37.081ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 5518379f-6cc8-4def-93d3-15bf16293e1d resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
77742025-03-01T01:22:37.083ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2485 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 5518379f-6cc8-4def-93d3-15bf16293e1d response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
77752025-03-01T01:22:37.414ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 397 local_addr = [fd00:1122:3344:101::c]:34357 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = 38233300-b021-416e-bcde-4f44e1cb3f77 response_code = 200 uri = /67b03f4e-4cbd-4843-9cd9-647f610abcfc
77762025-03-01T01:22:38.101ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 9f83941f-4340-4d4a-ab84-e84037c13f35 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
77772025-03-01T01:22:38.101ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 9f83941f-4340-4d4a-ab84-e84037c13f35 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
77782025-03-01T01:22:38.103ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2537 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 9f83941f-4340-4d4a-ab84-e84037c13f35 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
77792025-03-01T01:22:39.122ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 2a3625c0-7a7d-4cb0-9ede-f4a5355f32ae roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
77802025-03-01T01:22:39.123ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 2a3625c0-7a7d-4cb0-9ede-f4a5355f32ae resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
77812025-03-01T01:22:39.124ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2009 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 2a3625c0-7a7d-4cb0-9ede-f4a5355f32ae response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
77822025-03-01T01:22:40.145ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = a67849b8-8e36-4f38-be8b-c4e383a9f3af roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
77832025-03-01T01:22:40.146ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = a67849b8-8e36-4f38-be8b-c4e383a9f3af resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
77842025-03-01T01:22:40.147ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1967 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = a67849b8-8e36-4f38-be8b-c4e383a9f3af response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
77852025-03-01T01:22:41.168ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = cfe3fa70-88e4-4a60-a1a4-0ea60197c177 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
77862025-03-01T01:22:41.169ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = cfe3fa70-88e4-4a60-a1a4-0ea60197c177 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
77872025-03-01T01:22:41.171ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2421 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = cfe3fa70-88e4-4a60-a1a4-0ea60197c177 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
77882025-03-01T01:22:42.189ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 0bbf9c09-96b9-428a-bbcf-f062c93d7853 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
77892025-03-01T01:22:42.189ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 0bbf9c09-96b9-428a-bbcf-f062c93d7853 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
77902025-03-01T01:22:42.191ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1982 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 0bbf9c09-96b9-428a-bbcf-f062c93d7853 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
77912025-03-01T01:22:43.211ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c5ab0181-e70c-4015-8b58-37e34a8c421c roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
77922025-03-01T01:22:43.211ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c5ab0181-e70c-4015-8b58-37e34a8c421c resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
77932025-03-01T01:22:43.213ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2162 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c5ab0181-e70c-4015-8b58-37e34a8c421c response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
77942025-03-01T01:22:43.214ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 48 reason = Timeout
77952025-03-01T01:22:43.214ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 48 reason = Timeout
77962025-03-01T01:22:43.214ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
77972025-03-01T01:22:43.214ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77982025-03-01T01:22:43.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
77992025-03-01T01:22:43.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
78002025-03-01T01:22:43.215ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
78012025-03-01T01:22:43.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
78022025-03-01T01:22:43.216ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78032025-03-01T01:22:43.218ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
78042025-03-01T01:22:43.218ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78052025-03-01T01:22:43.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
78062025-03-01T01:22:43.221ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78072025-03-01T01:22:43.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
78082025-03-01T01:22:43.222ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78092025-03-01T01:22:43.225ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7, lookup_type: ById(8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7) } result = Ok(())
78102025-03-01T01:22:43.225ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78112025-03-01T01:22:43.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
78122025-03-01T01:22:43.233ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 original_time_created = 2025-03-01 01:14:50.436545 UTC target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 time_created = 2025-03-01 01:14:50.436545 UTC
78132025-03-01T01:22:43.233ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.075298ms iteration = 48 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7","time_created":"2025-03-01T01:14:50.436545Z"}
78142025-03-01T01:22:43.244ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.593534ms iteration = 48 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
78152025-03-01T01:22:44.232ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 03c6a1dd-809f-4019-a0f4-da4bf19a2da7 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
78162025-03-01T01:22:44.232ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 03c6a1dd-809f-4019-a0f4-da4bf19a2da7 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
78172025-03-01T01:22:44.234ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1758 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 03c6a1dd-809f-4019-a0f4-da4bf19a2da7 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
78182025-03-01T01:22:45.253ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 487db941-1b16-4d89-b541-28b1ef0c6f5d roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
78192025-03-01T01:22:45.253ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 487db941-1b16-4d89-b541-28b1ef0c6f5d resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
78202025-03-01T01:22:45.255ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2142 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 487db941-1b16-4d89-b541-28b1ef0c6f5d response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
78212025-03-01T01:22:46.276ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = fe03164c-018f-4b7a-9c20-d9330dc7aed9 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
78222025-03-01T01:22:46.276ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = fe03164c-018f-4b7a-9c20-d9330dc7aed9 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
78232025-03-01T01:22:46.277ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2053 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = fe03164c-018f-4b7a-9c20-d9330dc7aed9 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
78242025-03-01T01:22:47.297ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 09f182ae-c33f-4f9b-b000-f0a4b41329e0 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
78252025-03-01T01:22:47.297ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 09f182ae-c33f-4f9b-b000-f0a4b41329e0 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
78262025-03-01T01:22:47.299ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2020 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 09f182ae-c33f-4f9b-b000-f0a4b41329e0 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
78272025-03-01T01:22:47.415ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 363 local_addr = [fd00:1122:3344:101::c]:34357 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = 243d5edf-33bb-4410-b6b3-c706af864407 response_code = 200 uri = /67b03f4e-4cbd-4843-9cd9-647f610abcfc
78282025-03-01T01:22:48.319ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 71e7433a-44b4-4f23-8ba9-68ae1ad73348 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
78292025-03-01T01:22:48.320ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 71e7433a-44b4-4f23-8ba9-68ae1ad73348 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
78302025-03-01T01:22:48.322ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2172 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 71e7433a-44b4-4f23-8ba9-68ae1ad73348 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
78312025-03-01T01:22:49.342ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 987257b4-7794-4c43-a207-29515657cf41 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
78322025-03-01T01:22:49.342ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 987257b4-7794-4c43-a207-29515657cf41 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
78332025-03-01T01:22:49.343ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1718 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 987257b4-7794-4c43-a207-29515657cf41 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
78342025-03-01T01:22:50.364ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = cad80f57-07e4-4d3a-900d-469723f31e19 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
78352025-03-01T01:22:50.364ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = cad80f57-07e4-4d3a-900d-469723f31e19 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
78362025-03-01T01:22:50.366ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2098 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = cad80f57-07e4-4d3a-900d-469723f31e19 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
78372025-03-01T01:22:51.386ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 30b2a016-e2ef-4c57-a74e-cefa8a9618bd roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
78382025-03-01T01:22:51.386ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 30b2a016-e2ef-4c57-a74e-cefa8a9618bd resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
78392025-03-01T01:22:51.388ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2002 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 30b2a016-e2ef-4c57-a74e-cefa8a9618bd response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
78402025-03-01T01:22:52.409ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = e1f80b5b-7f19-4adf-add7-64d3170c61ac roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
78412025-03-01T01:22:52.409ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = e1f80b5b-7f19-4adf-add7-64d3170c61ac resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
78422025-03-01T01:22:52.411ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2202 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = e1f80b5b-7f19-4adf-add7-64d3170c61ac response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
78432025-03-01T01:22:53.214ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 17 reason = Timeout
78442025-03-01T01:22:53.214ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
78452025-03-01T01:22:53.214ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
78462025-03-01T01:22:53.214ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 9 reason = Timeout
78472025-03-01T01:22:53.214ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 18 reason = Timeout
78482025-03-01T01:22:53.214ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 17 reason = Timeout
78492025-03-01T01:22:53.214ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
78502025-03-01T01:22:53.214ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
78512025-03-01T01:22:53.214ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 9 reason = Timeout
78522025-03-01T01:22:53.214ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-03-01 01:12:53.214345277 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
78532025-03-01T01:22:53.214ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
78542025-03-01T01:22:53.214ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 9 reason = Timeout
78552025-03-01T01:22:53.214ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 9 reason = Timeout
78562025-03-01T01:22:53.214ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 11 reason = Timeout
78572025-03-01T01:22:53.214ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
78582025-03-01T01:22:53.214ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 9 reason = Timeout
78592025-03-01T01:22:53.214ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 17 reason = Timeout
78602025-03-01T01:22:53.214ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
78612025-03-01T01:22:53.214ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
78622025-03-01T01:22:53.214ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 10 reason = Timeout
78632025-03-01T01:22:53.214ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 17 reason = Timeout
78642025-03-01T01:22:53.214ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7
78652025-03-01T01:22:53.214ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 21.711\u{b5}s iteration = 10 status = {"enabled":false,"target_id":"8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7"}
78662025-03-01T01:22:53.214ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
78672025-03-01T01:22:53.214ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 17 reason = Timeout
78682025-03-01T01:22:53.214ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 9 reason = Timeout
78692025-03-01T01:22:53.214ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
78702025-03-01T01:22:53.214ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
78712025-03-01T01:22:53.214ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 17 reason = Timeout
78722025-03-01T01:22:53.214ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
78732025-03-01T01:22:53.214ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 11 reason = Timeout
78742025-03-01T01:22:53.214ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
78752025-03-01T01:22:53.214ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 17 reason = Timeout
78762025-03-01T01:22:53.214ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
78772025-03-01T01:22:53.214ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 17 reason = Timeout
78782025-03-01T01:22:53.214ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
78792025-03-01T01:22:53.214ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 9 reason = Timeout
78802025-03-01T01:22:53.214ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
78812025-03-01T01:22:53.214ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 9 reason = Timeout
78822025-03-01T01:22:53.214ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
78832025-03-01T01:22:53.214ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 17 reason = Timeout
78842025-03-01T01:22:53.214ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
78852025-03-01T01:22:53.214ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 17 reason = Timeout
78862025-03-01T01:22:53.214ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
78872025-03-01T01:22:53.214ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 17 reason = Timeout
78882025-03-01T01:22:53.214ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
78892025-03-01T01:22:53.214ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 9 reason = Timeout
78902025-03-01T01:22:53.214ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
78912025-03-01T01:22:53.214ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
78922025-03-01T01:22:53.214ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 49 reason = Timeout
78932025-03-01T01:22:53.214ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
78942025-03-01T01:22:53.214ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 17 reason = Timeout
78952025-03-01T01:22:53.215ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 17 reason = Timeout
78962025-03-01T01:22:53.215ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
78972025-03-01T01:22:53.215ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
78982025-03-01T01:22:53.215ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 49 reason = Timeout
78992025-03-01T01:22:53.215ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79002025-03-01T01:22:53.215ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 9 reason = Timeout
79012025-03-01T01:22:53.215ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
79022025-03-01T01:22:53.215ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
79032025-03-01T01:22:53.215ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 17 reason = Timeout
79042025-03-01T01:22:53.215ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
79052025-03-01T01:22:53.215ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 17 reason = Timeout
79062025-03-01T01:22:53.215ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
79072025-03-01T01:22:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
79082025-03-01T01:22:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
79092025-03-01T01:22:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
79102025-03-01T01:22:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
79112025-03-01T01:22:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
79122025-03-01T01:22:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
79132025-03-01T01:22:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
79142025-03-01T01:22:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
79152025-03-01T01:22:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
79162025-03-01T01:22:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
79172025-03-01T01:22:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
79182025-03-01T01:22:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
79192025-03-01T01:22:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
79202025-03-01T01:22:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
79212025-03-01T01:22:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
79222025-03-01T01:22:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
79232025-03-01T01:22:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79242025-03-01T01:22:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
79252025-03-01T01:22:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
79262025-03-01T01:22:53.215ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2e37f4af-57dc-468e-80e3-cf2aea2ffdc8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5f6eb3bd-0126-40e0-98ef-ee33df084158.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("5f6eb3bd-0126-40e0-98ef-ee33df084158.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1383, tv_nsec: 903119991 } })
79272025-03-01T01:22:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
79282025-03-01T01:22:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
79292025-03-01T01:22:53.215ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("3a9b8294-d9f3-4130-a669-e74c6f1f65a0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("450e8d93-9ed3-4721-9fe9-42521f60bc93.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a4f72c78-99c6-478d-b490-f7d8793d4173.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("a4f72c78-99c6-478d-b490-f7d8793d4173.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1383, tv_nsec: 903139561 } })
79302025-03-01T01:22:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
79312025-03-01T01:22:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
79322025-03-01T01:22:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
79332025-03-01T01:22:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
79342025-03-01T01:22:53.215ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
79352025-03-01T01:22:53.215ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.46705ms iteration = 9 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
79362025-03-01T01:22:53.215ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
79372025-03-01T01:22:53.215ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.506691ms iteration = 9 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
79382025-03-01T01:22:53.217ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79392025-03-01T01:22:53.217ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.372579ms iteration = 17 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
79402025-03-01T01:22:53.218ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79412025-03-01T01:22:53.218ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79422025-03-01T01:22:53.219ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
79432025-03-01T01:22:53.219ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
79442025-03-01T01:22:53.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
79452025-03-01T01:22:53.219ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-03-01 01:12:53.214345277 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
79462025-03-01T01:22:53.219ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 5.565914ms iteration = 9 status = {"expiration":"2025-03-01T01:12:53.214345277Z","pruned":[]}
79472025-03-01T01:22:53.221ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
79482025-03-01T01:22:53.221ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
79492025-03-01T01:22:53.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
79502025-03-01T01:22:53.221ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
79512025-03-01T01:22:53.221ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
79522025-03-01T01:22:53.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
79532025-03-01T01:22:53.222ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1383, tv_nsec: 910685285 } })
79542025-03-01T01:22:53.223ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1154
79552025-03-01T01:22:53.223ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79562025-03-01T01:22:53.224ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79572025-03-01T01:22:53.224ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 10.281259ms iteration = 9 status = {"errors":[],"found_port_ok":[]}
79582025-03-01T01:22:53.226ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
79592025-03-01T01:22:53.226ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
79602025-03-01T01:22:53.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
79612025-03-01T01:22:53.226ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
79622025-03-01T01:22:53.226ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
79632025-03-01T01:22:53.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
79642025-03-01T01:22:53.227ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
79652025-03-01T01:22:53.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
79662025-03-01T01:22:53.229ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79672025-03-01T01:22:53.230ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1383, tv_nsec: 918546735 } })
79682025-03-01T01:22:53.230ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
79692025-03-01T01:22:53.230ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
79702025-03-01T01:22:53.231ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1154
79712025-03-01T01:22:53.231ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
79722025-03-01T01:22:53.233ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
79732025-03-01T01:22:53.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
79742025-03-01T01:22:53.233ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79752025-03-01T01:22:53.234ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79762025-03-01T01:22:53.236ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
79772025-03-01T01:22:53.236ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
79782025-03-01T01:22:53.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
79792025-03-01T01:22:53.237ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
79802025-03-01T01:22:53.237ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
79812025-03-01T01:22:53.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
79822025-03-01T01:22:53.243ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
79832025-03-01T01:22:53.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
79842025-03-01T01:22:53.243ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
79852025-03-01T01:22:53.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
79862025-03-01T01:22:53.245ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
79872025-03-01T01:22:53.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
79882025-03-01T01:22:53.246ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79892025-03-01T01:22:53.246ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1383, tv_nsec: 934329787 } })
79902025-03-01T01:22:53.246ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1154 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66
79912025-03-01T01:22:53.248ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
79922025-03-01T01:22:53.248ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
79932025-03-01T01:22:53.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
79942025-03-01T01:22:53.251ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79952025-03-01T01:22:53.255ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
79962025-03-01T01:22:53.255ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
79972025-03-01T01:22:53.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
79982025-03-01T01:22:53.257ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79992025-03-01T01:22:53.260ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
80002025-03-01T01:22:53.260ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
80012025-03-01T01:22:53.260ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
80022025-03-01T01:22:53.269ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
80032025-03-01T01:22:53.269ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
80042025-03-01T01:22:53.269ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
80052025-03-01T01:22:53.269ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
80062025-03-01T01:22:53.276ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
80072025-03-01T01:22:53.276ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
80082025-03-01T01:22:53.276ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 62.010093ms iteration = 9 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
80092025-03-01T01:22:53.276ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 61.993393ms iteration = 17 status = {"errors":[],"garbage_collect_requested":[]}
80102025-03-01T01:22:53.276ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
80112025-03-01T01:22:53.277ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
80122025-03-01T01:22:53.278ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
80132025-03-01T01:22:53.278ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
80142025-03-01T01:22:53.279ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
80152025-03-01T01:22:53.279ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
80162025-03-01T01:22:53.281ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80172025-03-01T01:22:53.285ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
80182025-03-01T01:22:53.285ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
80192025-03-01T01:22:53.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
80202025-03-01T01:22:53.286ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
80212025-03-01T01:22:53.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
80222025-03-01T01:22:53.286ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 72.092979ms iteration = 17 status = {"errors":[],"finish_invoked_ok":[]}
80232025-03-01T01:22:53.288ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80242025-03-01T01:22:53.288ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
80252025-03-01T01:22:53.289ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80262025-03-01T01:22:53.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
80272025-03-01T01:22:53.289ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
80282025-03-01T01:22:53.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
80292025-03-01T01:22:53.290ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
80302025-03-01T01:22:53.290ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
80312025-03-01T01:22:53.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
80322025-03-01T01:22:53.293ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
80332025-03-01T01:22:53.293ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
80342025-03-01T01:22:53.293ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 79.215313ms iteration = 9 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
80352025-03-01T01:22:53.294ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
80362025-03-01T01:22:53.296ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
80372025-03-01T01:22:53.296ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
80382025-03-01T01:22:53.296ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
80392025-03-01T01:22:53.296ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 81.939339ms iteration = 17 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
80402025-03-01T01:22:53.297ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80412025-03-01T01:22:53.298ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80422025-03-01T01:22:53.299ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
80432025-03-01T01:22:53.299ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
80442025-03-01T01:22:53.300ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
80452025-03-01T01:22:53.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
80462025-03-01T01:22:53.301ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7, lookup_type: ById(8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7) } result = Ok(())
80472025-03-01T01:22:53.301ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
80482025-03-01T01:22:53.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
80492025-03-01T01:22:53.301ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
80502025-03-01T01:22:53.303ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80512025-03-01T01:22:53.308ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 3471264f-127e-4a25-bc10-2e8249e8d70a, lookup_type: ById(3471264f-127e-4a25-bc10-2e8249e8d70a) } result = Ok(())
80522025-03-01T01:22:53.308ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
80532025-03-01T01:22:53.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
80542025-03-01T01:22:53.310ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
80552025-03-01T01:22:53.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
80562025-03-01T01:22:53.310ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 96.240841ms iteration = 17 status = 0
80572025-03-01T01:22:53.318ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 103.420046ms iteration = 49 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
80582025-03-01T01:22:53.318ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 original_time_created = 2025-03-01 01:14:50.436545 UTC target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 time_created = 2025-03-01 01:14:50.436545 UTC
80592025-03-01T01:22:53.318ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 103.618521ms iteration = 49 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7","time_created":"2025-03-01T01:14:50.436545Z"}
80602025-03-01T01:22:53.332ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 118.106476ms iteration = 18 status = {"physical_disks_added":0}
80612025-03-01T01:22:53.332ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
80622025-03-01T01:22:53.332ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
80632025-03-01T01:22:53.333ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 118.349071ms iteration = 17 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
80642025-03-01T01:22:53.335ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 121.326141ms iteration = 17 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
80652025-03-01T01:22:53.337ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
80662025-03-01T01:22:53.337ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
80672025-03-01T01:22:53.337ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
80682025-03-01T01:22:53.337ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
80692025-03-01T01:22:53.337ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 123.1945ms iteration = 17 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
80702025-03-01T01:22:53.344ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
80712025-03-01T01:22:53.344ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
80722025-03-01T01:22:53.344ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
80732025-03-01T01:22:53.344ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
80742025-03-01T01:22:53.344ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
80752025-03-01T01:22:53.344ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
80762025-03-01T01:22:53.344ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
80772025-03-01T01:22:53.344ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
80782025-03-01T01:22:53.345ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
80792025-03-01T01:22:53.345ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
80802025-03-01T01:22:53.346ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80812025-03-01T01:22:53.347ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-03-01T01:14:49.537343Z, time_modified: 2025-03-01T01:14:49.537343Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 1682a303-6254-452b-b4cf-160ed9dc3fc9, db_silo: Silo { identity: SiloIdentity { id: 1682a303-6254-452b-b4cf-160ed9dc3fc9, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-03-01T01:14:54.631650Z, time_modified: 2025-03-01T01:14:54.631650Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "851c0b739689cfb98a2e401e6047fa98e9fcc283d9fc3f660bd69842a9c06be9" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 1682a303-6254-452b-b4cf-160ed9dc3fc9, db_silo: Silo { identity: SiloIdentity { id: 1682a303-6254-452b-b4cf-160ed9dc3fc9, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-03-01T01:14:54.631650Z, time_modified: 2025-03-01T01:14:54.631650Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "851c0b739689cfb98a2e401e6047fa98e9fcc283d9fc3f660bd69842a9c06be9" }] }) }
80822025-03-01T01:22:53.347ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 132.851337ms iteration = 9 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"1682a303-6254-452b-b4cf-160ed9dc3fc9","tls_certs":["851c0b739689cfb98a2e401e6047fa98e9fcc283d9fc3f660bd69842a9c06be9"]}},"default_endpoint":{"silo_id":"1682a303-6254-452b-b4cf-160ed9dc3fc9","tls_certs":["851c0b739689cfb98a2e401e6047fa98e9fcc283d9fc3f660bd69842a9c06be9"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
80832025-03-01T01:22:53.349ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
80842025-03-01T01:22:53.350ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
80852025-03-01T01:22:53.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
80862025-03-01T01:22:53.352ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
80872025-03-01T01:22:53.352ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 0a9e4b5c-53a1-4f0a-8849-98a8b1852af3 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
80882025-03-01T01:22:53.352ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
80892025-03-01T01:22:53.353ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
80902025-03-01T01:22:53.354ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80912025-03-01T01:22:53.355ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80922025-03-01T01:22:53.357ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
80932025-03-01T01:22:53.358ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
80942025-03-01T01:22:53.358ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
80952025-03-01T01:22:53.359ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
80962025-03-01T01:22:53.359ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
80972025-03-01T01:22:53.360ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "609d8a44-6e9f-43de-8b9e-c24b9ec7b18a", "content-length": "26", "date": "Sat, 01 Mar 2025 01:22:53 GMT"} })
80982025-03-01T01:22:53.360ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
80992025-03-01T01:22:53.360ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
81002025-03-01T01:22:53.360ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 145.435443ms iteration = 17 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
81012025-03-01T01:22:53.360ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
81022025-03-01T01:22:53.360ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
81032025-03-01T01:22:53.360ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
81042025-03-01T01:22:53.361ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
81052025-03-01T01:22:53.361ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
81062025-03-01T01:22:53.365ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
81072025-03-01T01:22:53.366ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
81082025-03-01T01:22:53.366ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
81092025-03-01T01:22:53.382ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
81102025-03-01T01:22:53.382ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
81112025-03-01T01:22:53.382ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 168.109475ms iteration = 17 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
81122025-03-01T01:22:53.386ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
81132025-03-01T01:22:53.386ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
81142025-03-01T01:22:53.387ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9b3b963f-8788-4f9b-a59e-4088191504eb", "content-length": "26", "date": "Sat, 01 Mar 2025 01:22:53 GMT"} })
81152025-03-01T01:22:53.387ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
81162025-03-01T01:22:53.389ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
81172025-03-01T01:22:53.393ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81182025-03-01T01:22:53.397ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
81192025-03-01T01:22:53.397ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
81202025-03-01T01:22:53.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
81212025-03-01T01:22:53.432ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = d984788d-b65d-41f3-abd6-e1e414f19ce0 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
81222025-03-01T01:22:53.432ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = d984788d-b65d-41f3-abd6-e1e414f19ce0 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
81232025-03-01T01:22:53.453ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
81242025-03-01T01:22:53.453ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 239.385756ms iteration = 9 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
81252025-03-01T01:22:53.466ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1162 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 zone_address = fd00:1122:3344:101::2
81262025-03-01T01:22:53.466ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
81272025-03-01T01:22:53.467ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "757acc55-760a-41de-b492-a29f53bbf07f", "content-length": "26", "date": "Sat, 01 Mar 2025 01:22:53 GMT"} })
81282025-03-01T01:22:53.467ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1167 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
81292025-03-01T01:22:53.469ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66
81302025-03-01T01:22:53.516ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
81312025-03-01T01:22:53.517ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "095daca9-c7f9-4c14-996e-8037955c36ff", "content-length": "2", "date": "Sat, 01 Mar 2025 01:22:52 GMT"} })
81322025-03-01T01:22:53.519ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
81332025-03-01T01:22:53.519ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
81342025-03-01T01:22:53.537ZINFOnexus (BackgroundTasks): VPC route manager sled 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
81352025-03-01T01:22:53.537ZDEBGnexus (BackgroundTasks): client request SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
81362025-03-01T01:22:53.537ZDEBGnexus (BackgroundTasks): client response SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "082d2e40-2e71-4ac3-b7a0-d66b38dd50b1", "content-length": "372", "date": "Sat, 01 Mar 2025 01:22:53 GMT"} })
81372025-03-01T01:22:53.537ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81382025-03-01T01:22:53.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81392025-03-01T01:22:53.540ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 0a9e4b5c-53a1-4f0a-8849-98a8b1852af3 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
81402025-03-01T01:22:53.540ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
81412025-03-01T01:22:53.540ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-03-01 01:14:53.460216 UTC dns_group = internal generation = 1
81422025-03-01T01:22:53.540ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 325.593373ms iteration = 9 status = {"generation":1}
81432025-03-01T01:22:53.541ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 109081 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = d984788d-b65d-41f3-abd6-e1e414f19ce0 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
81442025-03-01T01:22:53.541ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 327.124273ms iteration = 17 status = null
81452025-03-01T01:22:53.542ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
81462025-03-01T01:22:53.543ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "37f0e710-76b7-4e8a-aa2d-6c4330b170b5", "date": "Sat, 01 Mar 2025 01:22:53 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
81472025-03-01T01:22:53.543ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
81482025-03-01T01:22:53.544ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "98bed123-3abd-47bd-a3ec-56f71f62a684", "date": "Sat, 01 Mar 2025 01:22:53 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
81492025-03-01T01:22:53.544ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
81502025-03-01T01:22:53.546ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
81512025-03-01T01:22:53.546ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 331.573634ms iteration = 11 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
81522025-03-01T01:22:53.546ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
81532025-03-01T01:22:53.569ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
81542025-03-01T01:22:53.569ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = cce65e3e-6c86-4cdd-98ad-9a38c98082e8 dns_zone_name = oxide.test found_so_far = 0 version = 2
81552025-03-01T01:22:53.569ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
81562025-03-01T01:22:53.569ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 355.200636ms iteration = 17 status = {}
81572025-03-01T01:22:53.569ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
81582025-03-01T01:22:53.592ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
81592025-03-01T01:22:53.592ZDEBGnexus (BackgroundTasks): client request SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
81602025-03-01T01:22:53.592ZDEBGnexus (BackgroundTasks): client response SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "fec5e1ae-036c-4544-b604-6647b9600419", "date": "Sat, 01 Mar 2025 01:22:53 GMT"} })
81612025-03-01T01:22:53.592ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81622025-03-01T01:22:53.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81632025-03-01T01:22:53.595ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81642025-03-01T01:22:53.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81652025-03-01T01:22:53.599ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81662025-03-01T01:22:53.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81672025-03-01T01:22:53.603ZINFOnexus (BackgroundTasks): VPC route manager sled 3471264f-127e-4a25-bc10-2e8249e8d70a push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
81682025-03-01T01:22:53.603ZDEBGnexus (BackgroundTasks): client request SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
81692025-03-01T01:22:53.603ZDEBGnexus (BackgroundTasks): client response SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "7c5199e4-71a1-47bc-9171-cb564f3cd9c3", "date": "Sat, 01 Mar 2025 01:22:53 GMT"} })
81702025-03-01T01:22:53.604ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 390.463044ms iteration = 17 status = {}
81712025-03-01T01:22:53.606ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81722025-03-01T01:22:53.609ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
81732025-03-01T01:22:53.609ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
81742025-03-01T01:22:53.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
81752025-03-01T01:22:53.611ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = cce65e3e-6c86-4cdd-98ad-9a38c98082e8 dns_zone_name = oxide.test found_so_far = 1 version = 2
81762025-03-01T01:22:53.611ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
81772025-03-01T01:22:53.611ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-03-01 01:14:54.679503 UTC dns_group = external generation = 2
81782025-03-01T01:22:53.611ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 397.103229ms iteration = 9 status = {"generation":2}
81792025-03-01T01:22:53.615ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
81802025-03-01T01:22:53.615ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "9428a330-42d4-4b6e-b856-7a3a956bc8e9", "date": "Sat, 01 Mar 2025 01:22:53 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
81812025-03-01T01:22:53.615ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
81822025-03-01T01:22:53.618ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "77547dab-3aac-4415-a7bb-eb8a9dce02af", "date": "Sat, 01 Mar 2025 01:22:53 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
81832025-03-01T01:22:53.618ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
81842025-03-01T01:22:53.622ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "642ddb6e-1cd5-441f-b4c3-c4a49f6c5647", "date": "Sat, 01 Mar 2025 01:22:53 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
81852025-03-01T01:22:53.622ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
81862025-03-01T01:22:53.624ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
81872025-03-01T01:22:53.624ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 410.429411ms iteration = 11 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
81882025-03-01T01:22:53.647ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
81892025-03-01T01:22:53.647ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
81902025-03-01T01:22:53.672ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81912025-03-01T01:22:53.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81922025-03-01T01:22:53.674ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 7f9c3c14-58c5-473f-8692-6376be44401e, rack_id: 4854cb88-dfba-4609-8f9d-72aac08cef66, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(cb10d0c6-a704-4231-b148-4f9ae21a03f8) } rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 switch_location = Switch0
81932025-03-01T01:22:53.674ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81942025-03-01T01:22:53.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81952025-03-01T01:22:53.684ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
81962025-03-01T01:22:53.685ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "299b70c2-3ba7-4d1c-a2e1-ca144905ca1b", "content-length": "134", "date": "Sat, 01 Mar 2025 01:22:53 GMT"} })
81972025-03-01T01:22:53.685ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
81982025-03-01T01:22:53.685ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = cb10d0c6-a704-4231-b148-4f9ae21a03f8
81992025-03-01T01:22:53.685ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
82002025-03-01T01:22:53.685ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
82012025-03-01T01:22:53.685ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
82022025-03-01T01:22:53.685ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
82032025-03-01T01:22:53.685ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
82042025-03-01T01:22:53.685ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
82052025-03-01T01:22:53.685ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
82062025-03-01T01:22:53.685ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
82072025-03-01T01:22:53.685ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66
82082025-03-01T01:22:53.686ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
82092025-03-01T01:22:53.686ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
82102025-03-01T01:22:53.688ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
82112025-03-01T01:22:53.688ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "0b30f8c6-cbb4-4d52-80d3-37f94a019be2", "content-length": "2", "date": "Sat, 01 Mar 2025 01:22:53 GMT"} })
82122025-03-01T01:22:53.688ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
82132025-03-01T01:22:53.688ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "b77cd586-4005-47df-bb62-e9e335c43fa5", "content-length": "52", "date": "Sat, 01 Mar 2025 01:22:53 GMT"} })
82142025-03-01T01:22:53.688ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 switch_location = Switch0
82152025-03-01T01:22:53.688ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
82162025-03-01T01:22:53.690ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82172025-03-01T01:22:53.692ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
82182025-03-01T01:22:53.692ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
82192025-03-01T01:22:53.693ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
82202025-03-01T01:22:53.694ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82212025-03-01T01:22:53.696ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
82222025-03-01T01:22:53.696ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
82232025-03-01T01:22:53.696ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
82242025-03-01T01:22:53.802ZDEBGnexus (BackgroundTasks): client request SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
82252025-03-01T01:22:53.804ZDEBGnexus (BackgroundTasks): client response SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "0e6bb529-bf74-4dea-968a-5b798ce0af3e", "content-length": "691", "date": "Sat, 01 Mar 2025 01:22:53 GMT"} })
82262025-03-01T01:22:53.804ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
82272025-03-01T01:22:53.804ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
82282025-03-01T01:22:53.804ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
82292025-03-01T01:22:53.806ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 592.186723ms iteration = 17 status = {}
82302025-03-01T01:22:53.835ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "d815f1bb-dbdc-434b-954b-65067cfabc2c", "date": "Sat, 01 Mar 2025 01:22:53 GMT"} })
82312025-03-01T01:22:53.835ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 switch = Switch0
82322025-03-01T01:22:53.835ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
82332025-03-01T01:22:53.835ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "186cc526-0ef7-42d5-b056-0bf1b6c61e5e", "content-length": "682", "date": "Sat, 01 Mar 2025 01:22:53 GMT"} })
82342025-03-01T01:22:53.835ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
82352025-03-01T01:22:53.836ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
82362025-03-01T01:22:53.840ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
82372025-03-01T01:22:53.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
82382025-03-01T01:22:53.843ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
82392025-03-01T01:22:53.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
82402025-03-01T01:22:53.846ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
82412025-03-01T01:22:53.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
82422025-03-01T01:22:53.853ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 639.283443ms iteration = 17 status = {}
82432025-03-01T01:22:54.562ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 3dacddab-8ee7-44f8-ac6e-d199037949bc roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
82442025-03-01T01:22:54.562ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 3dacddab-8ee7-44f8-ac6e-d199037949bc resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
82452025-03-01T01:22:54.564ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2051 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 3dacddab-8ee7-44f8-ac6e-d199037949bc response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
82462025-03-01T01:22:55.583ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 93bc9618-f38d-4380-9b80-c6a9d8630017 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
82472025-03-01T01:22:55.583ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 93bc9618-f38d-4380-9b80-c6a9d8630017 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
82482025-03-01T01:22:55.585ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2374 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 93bc9618-f38d-4380-9b80-c6a9d8630017 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
82492025-03-01T01:22:56.605ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = e04d36e2-2cf8-4896-917c-562980b681cf roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
82502025-03-01T01:22:56.606ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = e04d36e2-2cf8-4896-917c-562980b681cf resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
82512025-03-01T01:22:56.607ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1852 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = e04d36e2-2cf8-4896-917c-562980b681cf response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
82522025-03-01T01:22:57.415ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 451 local_addr = [fd00:1122:3344:101::c]:34357 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = a687e322-5c3d-435e-ae2d-42da1a6eb0e4 response_code = 200 uri = /67b03f4e-4cbd-4843-9cd9-647f610abcfc
82532025-03-01T01:22:57.626ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 36a6446f-35e6-4884-9d30-0d1a34d302d6 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
82542025-03-01T01:22:57.627ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 36a6446f-35e6-4884-9d30-0d1a34d302d6 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
82552025-03-01T01:22:57.629ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2521 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 36a6446f-35e6-4884-9d30-0d1a34d302d6 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
82562025-03-01T01:22:58.648ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 9fd4e403-569d-4a58-8e4e-067e620b6eec roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
82572025-03-01T01:22:58.649ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 9fd4e403-569d-4a58-8e4e-067e620b6eec resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
82582025-03-01T01:22:58.650ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2382 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 9fd4e403-569d-4a58-8e4e-067e620b6eec response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
82592025-03-01T01:22:59.670ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 323bffce-050a-408c-bc21-9b1294b2dc66 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
82602025-03-01T01:22:59.671ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 323bffce-050a-408c-bc21-9b1294b2dc66 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
82612025-03-01T01:22:59.672ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2045 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 323bffce-050a-408c-bc21-9b1294b2dc66 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
82622025-03-01T01:23:00.691ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 5b1f72a4-8ebb-46e7-a211-5e43e0b393d1 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
82632025-03-01T01:23:00.692ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 5b1f72a4-8ebb-46e7-a211-5e43e0b393d1 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
82642025-03-01T01:23:00.694ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2744 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 5b1f72a4-8ebb-46e7-a211-5e43e0b393d1 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
82652025-03-01T01:23:01.714ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 820d0c2c-7a9f-4402-acd1-af69b3de0442 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
82662025-03-01T01:23:01.715ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 820d0c2c-7a9f-4402-acd1-af69b3de0442 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
82672025-03-01T01:23:01.716ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2296 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 820d0c2c-7a9f-4402-acd1-af69b3de0442 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
82682025-03-01T01:23:02.734ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = e1b6c009-6add-49ab-9915-2f4db8dbafc0 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
82692025-03-01T01:23:02.735ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = e1b6c009-6add-49ab-9915-2f4db8dbafc0 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
82702025-03-01T01:23:02.737ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2540 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = e1b6c009-6add-49ab-9915-2f4db8dbafc0 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
82712025-03-01T01:23:03.214ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 50 reason = Timeout
82722025-03-01T01:23:03.214ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 50 reason = Timeout
82732025-03-01T01:23:03.214ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
82742025-03-01T01:23:03.214ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82752025-03-01T01:23:03.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82762025-03-01T01:23:03.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
82772025-03-01T01:23:03.216ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82782025-03-01T01:23:03.218ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
82792025-03-01T01:23:03.218ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82802025-03-01T01:23:03.218ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82812025-03-01T01:23:03.220ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82822025-03-01T01:23:03.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82832025-03-01T01:23:03.222ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82842025-03-01T01:23:03.224ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7, lookup_type: ById(8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7) } result = Ok(())
82852025-03-01T01:23:03.224ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82862025-03-01T01:23:03.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82872025-03-01T01:23:03.236ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 original_time_created = 2025-03-01 01:14:50.436545 UTC target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 time_created = 2025-03-01 01:14:50.436545 UTC
82882025-03-01T01:23:03.236ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.188792ms iteration = 50 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7","time_created":"2025-03-01T01:14:50.436545Z"}
82892025-03-01T01:23:03.242ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
82902025-03-01T01:23:03.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
82912025-03-01T01:23:03.269ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 55.180404ms iteration = 50 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
82922025-03-01T01:23:03.756ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 5e41595f-36d1-4a23-bdbc-a6025406f8c0 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
82932025-03-01T01:23:03.756ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 5e41595f-36d1-4a23-bdbc-a6025406f8c0 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
82942025-03-01T01:23:03.757ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1793 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 5e41595f-36d1-4a23-bdbc-a6025406f8c0 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
82952025-03-01T01:23:04.777ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 9a6c072b-8c72-4c67-80ad-8b0e8029219a roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
82962025-03-01T01:23:04.777ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 9a6c072b-8c72-4c67-80ad-8b0e8029219a resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
82972025-03-01T01:23:04.779ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2741 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 9a6c072b-8c72-4c67-80ad-8b0e8029219a response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
82982025-03-01T01:23:05.799ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 444ef492-3c7a-453b-aa1c-b6bc16f95081 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
82992025-03-01T01:23:05.800ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 444ef492-3c7a-453b-aa1c-b6bc16f95081 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
83002025-03-01T01:23:05.802ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2275 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 444ef492-3c7a-453b-aa1c-b6bc16f95081 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
83012025-03-01T01:23:06.822ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = fd1dbd5c-9b50-4979-880f-cf940ebea872 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
83022025-03-01T01:23:06.822ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = fd1dbd5c-9b50-4979-880f-cf940ebea872 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
83032025-03-01T01:23:06.824ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2262 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = fd1dbd5c-9b50-4979-880f-cf940ebea872 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
83042025-03-01T01:23:07.406ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61177 req_id = 4f0aab46-ee12-4888-b5c5-8a77f2c57a3d roles = RoleSet { roles: {} } uri = /metrics/collectors/d77aa5d6-e6f9-4845-b1d4-57f91a3621e6/producers?sort_by=id_ascending
83052025-03-01T01:23:07.407ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61177 req_id = 4f0aab46-ee12-4888-b5c5-8a77f2c57a3d resource = Database result = Ok(()) uri = /metrics/collectors/d77aa5d6-e6f9-4845-b1d4-57f91a3621e6/producers?sort_by=id_ascending
83062025-03-01T01:23:07.410ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3167 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61177 req_id = 4f0aab46-ee12-4888-b5c5-8a77f2c57a3d response_code = 200 uri = /metrics/collectors/d77aa5d6-e6f9-4845-b1d4-57f91a3621e6/producers?sort_by=id_ascending
83072025-03-01T01:23:07.410ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61177 req_id = b222c298-400b-4f89-bf7e-03079064764d roles = RoleSet { roles: {} } uri = /metrics/collectors/d77aa5d6-e6f9-4845-b1d4-57f91a3621e6/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYmI0ODUwMS0zYzRlLTRkNDQtODgyMy1mOTc1ZTg2OTFmZmYifX0%3D
83082025-03-01T01:23:07.410ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61177 req_id = b222c298-400b-4f89-bf7e-03079064764d resource = Database result = Ok(()) uri = /metrics/collectors/d77aa5d6-e6f9-4845-b1d4-57f91a3621e6/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYmI0ODUwMS0zYzRlLTRkNDQtODgyMy1mOTc1ZTg2OTFmZmYifX0%3D
83092025-03-01T01:23:07.412ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2715 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61177 req_id = b222c298-400b-4f89-bf7e-03079064764d response_code = 200 uri = /metrics/collectors/d77aa5d6-e6f9-4845-b1d4-57f91a3621e6/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYmI0ODUwMS0zYzRlLTRkNDQtODgyMy1mOTc1ZTg2OTFmZmYifX0%3D
83102025-03-01T01:23:07.414ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 290 local_addr = [fd00:1122:3344:101::c]:34357 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = e123068a-3cc7-4f50-aaab-f8f9643bd30e response_code = 200 uri = /67b03f4e-4cbd-4843-9cd9-647f610abcfc
83112025-03-01T01:23:07.845ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = db450cc2-3212-458e-81c8-7c55b366e909 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
83122025-03-01T01:23:07.845ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = db450cc2-3212-458e-81c8-7c55b366e909 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
83132025-03-01T01:23:07.847ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2473 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = db450cc2-3212-458e-81c8-7c55b366e909 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
83142025-03-01T01:23:08.866ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = e770c81d-d791-4c9c-8036-cf648e5e9087 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
83152025-03-01T01:23:08.867ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = e770c81d-d791-4c9c-8036-cf648e5e9087 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
83162025-03-01T01:23:08.868ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2172 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = e770c81d-d791-4c9c-8036-cf648e5e9087 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
83172025-03-01T01:23:09.888ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 61103115-9670-4567-b0fc-8df280c37f46 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
83182025-03-01T01:23:09.888ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 61103115-9670-4567-b0fc-8df280c37f46 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
83192025-03-01T01:23:09.890ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2085 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 61103115-9670-4567-b0fc-8df280c37f46 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
83202025-03-01T01:23:10.910ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c4c65e87-3410-41cd-86f9-62dd873d93be roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
83212025-03-01T01:23:10.910ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c4c65e87-3410-41cd-86f9-62dd873d93be resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
83222025-03-01T01:23:10.912ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2437 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c4c65e87-3410-41cd-86f9-62dd873d93be response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
83232025-03-01T01:23:11.933ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 49f39ce8-f110-4741-8aac-b3008356ae2a roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
83242025-03-01T01:23:11.934ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 49f39ce8-f110-4741-8aac-b3008356ae2a resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
83252025-03-01T01:23:11.935ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1825 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 49f39ce8-f110-4741-8aac-b3008356ae2a response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
83262025-03-01T01:23:12.955ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = bc2a0b46-aa8b-497c-af7a-3f02fc292c91 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
83272025-03-01T01:23:12.955ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = bc2a0b46-aa8b-497c-af7a-3f02fc292c91 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
83282025-03-01T01:23:12.957ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2579 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = bc2a0b46-aa8b-497c-af7a-3f02fc292c91 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
83292025-03-01T01:23:13.214ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 51 reason = Timeout
83302025-03-01T01:23:13.214ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 51 reason = Timeout
83312025-03-01T01:23:13.214ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83322025-03-01T01:23:13.214ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
83332025-03-01T01:23:13.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
83342025-03-01T01:23:13.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83352025-03-01T01:23:13.216ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83362025-03-01T01:23:13.219ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
83372025-03-01T01:23:13.219ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83382025-03-01T01:23:13.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83392025-03-01T01:23:13.220ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83402025-03-01T01:23:13.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83412025-03-01T01:23:13.222ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83422025-03-01T01:23:13.225ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7, lookup_type: ById(8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7) } result = Ok(())
83432025-03-01T01:23:13.225ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83442025-03-01T01:23:13.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83452025-03-01T01:23:13.237ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 original_time_created = 2025-03-01 01:14:50.436545 UTC target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 time_created = 2025-03-01 01:14:50.436545 UTC
83462025-03-01T01:23:13.237ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.380296ms iteration = 51 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7","time_created":"2025-03-01T01:14:50.436545Z"}
83472025-03-01T01:23:13.244ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
83482025-03-01T01:23:13.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
83492025-03-01T01:23:13.272ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 58.827019ms iteration = 51 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
83502025-03-01T01:23:13.977ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = ea6cf2b3-4be6-4004-89f6-c243aaaaa3c1 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
83512025-03-01T01:23:13.977ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = ea6cf2b3-4be6-4004-89f6-c243aaaaa3c1 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
83522025-03-01T01:23:13.979ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2249 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = ea6cf2b3-4be6-4004-89f6-c243aaaaa3c1 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
83532025-03-01T01:23:14.999ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = e22ed671-b0d2-403d-8efe-77f7a25ca1ef roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
83542025-03-01T01:23:14.999ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = e22ed671-b0d2-403d-8efe-77f7a25ca1ef resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
83552025-03-01T01:23:15.001ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2157 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = e22ed671-b0d2-403d-8efe-77f7a25ca1ef response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
83562025-03-01T01:23:16.026ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 6680906c-dc00-40cc-876a-ae4e279937a0 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
83572025-03-01T01:23:16.026ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 6680906c-dc00-40cc-876a-ae4e279937a0 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
83582025-03-01T01:23:16.027ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1848 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 6680906c-dc00-40cc-876a-ae4e279937a0 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
83592025-03-01T01:23:17.047ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = b875d3dd-ca3c-4d68-83f6-75b9ad884a5e roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
83602025-03-01T01:23:17.047ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = b875d3dd-ca3c-4d68-83f6-75b9ad884a5e resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
83612025-03-01T01:23:17.049ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2422 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = b875d3dd-ca3c-4d68-83f6-75b9ad884a5e response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
83622025-03-01T01:23:17.414ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 315 local_addr = [fd00:1122:3344:101::c]:34357 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = 9d260980-7688-4d37-878d-1e50fbc2f16d response_code = 200 uri = /67b03f4e-4cbd-4843-9cd9-647f610abcfc
83632025-03-01T01:23:18.070ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = f3dad976-6b0a-4173-a273-9de5225f3de7 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
83642025-03-01T01:23:18.070ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = f3dad976-6b0a-4173-a273-9de5225f3de7 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
83652025-03-01T01:23:18.072ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2749 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = f3dad976-6b0a-4173-a273-9de5225f3de7 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
83662025-03-01T01:23:19.092ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 57e0bb95-6b0d-4c70-9679-781dbccb00d2 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
83672025-03-01T01:23:19.092ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 57e0bb95-6b0d-4c70-9679-781dbccb00d2 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
83682025-03-01T01:23:19.094ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2470 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 57e0bb95-6b0d-4c70-9679-781dbccb00d2 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
83692025-03-01T01:23:20.114ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = f17f7765-f909-4809-9ba7-c604f7147347 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
83702025-03-01T01:23:20.114ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = f17f7765-f909-4809-9ba7-c604f7147347 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
83712025-03-01T01:23:20.116ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2019 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = f17f7765-f909-4809-9ba7-c604f7147347 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
83722025-03-01T01:23:21.135ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 3fe09b29-ec30-40df-9613-eaeb0de6f059 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
83732025-03-01T01:23:21.136ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 3fe09b29-ec30-40df-9613-eaeb0de6f059 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
83742025-03-01T01:23:21.137ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2192 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 3fe09b29-ec30-40df-9613-eaeb0de6f059 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
83752025-03-01T01:23:22.158ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 183950ec-6cf0-4621-9afd-e6a154b61f14 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
83762025-03-01T01:23:22.158ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 183950ec-6cf0-4621-9afd-e6a154b61f14 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
83772025-03-01T01:23:22.160ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1814 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 183950ec-6cf0-4621-9afd-e6a154b61f14 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
83782025-03-01T01:23:22.407ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61177 req_id = 791c915c-0150-4a14-8fef-a640061d45b9 roles = RoleSet { roles: {} } uri = /metrics/collectors/d77aa5d6-e6f9-4845-b1d4-57f91a3621e6/producers?sort_by=id_ascending
83792025-03-01T01:23:22.407ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61177 req_id = 791c915c-0150-4a14-8fef-a640061d45b9 resource = Database result = Ok(()) uri = /metrics/collectors/d77aa5d6-e6f9-4845-b1d4-57f91a3621e6/producers?sort_by=id_ascending
83802025-03-01T01:23:22.409ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2325 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61177 req_id = 791c915c-0150-4a14-8fef-a640061d45b9 response_code = 200 uri = /metrics/collectors/d77aa5d6-e6f9-4845-b1d4-57f91a3621e6/producers?sort_by=id_ascending
83812025-03-01T01:23:22.409ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61177 req_id = 53daf477-cce3-4dbf-8048-be32e345bd2b roles = RoleSet { roles: {} } uri = /metrics/collectors/d77aa5d6-e6f9-4845-b1d4-57f91a3621e6/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYmI0ODUwMS0zYzRlLTRkNDQtODgyMy1mOTc1ZTg2OTFmZmYifX0%3D
83822025-03-01T01:23:22.410ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61177 req_id = 53daf477-cce3-4dbf-8048-be32e345bd2b resource = Database result = Ok(()) uri = /metrics/collectors/d77aa5d6-e6f9-4845-b1d4-57f91a3621e6/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYmI0ODUwMS0zYzRlLTRkNDQtODgyMy1mOTc1ZTg2OTFmZmYifX0%3D
83832025-03-01T01:23:22.412ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2644 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61177 req_id = 53daf477-cce3-4dbf-8048-be32e345bd2b response_code = 200 uri = /metrics/collectors/d77aa5d6-e6f9-4845-b1d4-57f91a3621e6/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYmI0ODUwMS0zYzRlLTRkNDQtODgyMy1mOTc1ZTg2OTFmZmYifX0%3D
83842025-03-01T01:23:23.180ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 3b6c3b1d-d476-4054-92d7-f8143baf60de roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
83852025-03-01T01:23:23.180ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 3b6c3b1d-d476-4054-92d7-f8143baf60de resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
83862025-03-01T01:23:23.181ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1984 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 3b6c3b1d-d476-4054-92d7-f8143baf60de response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
83872025-03-01T01:23:23.214ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 18 reason = Timeout
83882025-03-01T01:23:23.214ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 18 reason = Timeout
83892025-03-01T01:23:23.214ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
83902025-03-01T01:23:23.214ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 52 reason = Timeout
83912025-03-01T01:23:23.214ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
83922025-03-01T01:23:23.214ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
83932025-03-01T01:23:23.214ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 19 reason = Timeout
83942025-03-01T01:23:23.214ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
83952025-03-01T01:23:23.214ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 18 reason = Timeout
83962025-03-01T01:23:23.214ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 18 reason = Timeout
83972025-03-01T01:23:23.214ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
83982025-03-01T01:23:23.214ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
83992025-03-01T01:23:23.214ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 18 reason = Timeout
84002025-03-01T01:23:23.214ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
84012025-03-01T01:23:23.214ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 52 reason = Timeout
84022025-03-01T01:23:23.214ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84032025-03-01T01:23:23.214ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 18 reason = Timeout
84042025-03-01T01:23:23.214ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 18 reason = Timeout
84052025-03-01T01:23:23.214ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
84062025-03-01T01:23:23.214ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
84072025-03-01T01:23:23.214ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 18 reason = Timeout
84082025-03-01T01:23:23.214ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
84092025-03-01T01:23:23.214ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 18 reason = Timeout
84102025-03-01T01:23:23.214ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 18 reason = Timeout
84112025-03-01T01:23:23.214ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
84122025-03-01T01:23:23.214ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
84132025-03-01T01:23:23.214ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 18 reason = Timeout
84142025-03-01T01:23:23.214ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
84152025-03-01T01:23:23.214ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 18 reason = Timeout
84162025-03-01T01:23:23.214ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 18 reason = Timeout
84172025-03-01T01:23:23.214ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
84182025-03-01T01:23:23.214ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 18 reason = Timeout
84192025-03-01T01:23:23.214ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
84202025-03-01T01:23:23.214ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
84212025-03-01T01:23:23.214ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 18 reason = Timeout
84222025-03-01T01:23:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
84232025-03-01T01:23:23.214ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
84242025-03-01T01:23:23.214ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
84252025-03-01T01:23:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
84262025-03-01T01:23:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
84272025-03-01T01:23:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84282025-03-01T01:23:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
84292025-03-01T01:23:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
84302025-03-01T01:23:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
84312025-03-01T01:23:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
84322025-03-01T01:23:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
84332025-03-01T01:23:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
84342025-03-01T01:23:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
84352025-03-01T01:23:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
84362025-03-01T01:23:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
84372025-03-01T01:23:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
84382025-03-01T01:23:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
84392025-03-01T01:23:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
84402025-03-01T01:23:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
84412025-03-01T01:23:23.217ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84422025-03-01T01:23:23.217ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1413, tv_nsec: 905508149 } })
84432025-03-01T01:23:23.217ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1154
84442025-03-01T01:23:23.218ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.123054ms iteration = 18 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
84452025-03-01T01:23:23.219ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84462025-03-01T01:23:23.220ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
84472025-03-01T01:23:23.220ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84482025-03-01T01:23:23.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84492025-03-01T01:23:23.221ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
84502025-03-01T01:23:23.221ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
84512025-03-01T01:23:23.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
84522025-03-01T01:23:23.225ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1413, tv_nsec: 913767398 } })
84532025-03-01T01:23:23.226ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1154
84542025-03-01T01:23:23.226ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84552025-03-01T01:23:23.229ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
84562025-03-01T01:23:23.229ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
84572025-03-01T01:23:23.229ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
84582025-03-01T01:23:23.231ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84592025-03-01T01:23:23.231ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84602025-03-01T01:23:23.231ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84612025-03-01T01:23:23.234ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
84622025-03-01T01:23:23.234ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
84632025-03-01T01:23:23.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
84642025-03-01T01:23:23.236ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1413, tv_nsec: 924727271 } })
84652025-03-01T01:23:23.237ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1154 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66
84662025-03-01T01:23:23.256ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
84672025-03-01T01:23:23.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
84682025-03-01T01:23:23.258ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84692025-03-01T01:23:23.260ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
84702025-03-01T01:23:23.260ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
84712025-03-01T01:23:23.260ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
84722025-03-01T01:23:23.263ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 49.726823ms iteration = 18 status = {"errors":[],"finish_invoked_ok":[]}
84732025-03-01T01:23:23.265ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
84742025-03-01T01:23:23.265ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
84752025-03-01T01:23:23.265ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
84762025-03-01T01:23:23.265ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
84772025-03-01T01:23:23.265ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
84782025-03-01T01:23:23.265ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
84792025-03-01T01:23:23.266ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
84802025-03-01T01:23:23.266ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
84812025-03-01T01:23:23.267ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84822025-03-01T01:23:23.268ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84832025-03-01T01:23:23.270ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
84842025-03-01T01:23:23.270ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
84852025-03-01T01:23:23.270ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 56.135114ms iteration = 18 status = {"errors":[],"garbage_collect_requested":[]}
84862025-03-01T01:23:23.270ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
84872025-03-01T01:23:23.272ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
84882025-03-01T01:23:23.272ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
84892025-03-01T01:23:23.272ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
84902025-03-01T01:23:23.272ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
84912025-03-01T01:23:23.272ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
84922025-03-01T01:23:23.273ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
84932025-03-01T01:23:23.273ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
84942025-03-01T01:23:23.273ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
84952025-03-01T01:23:23.273ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 59.928531ms iteration = 18 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
84962025-03-01T01:23:23.274ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84972025-03-01T01:23:23.274ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84982025-03-01T01:23:23.274ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
84992025-03-01T01:23:23.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
85002025-03-01T01:23:23.276ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
85012025-03-01T01:23:23.276ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
85022025-03-01T01:23:23.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
85032025-03-01T01:23:23.277ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7, lookup_type: ById(8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7) } result = Ok(())
85042025-03-01T01:23:23.277ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85052025-03-01T01:23:23.277ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
85062025-03-01T01:23:23.278ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85072025-03-01T01:23:23.280ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
85082025-03-01T01:23:23.280ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
85092025-03-01T01:23:23.280ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
85102025-03-01T01:23:23.280ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
85112025-03-01T01:23:23.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
85122025-03-01T01:23:23.282ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85132025-03-01T01:23:23.284ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
85142025-03-01T01:23:23.284ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
85152025-03-01T01:23:23.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
85162025-03-01T01:23:23.294ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 original_time_created = 2025-03-01 01:14:50.436545 UTC target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 time_created = 2025-03-01 01:14:50.436545 UTC
85172025-03-01T01:23:23.294ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 80.702194ms iteration = 52 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7","time_created":"2025-03-01T01:14:50.436545Z"}
85182025-03-01T01:23:23.299ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
85192025-03-01T01:23:23.299ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
85202025-03-01T01:23:23.299ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 85.685506ms iteration = 52 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
85212025-03-01T01:23:23.299ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b85bc220-e695-4633-86ba-4ac1dd0b9b8f", "content-length": "26", "date": "Sat, 01 Mar 2025 01:23:23 GMT"} })
85222025-03-01T01:23:23.299ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
85232025-03-01T01:23:23.302ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
85242025-03-01T01:23:23.305ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
85252025-03-01T01:23:23.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
85262025-03-01T01:23:23.306ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
85272025-03-01T01:23:23.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
85282025-03-01T01:23:23.307ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
85292025-03-01T01:23:23.307ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
85302025-03-01T01:23:23.307ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
85312025-03-01T01:23:23.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
85322025-03-01T01:23:23.307ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
85332025-03-01T01:23:23.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
85342025-03-01T01:23:23.308ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 94.682499ms iteration = 18 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
85352025-03-01T01:23:23.309ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
85362025-03-01T01:23:23.309ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
85372025-03-01T01:23:23.309ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "927a1729-253f-4614-8077-2c79bf92b0b3", "content-length": "26", "date": "Sat, 01 Mar 2025 01:23:23 GMT"} })
85382025-03-01T01:23:23.309ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
85392025-03-01T01:23:23.309ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85402025-03-01T01:23:23.311ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
85412025-03-01T01:23:23.314ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 3471264f-127e-4a25-bc10-2e8249e8d70a, lookup_type: ById(3471264f-127e-4a25-bc10-2e8249e8d70a) } result = Ok(())
85422025-03-01T01:23:23.314ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
85432025-03-01T01:23:23.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
85442025-03-01T01:23:23.316ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 102.10139ms iteration = 18 status = 0
85452025-03-01T01:23:23.317ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 103.256503ms iteration = 18 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
85462025-03-01T01:23:23.318ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 104.245613ms iteration = 18 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
85472025-03-01T01:23:23.319ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
85482025-03-01T01:23:23.319ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 104.971598ms iteration = 18 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
85492025-03-01T01:23:23.332ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1162 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 zone_address = fd00:1122:3344:101::2
85502025-03-01T01:23:23.332ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
85512025-03-01T01:23:23.332ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7eddc6c0-65b8-4989-9f4a-db15e85bd7cf", "content-length": "26", "date": "Sat, 01 Mar 2025 01:23:23 GMT"} })
85522025-03-01T01:23:23.332ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1167 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
85532025-03-01T01:23:23.334ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66
85542025-03-01T01:23:23.340ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
85552025-03-01T01:23:23.340ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
85562025-03-01T01:23:23.340ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 126.255842ms iteration = 18 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
85572025-03-01T01:23:23.342ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
85582025-03-01T01:23:23.342ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
85592025-03-01T01:23:23.391ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 177.550577ms iteration = 18 status = {}
85602025-03-01T01:23:23.397ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 183.066469ms iteration = 19 status = {"physical_disks_added":0}
85612025-03-01T01:23:23.403ZINFOnexus (BackgroundTasks): VPC route manager sled 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
85622025-03-01T01:23:23.403ZDEBGnexus (BackgroundTasks): client request SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
85632025-03-01T01:23:23.404ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
85642025-03-01T01:23:23.404ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "d5432921-d881-4f19-a7e2-093659d54eeb", "content-length": "2", "date": "Sat, 01 Mar 2025 01:23:22 GMT"} })
85652025-03-01T01:23:23.406ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
85662025-03-01T01:23:23.406ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
85672025-03-01T01:23:23.416ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 202.535946ms iteration = 18 status = null
85682025-03-01T01:23:23.417ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
85692025-03-01T01:23:23.418ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
85702025-03-01T01:23:23.420ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85712025-03-01T01:23:23.423ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
85722025-03-01T01:23:23.423ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
85732025-03-01T01:23:23.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
85742025-03-01T01:23:23.425ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85752025-03-01T01:23:23.427ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
85762025-03-01T01:23:23.427ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
85772025-03-01T01:23:23.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
85782025-03-01T01:23:23.495ZDEBGnexus (BackgroundTasks): client request SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
85792025-03-01T01:23:23.507ZDEBGnexus (BackgroundTasks): client response SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "5aec896c-be69-488d-8a8c-1d4ce03b19e0", "content-length": "372", "date": "Sat, 01 Mar 2025 01:23:23 GMT"} })
85802025-03-01T01:23:23.507ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
85812025-03-01T01:23:23.507ZDEBGnexus (BackgroundTasks): client response SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "59194b29-4f27-4890-91b0-8f2b467e1a56", "content-length": "691", "date": "Sat, 01 Mar 2025 01:23:23 GMT"} })
85822025-03-01T01:23:23.507ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
85832025-03-01T01:23:23.507ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
85842025-03-01T01:23:23.507ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
85852025-03-01T01:23:23.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
85862025-03-01T01:23:23.508ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 294.260544ms iteration = 18 status = {}
85872025-03-01T01:23:23.515ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85882025-03-01T01:23:23.515ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85892025-03-01T01:23:23.517ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 7f9c3c14-58c5-473f-8692-6376be44401e, rack_id: 4854cb88-dfba-4609-8f9d-72aac08cef66, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(cb10d0c6-a704-4231-b148-4f9ae21a03f8) } rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 switch_location = Switch0
85902025-03-01T01:23:23.517ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85912025-03-01T01:23:23.518ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85922025-03-01T01:23:23.525ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
85932025-03-01T01:23:23.525ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "20be8af7-022b-4711-9622-53575b85207d", "content-length": "134", "date": "Sat, 01 Mar 2025 01:23:22 GMT"} })
85942025-03-01T01:23:23.525ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
85952025-03-01T01:23:23.525ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = cb10d0c6-a704-4231-b148-4f9ae21a03f8
85962025-03-01T01:23:23.525ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
85972025-03-01T01:23:23.525ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
85982025-03-01T01:23:23.525ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
85992025-03-01T01:23:23.525ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
86002025-03-01T01:23:23.525ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
86012025-03-01T01:23:23.525ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
86022025-03-01T01:23:23.525ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
86032025-03-01T01:23:23.525ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
86042025-03-01T01:23:23.526ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66
86052025-03-01T01:23:23.526ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
86062025-03-01T01:23:23.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
86072025-03-01T01:23:23.530ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
86082025-03-01T01:23:23.530ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "447c4f98-7328-4d07-aa51-8c087b48ec76", "content-length": "2", "date": "Sat, 01 Mar 2025 01:23:22 GMT"} })
86092025-03-01T01:23:23.530ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
86102025-03-01T01:23:23.530ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "3bd5d9ff-1de0-4d51-b960-adcc7bf009f6", "content-length": "52", "date": "Sat, 01 Mar 2025 01:23:22 GMT"} })
86112025-03-01T01:23:23.530ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 switch_location = Switch0
86122025-03-01T01:23:23.530ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
86132025-03-01T01:23:23.555ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
86142025-03-01T01:23:23.555ZDEBGnexus (BackgroundTasks): client request SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
86152025-03-01T01:23:23.624ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "f443c2fa-935e-49f2-9fc1-e2cd888935f5", "date": "Sat, 01 Mar 2025 01:23:23 GMT"} })
86162025-03-01T01:23:23.624ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 switch = Switch0
86172025-03-01T01:23:23.624ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
86182025-03-01T01:23:23.624ZDEBGnexus (BackgroundTasks): client response SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "657b9d34-6327-492e-8ca4-e3fd669a6ee4", "date": "Sat, 01 Mar 2025 01:23:23 GMT"} })
86192025-03-01T01:23:23.624ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
86202025-03-01T01:23:23.625ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
86212025-03-01T01:23:23.625ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "8674676f-33d3-47e7-91f5-8a661472c485", "content-length": "682", "date": "Sat, 01 Mar 2025 01:23:23 GMT"} })
86222025-03-01T01:23:23.625ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
86232025-03-01T01:23:23.625ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
86242025-03-01T01:23:23.627ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
86252025-03-01T01:23:23.627ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
86262025-03-01T01:23:23.629ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
86272025-03-01T01:23:23.629ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
86282025-03-01T01:23:23.631ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
86292025-03-01T01:23:23.632ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
86302025-03-01T01:23:23.632ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
86312025-03-01T01:23:23.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
86322025-03-01T01:23:23.634ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
86332025-03-01T01:23:23.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
86342025-03-01T01:23:23.635ZINFOnexus (BackgroundTasks): VPC route manager sled 3471264f-127e-4a25-bc10-2e8249e8d70a push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
86352025-03-01T01:23:23.635ZDEBGnexus (BackgroundTasks): client request SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
86362025-03-01T01:23:23.636ZDEBGnexus (BackgroundTasks): client response SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "3440cb63-8d1e-4f6d-947e-b586cceb4aa0", "date": "Sat, 01 Mar 2025 01:23:23 GMT"} })
86372025-03-01T01:23:23.637ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 423.302473ms iteration = 18 status = {}
86382025-03-01T01:23:23.644ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 430.343797ms iteration = 18 status = {}
86392025-03-01T01:23:23.984ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
86402025-03-01T01:23:23.984ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
86412025-03-01T01:23:24.014ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
86422025-03-01T01:23:24.014ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:61129
86432025-03-01T01:23:24.014ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:61129 req_id = d4c47b7d-4ccf-4a1d-a929-5c331a28e4be roles = RoleSet { roles: {} } uri = /metrics/producers
86442025-03-01T01:23:24.014ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:61129 req_id = d4c47b7d-4ccf-4a1d-a929-5c331a28e4be resource = Database result = Ok(()) uri = /metrics/producers
86452025-03-01T01:23:24.057ZINFOnexus: assigned collector to new producer collector_id = d77aa5d6-e6f9-4845-b1d4-57f91a3621e6 file = nexus/src/app/oximeter.rs:76 producer_id = 67b03f4e-4cbd-4843-9cd9-647f610abcfc
86462025-03-01T01:23:24.057ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 42751 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:61129 req_id = d4c47b7d-4ccf-4a1d-a929-5c331a28e4be response_code = 201 uri = /metrics/producers
86472025-03-01T01:23:24.057ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "d4c47b7d-4ccf-4a1d-a929-5c331a28e4be", "content-length": "41", "date": "Sat, 01 Mar 2025 01:23:24 GMT"} })
86482025-03-01T01:23:24.058ZDEBGnexus (producer-registration-task): registered with nexus successfully
86492025-03-01T01:23:24.058ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
86502025-03-01T01:23:24.201ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = be3d6678-a4b1-4532-bce8-1e88d1148229 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
86512025-03-01T01:23:24.201ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = be3d6678-a4b1-4532-bce8-1e88d1148229 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
86522025-03-01T01:23:24.202ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1554 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = be3d6678-a4b1-4532-bce8-1e88d1148229 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
86532025-03-01T01:23:25.221ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 8e2ba918-8760-46bf-9e0a-6d55cacfa7ae roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
86542025-03-01T01:23:25.221ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 8e2ba918-8760-46bf-9e0a-6d55cacfa7ae resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
86552025-03-01T01:23:25.223ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2080 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 8e2ba918-8760-46bf-9e0a-6d55cacfa7ae response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
86562025-03-01T01:23:26.243ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = d8e1088b-7897-43a9-b4f2-4a0af1937b27 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
86572025-03-01T01:23:26.244ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = d8e1088b-7897-43a9-b4f2-4a0af1937b27 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
86582025-03-01T01:23:26.246ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2267 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = d8e1088b-7897-43a9-b4f2-4a0af1937b27 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
86592025-03-01T01:23:27.265ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 35e3bba5-071f-4baf-88fb-015a84596e5d roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
86602025-03-01T01:23:27.265ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 35e3bba5-071f-4baf-88fb-015a84596e5d resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
86612025-03-01T01:23:27.267ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2031 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 35e3bba5-071f-4baf-88fb-015a84596e5d response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
86622025-03-01T01:23:27.414ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 436 local_addr = [fd00:1122:3344:101::c]:34357 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = 25aaeca9-e224-4cdb-af02-48970cc3a885 response_code = 200 uri = /67b03f4e-4cbd-4843-9cd9-647f610abcfc
86632025-03-01T01:23:28.286ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 5435dab2-c4e8-4d9a-93f5-80b6c52bd1b2 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
86642025-03-01T01:23:28.287ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 5435dab2-c4e8-4d9a-93f5-80b6c52bd1b2 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
86652025-03-01T01:23:28.288ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2036 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 5435dab2-c4e8-4d9a-93f5-80b6c52bd1b2 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
86662025-03-01T01:23:29.307ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 029371ca-6524-4c57-87ce-32752cd821c2 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
86672025-03-01T01:23:29.307ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 029371ca-6524-4c57-87ce-32752cd821c2 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
86682025-03-01T01:23:29.309ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1921 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 029371ca-6524-4c57-87ce-32752cd821c2 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
86692025-03-01T01:23:30.329ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 748a1ef2-108f-46c2-b94d-0153d43c728b roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
86702025-03-01T01:23:30.329ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 748a1ef2-108f-46c2-b94d-0153d43c728b resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
86712025-03-01T01:23:30.331ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2380 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 748a1ef2-108f-46c2-b94d-0153d43c728b response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
86722025-03-01T01:23:31.350ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = a8c9d048-0107-4c8e-a0c4-efb34a4c1972 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
86732025-03-01T01:23:31.350ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = a8c9d048-0107-4c8e-a0c4-efb34a4c1972 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
86742025-03-01T01:23:31.351ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1955 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = a8c9d048-0107-4c8e-a0c4-efb34a4c1972 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
86752025-03-01T01:23:32.371ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 09186c53-f70b-4d55-9688-1982dde4ee3f roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
86762025-03-01T01:23:32.371ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 09186c53-f70b-4d55-9688-1982dde4ee3f resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
86772025-03-01T01:23:32.373ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2340 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 09186c53-f70b-4d55-9688-1982dde4ee3f response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
86782025-03-01T01:23:33.214ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 53 reason = Timeout
86792025-03-01T01:23:33.214ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 53 reason = Timeout
86802025-03-01T01:23:33.214ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
86812025-03-01T01:23:33.214ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86822025-03-01T01:23:33.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
86832025-03-01T01:23:33.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86842025-03-01T01:23:33.216ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
86852025-03-01T01:23:33.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
86862025-03-01T01:23:33.216ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86872025-03-01T01:23:33.218ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.756556ms iteration = 53 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
86882025-03-01T01:23:33.219ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
86892025-03-01T01:23:33.219ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86902025-03-01T01:23:33.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86912025-03-01T01:23:33.221ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86922025-03-01T01:23:33.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86932025-03-01T01:23:33.222ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86942025-03-01T01:23:33.225ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7, lookup_type: ById(8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7) } result = Ok(())
86952025-03-01T01:23:33.225ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86962025-03-01T01:23:33.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86972025-03-01T01:23:33.237ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 original_time_created = 2025-03-01 01:14:50.436545 UTC target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 time_created = 2025-03-01 01:14:50.436545 UTC
86982025-03-01T01:23:33.237ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.846986ms iteration = 53 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7","time_created":"2025-03-01T01:14:50.436545Z"}
86992025-03-01T01:23:33.393ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = bf8ec9b8-486c-45f4-966a-e286c4bdb9d2 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
87002025-03-01T01:23:33.393ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = bf8ec9b8-486c-45f4-966a-e286c4bdb9d2 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
87012025-03-01T01:23:33.394ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1546 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = bf8ec9b8-486c-45f4-966a-e286c4bdb9d2 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
87022025-03-01T01:23:34.414ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 975bb76d-a231-4819-84ef-6d88792bca34 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
87032025-03-01T01:23:34.414ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 975bb76d-a231-4819-84ef-6d88792bca34 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
87042025-03-01T01:23:34.416ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2189 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 975bb76d-a231-4819-84ef-6d88792bca34 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
87052025-03-01T01:23:35.435ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 6ef43c8a-04ac-4c22-a1e1-e9b006147316 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
87062025-03-01T01:23:35.436ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 6ef43c8a-04ac-4c22-a1e1-e9b006147316 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
87072025-03-01T01:23:35.438ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2398 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 6ef43c8a-04ac-4c22-a1e1-e9b006147316 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
87082025-03-01T01:23:36.458ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 8e50fc9a-8c12-4698-8215-a7534b7bff77 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
87092025-03-01T01:23:36.458ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 8e50fc9a-8c12-4698-8215-a7534b7bff77 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
87102025-03-01T01:23:36.460ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2432 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 8e50fc9a-8c12-4698-8215-a7534b7bff77 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
87112025-03-01T01:23:37.407ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61177 req_id = 37baf548-4e91-4658-a9f5-3f0a3b64133a roles = RoleSet { roles: {} } uri = /metrics/collectors/d77aa5d6-e6f9-4845-b1d4-57f91a3621e6/producers?sort_by=id_ascending
87122025-03-01T01:23:37.407ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61177 req_id = 37baf548-4e91-4658-a9f5-3f0a3b64133a resource = Database result = Ok(()) uri = /metrics/collectors/d77aa5d6-e6f9-4845-b1d4-57f91a3621e6/producers?sort_by=id_ascending
87132025-03-01T01:23:37.410ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2794 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61177 req_id = 37baf548-4e91-4658-a9f5-3f0a3b64133a response_code = 200 uri = /metrics/collectors/d77aa5d6-e6f9-4845-b1d4-57f91a3621e6/producers?sort_by=id_ascending
87142025-03-01T01:23:37.410ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61177 req_id = e370f26c-8d59-47b4-b532-e21d7ed13e47 roles = RoleSet { roles: {} } uri = /metrics/collectors/d77aa5d6-e6f9-4845-b1d4-57f91a3621e6/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYmI0ODUwMS0zYzRlLTRkNDQtODgyMy1mOTc1ZTg2OTFmZmYifX0%3D
87152025-03-01T01:23:37.410ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61177 req_id = e370f26c-8d59-47b4-b532-e21d7ed13e47 resource = Database result = Ok(()) uri = /metrics/collectors/d77aa5d6-e6f9-4845-b1d4-57f91a3621e6/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYmI0ODUwMS0zYzRlLTRkNDQtODgyMy1mOTc1ZTg2OTFmZmYifX0%3D
87162025-03-01T01:23:37.412ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1700 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:61177 req_id = e370f26c-8d59-47b4-b532-e21d7ed13e47 response_code = 200 uri = /metrics/collectors/d77aa5d6-e6f9-4845-b1d4-57f91a3621e6/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYmI0ODUwMS0zYzRlLTRkNDQtODgyMy1mOTc1ZTg2OTFmZmYifX0%3D
87172025-03-01T01:23:37.414ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 323 local_addr = [fd00:1122:3344:101::c]:34357 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = 6e03f6d8-c37c-43a2-9d89-d12422b8083b response_code = 200 uri = /67b03f4e-4cbd-4843-9cd9-647f610abcfc
87182025-03-01T01:23:37.479ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = ab30ffeb-1fe9-44eb-a27b-04e35997fd23 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
87192025-03-01T01:23:37.479ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = ab30ffeb-1fe9-44eb-a27b-04e35997fd23 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
87202025-03-01T01:23:37.481ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2009 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = ab30ffeb-1fe9-44eb-a27b-04e35997fd23 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
87212025-03-01T01:23:38.504ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 72eb9232-c827-44c6-8138-149f1e62ea0e roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
87222025-03-01T01:23:38.504ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 72eb9232-c827-44c6-8138-149f1e62ea0e resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
87232025-03-01T01:23:38.506ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2331 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 72eb9232-c827-44c6-8138-149f1e62ea0e response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
87242025-03-01T01:23:39.526ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 260bcd12-25ca-4fbc-a936-f11b0598c39b roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
87252025-03-01T01:23:39.526ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 260bcd12-25ca-4fbc-a936-f11b0598c39b resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
87262025-03-01T01:23:39.528ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2290 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 260bcd12-25ca-4fbc-a936-f11b0598c39b response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
87272025-03-01T01:23:40.549ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 4bfb0414-3040-4377-a91d-390b965b17d7 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
87282025-03-01T01:23:40.550ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 4bfb0414-3040-4377-a91d-390b965b17d7 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
87292025-03-01T01:23:40.551ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1890 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 4bfb0414-3040-4377-a91d-390b965b17d7 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
87302025-03-01T01:23:41.571ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = d7a9453b-57e3-4a8b-9087-f166fd17dcf9 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
87312025-03-01T01:23:41.571ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = d7a9453b-57e3-4a8b-9087-f166fd17dcf9 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
87322025-03-01T01:23:41.573ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2076 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = d7a9453b-57e3-4a8b-9087-f166fd17dcf9 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
87332025-03-01T01:23:42.591ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = ac2e9f75-275d-4589-bd30-4ca06cf62f63 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
87342025-03-01T01:23:42.591ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = ac2e9f75-275d-4589-bd30-4ca06cf62f63 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
87352025-03-01T01:23:42.593ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2120 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = ac2e9f75-275d-4589-bd30-4ca06cf62f63 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
87362025-03-01T01:23:43.214ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 54 reason = Timeout
87372025-03-01T01:23:43.214ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 54 reason = Timeout
87382025-03-01T01:23:43.214ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
87392025-03-01T01:23:43.214ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87402025-03-01T01:23:43.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87412025-03-01T01:23:43.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
87422025-03-01T01:23:43.216ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87432025-03-01T01:23:43.217ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
87442025-03-01T01:23:43.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
87452025-03-01T01:23:43.218ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.289298ms iteration = 54 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
87462025-03-01T01:23:43.218ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
87472025-03-01T01:23:43.218ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87482025-03-01T01:23:43.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87492025-03-01T01:23:43.220ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87502025-03-01T01:23:43.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87512025-03-01T01:23:43.222ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87522025-03-01T01:23:43.225ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7, lookup_type: ById(8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7) } result = Ok(())
87532025-03-01T01:23:43.225ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87542025-03-01T01:23:43.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87552025-03-01T01:23:43.236ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 original_time_created = 2025-03-01 01:14:50.436545 UTC target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 time_created = 2025-03-01 01:14:50.436545 UTC
87562025-03-01T01:23:43.236ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.219483ms iteration = 54 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7","time_created":"2025-03-01T01:14:50.436545Z"}
87572025-03-01T01:23:43.611ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = a63de54f-9d09-4900-9e7c-ba30e6715ee4 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
87582025-03-01T01:23:43.611ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = a63de54f-9d09-4900-9e7c-ba30e6715ee4 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
87592025-03-01T01:23:43.613ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2203 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = a63de54f-9d09-4900-9e7c-ba30e6715ee4 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
87602025-03-01T01:23:44.633ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = dbdfc142-c0b6-41db-8e37-1d93b3cce1f0 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
87612025-03-01T01:23:44.634ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = dbdfc142-c0b6-41db-8e37-1d93b3cce1f0 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
87622025-03-01T01:23:44.636ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2298 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = dbdfc142-c0b6-41db-8e37-1d93b3cce1f0 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
87632025-03-01T01:23:45.655ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = fa393c1a-8b67-49e3-9b1a-3eacea9ddeef roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
87642025-03-01T01:23:45.655ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = fa393c1a-8b67-49e3-9b1a-3eacea9ddeef resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
87652025-03-01T01:23:45.657ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2272 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = fa393c1a-8b67-49e3-9b1a-3eacea9ddeef response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
87662025-03-01T01:23:46.677ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = bd453d65-204c-4600-86bf-1bf95f998f73 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
87672025-03-01T01:23:46.678ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = bd453d65-204c-4600-86bf-1bf95f998f73 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
87682025-03-01T01:23:46.679ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2075 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = bd453d65-204c-4600-86bf-1bf95f998f73 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
87692025-03-01T01:23:47.414ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 311 local_addr = [fd00:1122:3344:101::c]:34357 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = a3845d1a-b7d5-4779-a9a5-1ff55d4ad80a response_code = 200 uri = /67b03f4e-4cbd-4843-9cd9-647f610abcfc
87702025-03-01T01:23:47.699ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 1026b798-cdbc-4894-bf67-47169eee2314 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
87712025-03-01T01:23:47.699ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 1026b798-cdbc-4894-bf67-47169eee2314 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
87722025-03-01T01:23:47.700ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1830 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 1026b798-cdbc-4894-bf67-47169eee2314 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
87732025-03-01T01:23:48.721ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 803f9a78-363b-4292-afa8-94db3a2d7020 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
87742025-03-01T01:23:48.721ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 803f9a78-363b-4292-afa8-94db3a2d7020 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
87752025-03-01T01:23:48.723ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2079 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 803f9a78-363b-4292-afa8-94db3a2d7020 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
87762025-03-01T01:23:49.744ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = bf3b705a-eaac-4fd1-b1d7-f661bd02fa7c roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
87772025-03-01T01:23:49.745ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = bf3b705a-eaac-4fd1-b1d7-f661bd02fa7c resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
87782025-03-01T01:23:49.746ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2337 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = bf3b705a-eaac-4fd1-b1d7-f661bd02fa7c response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
87792025-03-01T01:23:50.766ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = f8cdfda0-2e31-4b6e-a4ca-78731c293168 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
87802025-03-01T01:23:50.766ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = f8cdfda0-2e31-4b6e-a4ca-78731c293168 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
87812025-03-01T01:23:50.768ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2209 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = f8cdfda0-2e31-4b6e-a4ca-78731c293168 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
87822025-03-01T01:23:51.787ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 698eeeb0-182c-40d9-be6e-78e533acc9b7 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
87832025-03-01T01:23:51.788ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 698eeeb0-182c-40d9-be6e-78e533acc9b7 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
87842025-03-01T01:23:51.790ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2202 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 698eeeb0-182c-40d9-be6e-78e533acc9b7 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
87852025-03-01T01:23:52.811ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 34a3aea7-8bf5-4508-b54b-43b664e44a87 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
87862025-03-01T01:23:52.811ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 34a3aea7-8bf5-4508-b54b-43b664e44a87 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
87872025-03-01T01:23:52.813ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2083 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 34a3aea7-8bf5-4508-b54b-43b664e44a87 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
87882025-03-01T01:23:53.214ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 12 reason = Timeout
87892025-03-01T01:23:53.214ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 19 reason = Timeout
87902025-03-01T01:23:53.214ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 19 reason = Timeout
87912025-03-01T01:23:53.214ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
87922025-03-01T01:23:53.214ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 11 reason = Timeout
87932025-03-01T01:23:53.214ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
87942025-03-01T01:23:53.214ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7
87952025-03-01T01:23:53.214ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 14.421\u{b5}s iteration = 11 status = {"enabled":false,"target_id":"8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7"}
87962025-03-01T01:23:53.214ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 19 reason = Timeout
87972025-03-01T01:23:53.214ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
87982025-03-01T01:23:53.214ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 55 reason = Timeout
87992025-03-01T01:23:53.214ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 10 reason = Timeout
88002025-03-01T01:23:53.214ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
88012025-03-01T01:23:53.214ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88022025-03-01T01:23:53.214ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
88032025-03-01T01:23:53.214ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
88042025-03-01T01:23:53.214ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 19 reason = Timeout
88052025-03-01T01:23:53.214ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 10 reason = Timeout
88062025-03-01T01:23:53.214ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-03-01 01:13:53.214242427 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
88072025-03-01T01:23:53.214ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 10 reason = Timeout
88082025-03-01T01:23:53.214ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
88092025-03-01T01:23:53.214ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
88102025-03-01T01:23:53.214ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 19 reason = Timeout
88112025-03-01T01:23:53.214ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 10 reason = Timeout
88122025-03-01T01:23:53.214ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
88132025-03-01T01:23:53.214ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 19 reason = Timeout
88142025-03-01T01:23:53.214ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
88152025-03-01T01:23:53.214ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 19 reason = Timeout
88162025-03-01T01:23:53.214ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 19 reason = Timeout
88172025-03-01T01:23:53.214ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
88182025-03-01T01:23:53.214ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 10 reason = Timeout
88192025-03-01T01:23:53.214ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 19 reason = Timeout
88202025-03-01T01:23:53.214ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
88212025-03-01T01:23:53.214ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
88222025-03-01T01:23:53.214ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
88232025-03-01T01:23:53.214ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
88242025-03-01T01:23:53.214ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 20 reason = Timeout
88252025-03-01T01:23:53.214ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 55 reason = Timeout
88262025-03-01T01:23:53.214ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 10 reason = Timeout
88272025-03-01T01:23:53.214ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
88282025-03-01T01:23:53.214ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
88292025-03-01T01:23:53.214ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
88302025-03-01T01:23:53.214ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
88312025-03-01T01:23:53.214ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 19 reason = Timeout
88322025-03-01T01:23:53.214ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 5 reason = Timeout
88332025-03-01T01:23:53.214ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
88342025-03-01T01:23:53.214ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 12 reason = Timeout
88352025-03-01T01:23:53.214ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 19 reason = Timeout
88362025-03-01T01:23:53.214ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
88372025-03-01T01:23:53.214ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
88382025-03-01T01:23:53.214ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 19 reason = Timeout
88392025-03-01T01:23:53.214ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
88402025-03-01T01:23:53.214ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 19 reason = Timeout
88412025-03-01T01:23:53.214ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
88422025-03-01T01:23:53.214ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 10 reason = Timeout
88432025-03-01T01:23:53.214ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
88442025-03-01T01:23:53.214ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 19 reason = Timeout
88452025-03-01T01:23:53.214ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
88462025-03-01T01:23:53.214ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 10 reason = Timeout
88472025-03-01T01:23:53.214ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
88482025-03-01T01:23:53.214ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 10 reason = Timeout
88492025-03-01T01:23:53.214ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
88502025-03-01T01:23:53.214ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 10 reason = Timeout
88512025-03-01T01:23:53.214ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
88522025-03-01T01:23:53.214ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 19 reason = Timeout
88532025-03-01T01:23:53.214ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
88542025-03-01T01:23:53.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
88552025-03-01T01:23:53.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
88562025-03-01T01:23:53.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88572025-03-01T01:23:53.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
88582025-03-01T01:23:53.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
88592025-03-01T01:23:53.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
88602025-03-01T01:23:53.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
88612025-03-01T01:23:53.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
88622025-03-01T01:23:53.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
88632025-03-01T01:23:53.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
88642025-03-01T01:23:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
88652025-03-01T01:23:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
88662025-03-01T01:23:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
88672025-03-01T01:23:53.215ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
88682025-03-01T01:23:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
88692025-03-01T01:23:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
88702025-03-01T01:23:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
88712025-03-01T01:23:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
88722025-03-01T01:23:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
88732025-03-01T01:23:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
88742025-03-01T01:23:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
88752025-03-01T01:23:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
88762025-03-01T01:23:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
88772025-03-01T01:23:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
88782025-03-01T01:23:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
88792025-03-01T01:23:53.215ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2e37f4af-57dc-468e-80e3-cf2aea2ffdc8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5f6eb3bd-0126-40e0-98ef-ee33df084158.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("5f6eb3bd-0126-40e0-98ef-ee33df084158.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1443, tv_nsec: 903024749 } })
88802025-03-01T01:23:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
88812025-03-01T01:23:53.215ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("3a9b8294-d9f3-4130-a669-e74c6f1f65a0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("450e8d93-9ed3-4721-9fe9-42521f60bc93.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a4f72c78-99c6-478d-b490-f7d8793d4173.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("a4f72c78-99c6-478d-b490-f7d8793d4173.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1443, tv_nsec: 903060440 } })
88822025-03-01T01:23:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
88832025-03-01T01:23:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
88842025-03-01T01:23:53.215ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
88852025-03-01T01:23:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
88862025-03-01T01:23:53.215ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
88872025-03-01T01:23:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
88882025-03-01T01:23:53.215ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
88892025-03-01T01:23:53.215ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.338527ms iteration = 10 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
88902025-03-01T01:23:53.215ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
88912025-03-01T01:23:53.215ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
88922025-03-01T01:23:53.215ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
88932025-03-01T01:23:53.215ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.45512ms iteration = 10 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
88942025-03-01T01:23:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
88952025-03-01T01:23:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
88962025-03-01T01:23:53.217ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88972025-03-01T01:23:53.218ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88982025-03-01T01:23:53.218ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.913969ms iteration = 19 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
88992025-03-01T01:23:53.218ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89002025-03-01T01:23:53.219ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1443, tv_nsec: 907561402 } })
89012025-03-01T01:23:53.219ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-03-01 01:13:53.214242427 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
89022025-03-01T01:23:53.219ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 5.538183ms iteration = 10 status = {"expiration":"2025-03-01T01:13:53.214242427Z","pruned":[]}
89032025-03-01T01:23:53.219ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1154
89042025-03-01T01:23:53.220ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
89052025-03-01T01:23:53.220ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
89062025-03-01T01:23:53.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
89072025-03-01T01:23:53.220ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
89082025-03-01T01:23:53.220ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
89092025-03-01T01:23:53.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
89102025-03-01T01:23:53.221ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
89112025-03-01T01:23:53.221ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
89122025-03-01T01:23:53.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
89132025-03-01T01:23:53.222ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89142025-03-01T01:23:53.223ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89152025-03-01T01:23:53.223ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89162025-03-01T01:23:53.224ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1443, tv_nsec: 912189766 } })
89172025-03-01T01:23:53.224ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1154
89182025-03-01T01:23:53.224ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
89192025-03-01T01:23:53.224ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
89202025-03-01T01:23:53.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
89212025-03-01T01:23:53.226ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
89222025-03-01T01:23:53.226ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
89232025-03-01T01:23:53.226ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
89242025-03-01T01:23:53.226ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
89252025-03-01T01:23:53.226ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
89262025-03-01T01:23:53.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
89272025-03-01T01:23:53.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
89282025-03-01T01:23:53.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
89292025-03-01T01:23:53.226ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89302025-03-01T01:23:53.228ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
89312025-03-01T01:23:53.228ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
89322025-03-01T01:23:53.228ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
89332025-03-01T01:23:53.228ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 14.317001ms iteration = 19 status = {"errors":[],"garbage_collect_requested":[]}
89342025-03-01T01:23:53.229ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
89352025-03-01T01:23:53.229ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
89362025-03-01T01:23:53.231ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 16.875764ms iteration = 10 status = {"errors":[],"found_port_ok":[]}
89372025-03-01T01:23:53.232ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89382025-03-01T01:23:53.232ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89392025-03-01T01:23:53.233ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89402025-03-01T01:23:53.234ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
89412025-03-01T01:23:53.234ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
89422025-03-01T01:23:53.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
89432025-03-01T01:23:53.235ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
89442025-03-01T01:23:53.235ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
89452025-03-01T01:23:53.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
89462025-03-01T01:23:53.236ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
89472025-03-01T01:23:53.236ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
89482025-03-01T01:23:53.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
89492025-03-01T01:23:53.239ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89502025-03-01T01:23:53.241ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
89512025-03-01T01:23:53.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
89522025-03-01T01:23:53.241ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1443, tv_nsec: 929361036 } })
89532025-03-01T01:23:53.241ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1154 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66
89542025-03-01T01:23:53.242ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
89552025-03-01T01:23:53.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
89562025-03-01T01:23:53.244ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
89572025-03-01T01:23:53.246ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 32.028873ms iteration = 55 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
89582025-03-01T01:23:53.264ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
89592025-03-01T01:23:53.264ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
89602025-03-01T01:23:53.269ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
89612025-03-01T01:23:53.269ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
89622025-03-01T01:23:53.270ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
89632025-03-01T01:23:53.270ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
89642025-03-01T01:23:53.272ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
89652025-03-01T01:23:53.272ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
89662025-03-01T01:23:53.272ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
89672025-03-01T01:23:53.272ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
89682025-03-01T01:23:53.272ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 58.190465ms iteration = 10 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
89692025-03-01T01:23:53.273ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
89702025-03-01T01:23:53.273ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
89712025-03-01T01:23:53.274ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89722025-03-01T01:23:53.276ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
89732025-03-01T01:23:53.276ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
89742025-03-01T01:23:53.276ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
89752025-03-01T01:23:53.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
89762025-03-01T01:23:53.278ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7, lookup_type: ById(8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7) } result = Ok(())
89772025-03-01T01:23:53.278ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
89782025-03-01T01:23:53.278ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
89792025-03-01T01:23:53.280ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89802025-03-01T01:23:53.280ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89812025-03-01T01:23:53.280ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
89822025-03-01T01:23:53.280ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
89832025-03-01T01:23:53.280ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
89842025-03-01T01:23:53.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
89852025-03-01T01:23:53.283ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
89862025-03-01T01:23:53.283ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
89872025-03-01T01:23:53.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
89882025-03-01T01:23:53.283ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
89892025-03-01T01:23:53.283ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
89902025-03-01T01:23:53.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
89912025-03-01T01:23:53.284ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89922025-03-01T01:23:53.286ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 71.814163ms iteration = 19 status = {"errors":[],"finish_invoked_ok":[]}
89932025-03-01T01:23:53.286ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
89942025-03-01T01:23:53.286ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
89952025-03-01T01:23:53.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
89962025-03-01T01:23:53.286ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89972025-03-01T01:23:53.288ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89982025-03-01T01:23:53.288ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
89992025-03-01T01:23:53.288ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
90002025-03-01T01:23:53.288ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
90012025-03-01T01:23:53.288ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
90022025-03-01T01:23:53.288ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
90032025-03-01T01:23:53.288ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90042025-03-01T01:23:53.289ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 74.871135ms iteration = 19 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
90052025-03-01T01:23:53.289ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
90062025-03-01T01:23:53.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
90072025-03-01T01:23:53.290ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
90082025-03-01T01:23:53.290ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
90092025-03-01T01:23:53.290ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
90102025-03-01T01:23:53.290ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
90112025-03-01T01:23:53.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
90122025-03-01T01:23:53.290ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90132025-03-01T01:23:53.290ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
90142025-03-01T01:23:53.290ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 76.60427ms iteration = 19 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
90152025-03-01T01:23:53.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
90162025-03-01T01:23:53.292ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
90172025-03-01T01:23:53.292ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
90182025-03-01T01:23:53.292ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
90192025-03-01T01:23:53.293ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
90202025-03-01T01:23:53.293ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
90212025-03-01T01:23:53.293ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 79.438608ms iteration = 19 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
90222025-03-01T01:23:53.294ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
90232025-03-01T01:23:53.294ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
90242025-03-01T01:23:53.294ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
90252025-03-01T01:23:53.296ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
90262025-03-01T01:23:53.297ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90272025-03-01T01:23:53.297ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
90282025-03-01T01:23:53.300ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
90292025-03-01T01:23:53.300ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
90302025-03-01T01:23:53.300ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
90312025-03-01T01:23:53.300ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
90322025-03-01T01:23:53.300ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
90332025-03-01T01:23:53.302ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 88.452171ms iteration = 5 status = {"nsuccess":5}
90342025-03-01T01:23:53.303ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 original_time_created = 2025-03-01 01:14:50.436545 UTC target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 time_created = 2025-03-01 01:14:50.436545 UTC
90352025-03-01T01:23:53.303ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 88.942652ms iteration = 55 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7","time_created":"2025-03-01T01:14:50.436545Z"}
90362025-03-01T01:23:53.303ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90372025-03-01T01:23:53.304ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
90382025-03-01T01:23:53.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
90392025-03-01T01:23:53.305ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90402025-03-01T01:23:53.306ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
90412025-03-01T01:23:53.306ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
90422025-03-01T01:23:53.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
90432025-03-01T01:23:53.309ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
90442025-03-01T01:23:53.310ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90452025-03-01T01:23:53.311ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
90462025-03-01T01:23:53.311ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 97.059317ms iteration = 19 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
90472025-03-01T01:23:53.313ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 3471264f-127e-4a25-bc10-2e8249e8d70a, lookup_type: ById(3471264f-127e-4a25-bc10-2e8249e8d70a) } result = Ok(())
90482025-03-01T01:23:53.313ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
90492025-03-01T01:23:53.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
90502025-03-01T01:23:53.314ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
90512025-03-01T01:23:53.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
90522025-03-01T01:23:53.316ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 101.910145ms iteration = 19 status = 0
90532025-03-01T01:23:53.319ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
90542025-03-01T01:23:53.319ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
90552025-03-01T01:23:53.319ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 105.53099ms iteration = 10 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
90562025-03-01T01:23:53.321ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 107.295836ms iteration = 19 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
90572025-03-01T01:23:53.329ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 115.298398ms iteration = 19 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
90582025-03-01T01:23:53.333ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 119.360912ms iteration = 20 status = {"physical_disks_added":0}
90592025-03-01T01:23:53.336ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
90602025-03-01T01:23:53.337ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
90612025-03-01T01:23:53.337ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
90622025-03-01T01:23:53.337ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 0a9e4b5c-53a1-4f0a-8849-98a8b1852af3 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
90632025-03-01T01:23:53.337ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
90642025-03-01T01:23:53.337ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
90652025-03-01T01:23:53.337ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
90662025-03-01T01:23:53.337ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
90672025-03-01T01:23:53.340ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90682025-03-01T01:23:53.340ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90692025-03-01T01:23:53.341ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
90702025-03-01T01:23:53.341ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
90712025-03-01T01:23:53.342ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d8bca8e4-d627-43ec-b7a1-139a051ee946", "content-length": "26", "date": "Sat, 01 Mar 2025 01:23:53 GMT"} })
90722025-03-01T01:23:53.342ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
90732025-03-01T01:23:53.342ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
90742025-03-01T01:23:53.342ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
90752025-03-01T01:23:53.342ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
90762025-03-01T01:23:53.342ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
90772025-03-01T01:23:53.342ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
90782025-03-01T01:23:53.342ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
90792025-03-01T01:23:53.342ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
90802025-03-01T01:23:53.343ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
90812025-03-01T01:23:53.343ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
90822025-03-01T01:23:53.343ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
90832025-03-01T01:23:53.343ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
90842025-03-01T01:23:53.344ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90852025-03-01T01:23:53.344ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
90862025-03-01T01:23:53.346ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 0a9e4b5c-53a1-4f0a-8849-98a8b1852af3 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
90872025-03-01T01:23:53.346ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
90882025-03-01T01:23:53.346ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-03-01 01:14:53.460216 UTC dns_group = internal generation = 1
90892025-03-01T01:23:53.346ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 132.261314ms iteration = 10 status = {"generation":1}
90902025-03-01T01:23:53.346ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
90912025-03-01T01:23:53.346ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
90922025-03-01T01:23:53.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
90932025-03-01T01:23:53.358ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
90942025-03-01T01:23:53.358ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
90952025-03-01T01:23:53.358ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
90962025-03-01T01:23:53.358ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3548f105-8e35-4171-949d-89b1fd2d35fd", "content-length": "26", "date": "Sat, 01 Mar 2025 01:23:53 GMT"} })
90972025-03-01T01:23:53.358ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
90982025-03-01T01:23:53.359ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
90992025-03-01T01:23:53.360ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
91002025-03-01T01:23:53.374ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1162 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 zone_address = fd00:1122:3344:101::2
91012025-03-01T01:23:53.375ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
91022025-03-01T01:23:53.378ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9280225e-1ffc-4bbf-9f63-8796f61e903e", "content-length": "26", "date": "Sat, 01 Mar 2025 01:23:53 GMT"} })
91032025-03-01T01:23:53.378ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1167 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
91042025-03-01T01:23:53.380ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66
91052025-03-01T01:23:53.380ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
91062025-03-01T01:23:53.382ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
91072025-03-01T01:23:53.384ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91082025-03-01T01:23:53.391ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
91092025-03-01T01:23:53.391ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
91102025-03-01T01:23:53.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
91112025-03-01T01:23:53.394ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91122025-03-01T01:23:53.396ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
91132025-03-01T01:23:53.396ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
91142025-03-01T01:23:53.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
91152025-03-01T01:23:53.416ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-03-01T01:14:49.537343Z, time_modified: 2025-03-01T01:14:49.537343Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 1682a303-6254-452b-b4cf-160ed9dc3fc9, db_silo: Silo { identity: SiloIdentity { id: 1682a303-6254-452b-b4cf-160ed9dc3fc9, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-03-01T01:14:54.631650Z, time_modified: 2025-03-01T01:14:54.631650Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "851c0b739689cfb98a2e401e6047fa98e9fcc283d9fc3f660bd69842a9c06be9" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 1682a303-6254-452b-b4cf-160ed9dc3fc9, db_silo: Silo { identity: SiloIdentity { id: 1682a303-6254-452b-b4cf-160ed9dc3fc9, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-03-01T01:14:54.631650Z, time_modified: 2025-03-01T01:14:54.631650Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "851c0b739689cfb98a2e401e6047fa98e9fcc283d9fc3f660bd69842a9c06be9" }] }) }
91162025-03-01T01:23:53.416ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 201.700889ms iteration = 10 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"1682a303-6254-452b-b4cf-160ed9dc3fc9","tls_certs":["851c0b739689cfb98a2e401e6047fa98e9fcc283d9fc3f660bd69842a9c06be9"]}},"default_endpoint":{"silo_id":"1682a303-6254-452b-b4cf-160ed9dc3fc9","tls_certs":["851c0b739689cfb98a2e401e6047fa98e9fcc283d9fc3f660bd69842a9c06be9"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
91172025-03-01T01:23:53.418ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
91182025-03-01T01:23:53.419ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = cce65e3e-6c86-4cdd-98ad-9a38c98082e8 dns_zone_name = oxide.test found_so_far = 0 version = 2
91192025-03-01T01:23:53.419ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
91202025-03-01T01:23:53.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
91212025-03-01T01:23:53.420ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91222025-03-01T01:23:53.423ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
91232025-03-01T01:23:53.423ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
91242025-03-01T01:23:53.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
91252025-03-01T01:23:53.439ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
91262025-03-01T01:23:53.439ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 225.091875ms iteration = 10 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
91272025-03-01T01:23:53.500ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
91282025-03-01T01:23:53.501ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "64e06169-6610-4c5e-96cb-9507c8d69a79", "date": "Sat, 01 Mar 2025 01:23:53 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
91292025-03-01T01:23:53.501ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
91302025-03-01T01:23:53.502ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "6b7a45bd-5c99-4970-a5cd-03530b6044bc", "date": "Sat, 01 Mar 2025 01:23:53 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
91312025-03-01T01:23:53.502ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
91322025-03-01T01:23:53.504ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
91332025-03-01T01:23:53.504ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 290.234843ms iteration = 12 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
91342025-03-01T01:23:53.569ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
91352025-03-01T01:23:53.579ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
91362025-03-01T01:23:53.580ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "6979a8c0-2899-4124-b73d-7570a33a1fdd", "content-length": "2", "date": "Sat, 01 Mar 2025 01:23:52 GMT"} })
91372025-03-01T01:23:53.582ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
91382025-03-01T01:23:53.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
91392025-03-01T01:23:53.597ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 383.620034ms iteration = 19 status = {}
91402025-03-01T01:23:53.610ZDEBGnexus (BackgroundTasks): client request SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
91412025-03-01T01:23:53.613ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = cce65e3e-6c86-4cdd-98ad-9a38c98082e8 dns_zone_name = oxide.test found_so_far = 1 version = 2
91422025-03-01T01:23:53.613ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
91432025-03-01T01:23:53.613ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-03-01 01:14:54.679503 UTC dns_group = external generation = 2
91442025-03-01T01:23:53.613ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 398.986478ms iteration = 10 status = {"generation":2}
91452025-03-01T01:23:53.613ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 399.304343ms iteration = 19 status = null
91462025-03-01T01:23:53.632ZINFOnexus (BackgroundTasks): VPC route manager sled 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
91472025-03-01T01:23:53.632ZDEBGnexus (BackgroundTasks): client request SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
91482025-03-01T01:23:53.645ZDEBGnexus (BackgroundTasks): client response SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "328cb65f-db71-44e4-873d-919059460c9f", "content-length": "372", "date": "Sat, 01 Mar 2025 01:23:53 GMT"} })
91492025-03-01T01:23:53.645ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
91502025-03-01T01:23:53.645ZDEBGnexus (BackgroundTasks): client response SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "3e04f2d0-9503-48ba-8262-86600ef795c5", "content-length": "691", "date": "Sat, 01 Mar 2025 01:23:53 GMT"} })
91512025-03-01T01:23:53.645ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
91522025-03-01T01:23:53.645ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
91532025-03-01T01:23:53.645ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
91542025-03-01T01:23:53.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
91552025-03-01T01:23:53.648ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 433.96653ms iteration = 19 status = {}
91562025-03-01T01:23:53.667ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
91572025-03-01T01:23:53.668ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "470f0b89-3892-43d3-b6d3-f6387ce83f01", "date": "Sat, 01 Mar 2025 01:23:53 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
91582025-03-01T01:23:53.668ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
91592025-03-01T01:23:53.670ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "3776697d-f543-416a-9dbe-8c649c83b9fd", "date": "Sat, 01 Mar 2025 01:23:53 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
91602025-03-01T01:23:53.670ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
91612025-03-01T01:23:53.672ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "6a312f7b-8eaa-4d7d-9a44-a23a0db5cbd8", "date": "Sat, 01 Mar 2025 01:23:53 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
91622025-03-01T01:23:53.672ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
91632025-03-01T01:23:53.674ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
91642025-03-01T01:23:53.674ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 460.0036ms iteration = 12 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
91652025-03-01T01:23:53.694ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
91662025-03-01T01:23:53.694ZDEBGnexus (BackgroundTasks): client request SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
91672025-03-01T01:23:53.694ZDEBGnexus (BackgroundTasks): client response SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "de5f70fd-265c-4b9f-a0e5-72e09381d42d", "date": "Sat, 01 Mar 2025 01:23:53 GMT"} })
91682025-03-01T01:23:53.694ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
91692025-03-01T01:23:53.694ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
91702025-03-01T01:23:53.696ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
91712025-03-01T01:23:53.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
91722025-03-01T01:23:53.700ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
91732025-03-01T01:23:53.700ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
91742025-03-01T01:23:53.703ZINFOnexus (BackgroundTasks): VPC route manager sled 3471264f-127e-4a25-bc10-2e8249e8d70a push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
91752025-03-01T01:23:53.703ZDEBGnexus (BackgroundTasks): client request SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
91762025-03-01T01:23:53.704ZDEBGnexus (BackgroundTasks): client response SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "fe41c905-a118-4dca-bd2d-8a76b421e916", "date": "Sat, 01 Mar 2025 01:23:53 GMT"} })
91772025-03-01T01:23:53.706ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 492.209746ms iteration = 19 status = {}
91782025-03-01T01:23:53.706ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
91792025-03-01T01:23:53.706ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
91802025-03-01T01:23:53.708ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 7f9c3c14-58c5-473f-8692-6376be44401e, rack_id: 4854cb88-dfba-4609-8f9d-72aac08cef66, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(cb10d0c6-a704-4231-b148-4f9ae21a03f8) } rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 switch_location = Switch0
91812025-03-01T01:23:53.708ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
91822025-03-01T01:23:53.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
91832025-03-01T01:23:53.718ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
91842025-03-01T01:23:53.718ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "1be205d9-7f84-470e-a6a3-f8937fc7f7ee", "content-length": "134", "date": "Sat, 01 Mar 2025 01:23:52 GMT"} })
91852025-03-01T01:23:53.718ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
91862025-03-01T01:23:53.718ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = cb10d0c6-a704-4231-b148-4f9ae21a03f8
91872025-03-01T01:23:53.718ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
91882025-03-01T01:23:53.718ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
91892025-03-01T01:23:53.718ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
91902025-03-01T01:23:53.718ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
91912025-03-01T01:23:53.718ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
91922025-03-01T01:23:53.718ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
91932025-03-01T01:23:53.719ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
91942025-03-01T01:23:53.719ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
91952025-03-01T01:23:53.719ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66
91962025-03-01T01:23:53.719ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
91972025-03-01T01:23:53.719ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
91982025-03-01T01:23:53.721ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
91992025-03-01T01:23:53.721ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "77bc0369-a84a-4589-8c99-939962508b77", "content-length": "2", "date": "Sat, 01 Mar 2025 01:23:53 GMT"} })
92002025-03-01T01:23:53.721ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
92012025-03-01T01:23:53.721ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "d005ddc7-3218-4698-8f4b-5e340eb93d8b", "content-length": "52", "date": "Sat, 01 Mar 2025 01:23:53 GMT"} })
92022025-03-01T01:23:53.721ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 switch_location = Switch0
92032025-03-01T01:23:53.721ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
92042025-03-01T01:23:53.818ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "d777e1ad-3208-4a80-9d1d-44b238bafc9a", "date": "Sat, 01 Mar 2025 01:23:53 GMT"} })
92052025-03-01T01:23:53.818ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 switch = Switch0
92062025-03-01T01:23:53.818ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
92072025-03-01T01:23:53.818ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "0f9d7877-2fe2-44de-af34-080c2c3d358e", "content-length": "682", "date": "Sat, 01 Mar 2025 01:23:53 GMT"} })
92082025-03-01T01:23:53.818ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
92092025-03-01T01:23:53.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
92102025-03-01T01:23:53.822ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
92112025-03-01T01:23:53.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
92122025-03-01T01:23:53.825ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
92132025-03-01T01:23:53.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
92142025-03-01T01:23:53.827ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
92152025-03-01T01:23:53.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
92162025-03-01T01:23:53.834ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 620.312376ms iteration = 19 status = {}
92172025-03-01T01:23:53.834ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 94861e7d-6a53-4508-9db3-41f2979beb16 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
92182025-03-01T01:23:53.834ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 94861e7d-6a53-4508-9db3-41f2979beb16 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
92192025-03-01T01:23:53.836ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1655 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 94861e7d-6a53-4508-9db3-41f2979beb16 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
92202025-03-01T01:23:54.854ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = a9aa8263-24da-4882-ad5e-0f8d384c026d roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
92212025-03-01T01:23:54.854ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = a9aa8263-24da-4882-ad5e-0f8d384c026d resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
92222025-03-01T01:23:54.856ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2098 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = a9aa8263-24da-4882-ad5e-0f8d384c026d response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
92232025-03-01T01:23:55.876ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 42bef218-512c-44ac-8fc1-80e1213e93e2 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
92242025-03-01T01:23:55.876ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 42bef218-512c-44ac-8fc1-80e1213e93e2 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
92252025-03-01T01:23:55.878ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2433 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 42bef218-512c-44ac-8fc1-80e1213e93e2 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
92262025-03-01T01:23:56.897ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 7a1368fc-ea5d-4637-a982-5ac5af0aeda3 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
92272025-03-01T01:23:56.897ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 7a1368fc-ea5d-4637-a982-5ac5af0aeda3 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
92282025-03-01T01:23:56.900ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2587 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 7a1368fc-ea5d-4637-a982-5ac5af0aeda3 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
92292025-03-01T01:23:57.414ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 343 local_addr = [fd00:1122:3344:101::c]:34357 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = a7acc653-e7b6-4029-b451-2e18c6698479 response_code = 200 uri = /67b03f4e-4cbd-4843-9cd9-647f610abcfc
92302025-03-01T01:23:57.919ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 6b883ea2-2dd2-4453-ba5b-4ead576b60ef roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
92312025-03-01T01:23:57.920ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 6b883ea2-2dd2-4453-ba5b-4ead576b60ef resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
92322025-03-01T01:23:57.922ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2621 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 6b883ea2-2dd2-4453-ba5b-4ead576b60ef response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
92332025-03-01T01:23:58.942ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 44e84e1c-163a-40e0-8bbd-adcdff563533 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
92342025-03-01T01:23:58.942ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 44e84e1c-163a-40e0-8bbd-adcdff563533 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
92352025-03-01T01:23:58.943ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1969 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 44e84e1c-163a-40e0-8bbd-adcdff563533 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
92362025-03-01T01:23:59.963ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = fdb6cf5e-9fda-495b-9595-2c66f157524a roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
92372025-03-01T01:23:59.964ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = fdb6cf5e-9fda-495b-9595-2c66f157524a resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
92382025-03-01T01:23:59.965ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2011 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = fdb6cf5e-9fda-495b-9595-2c66f157524a response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
92392025-03-01T01:24:00.985ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 72cab7bc-818d-4b93-87e3-1b511535d16d roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
92402025-03-01T01:24:00.986ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 72cab7bc-818d-4b93-87e3-1b511535d16d resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
92412025-03-01T01:24:00.988ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2426 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 72cab7bc-818d-4b93-87e3-1b511535d16d response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
92422025-03-01T01:24:02.007ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 036a1c0e-7150-43e9-91a1-f331de9713d6 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
92432025-03-01T01:24:02.007ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 036a1c0e-7150-43e9-91a1-f331de9713d6 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
92442025-03-01T01:24:02.009ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2226 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 036a1c0e-7150-43e9-91a1-f331de9713d6 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
92452025-03-01T01:24:03.029ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 430cbcfe-062e-433e-ae54-ec22aaa7dc45 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
92462025-03-01T01:24:03.030ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 430cbcfe-062e-433e-ae54-ec22aaa7dc45 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
92472025-03-01T01:24:03.032ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2343 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 430cbcfe-062e-433e-ae54-ec22aaa7dc45 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
92482025-03-01T01:24:03.214ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 56 reason = Timeout
92492025-03-01T01:24:03.214ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 56 reason = Timeout
92502025-03-01T01:24:03.214ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92512025-03-01T01:24:03.214ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
92522025-03-01T01:24:03.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92532025-03-01T01:24:03.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
92542025-03-01T01:24:03.216ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92552025-03-01T01:24:03.219ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
92562025-03-01T01:24:03.219ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92572025-03-01T01:24:03.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92582025-03-01T01:24:03.221ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92592025-03-01T01:24:03.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92602025-03-01T01:24:03.223ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92612025-03-01T01:24:03.226ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7, lookup_type: ById(8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7) } result = Ok(())
92622025-03-01T01:24:03.226ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92632025-03-01T01:24:03.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92642025-03-01T01:24:03.237ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 original_time_created = 2025-03-01 01:14:50.436545 UTC target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 time_created = 2025-03-01 01:14:50.436545 UTC
92652025-03-01T01:24:03.237ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.57918ms iteration = 56 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7","time_created":"2025-03-01T01:14:50.436545Z"}
92662025-03-01T01:24:03.244ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
92672025-03-01T01:24:03.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
92682025-03-01T01:24:03.246ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 32.284548ms iteration = 56 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
92692025-03-01T01:24:04.052ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 609516f3-53db-4707-8e8d-41f2affad139 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
92702025-03-01T01:24:04.053ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 609516f3-53db-4707-8e8d-41f2affad139 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
92712025-03-01T01:24:04.054ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2041 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 609516f3-53db-4707-8e8d-41f2affad139 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
92722025-03-01T01:24:05.075ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 00db5db0-aaa5-484b-8968-804f953c4aea roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
92732025-03-01T01:24:05.075ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 00db5db0-aaa5-484b-8968-804f953c4aea resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
92742025-03-01T01:24:05.077ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2286 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 00db5db0-aaa5-484b-8968-804f953c4aea response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
92752025-03-01T01:24:06.097ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 0e08fdfe-f700-48d2-8199-7e3bcf5c15ee roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
92762025-03-01T01:24:06.097ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 0e08fdfe-f700-48d2-8199-7e3bcf5c15ee resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
92772025-03-01T01:24:06.099ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2201 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 0e08fdfe-f700-48d2-8199-7e3bcf5c15ee response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
92782025-03-01T01:24:07.121ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = dba00f45-98cf-4c60-b9ce-ab4531d99a42 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
92792025-03-01T01:24:07.121ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = dba00f45-98cf-4c60-b9ce-ab4531d99a42 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
92802025-03-01T01:24:07.123ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2075 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = dba00f45-98cf-4c60-b9ce-ab4531d99a42 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
92812025-03-01T01:24:07.414ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 372 local_addr = [fd00:1122:3344:101::c]:34357 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = 4e94356b-9542-45c6-8ca5-34b50331d845 response_code = 200 uri = /67b03f4e-4cbd-4843-9cd9-647f610abcfc
92822025-03-01T01:24:08.144ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = b42b2f28-53f3-40b0-8e49-22a9ccd3bbd0 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
92832025-03-01T01:24:08.144ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = b42b2f28-53f3-40b0-8e49-22a9ccd3bbd0 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
92842025-03-01T01:24:08.146ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2117 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = b42b2f28-53f3-40b0-8e49-22a9ccd3bbd0 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
92852025-03-01T01:24:09.165ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = cbfa70fe-66ff-48ec-ad13-97e8e899903b roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
92862025-03-01T01:24:09.166ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = cbfa70fe-66ff-48ec-ad13-97e8e899903b resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
92872025-03-01T01:24:09.167ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2201 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = cbfa70fe-66ff-48ec-ad13-97e8e899903b response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
92882025-03-01T01:24:10.188ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = d3231cb8-fb20-404c-8e08-91d0bbbb5dcd roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
92892025-03-01T01:24:10.188ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = d3231cb8-fb20-404c-8e08-91d0bbbb5dcd resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
92902025-03-01T01:24:10.190ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2355 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = d3231cb8-fb20-404c-8e08-91d0bbbb5dcd response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
92912025-03-01T01:24:11.210ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = b228c98d-4a78-4f82-a4b9-211b0ad2bebd roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
92922025-03-01T01:24:11.210ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = b228c98d-4a78-4f82-a4b9-211b0ad2bebd resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
92932025-03-01T01:24:11.212ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1964 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = b228c98d-4a78-4f82-a4b9-211b0ad2bebd response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
92942025-03-01T01:24:12.232ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 9fd54d51-a35c-43fd-9f97-20fc49f3c777 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
92952025-03-01T01:24:12.232ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 9fd54d51-a35c-43fd-9f97-20fc49f3c777 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
92962025-03-01T01:24:12.234ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2328 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 9fd54d51-a35c-43fd-9f97-20fc49f3c777 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
92972025-03-01T01:24:13.214ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 57 reason = Timeout
92982025-03-01T01:24:13.214ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 57 reason = Timeout
92992025-03-01T01:24:13.214ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
93002025-03-01T01:24:13.214ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
93012025-03-01T01:24:13.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
93022025-03-01T01:24:13.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
93032025-03-01T01:24:13.216ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93042025-03-01T01:24:13.217ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
93052025-03-01T01:24:13.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
93062025-03-01T01:24:13.219ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
93072025-03-01T01:24:13.219ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
93082025-03-01T01:24:13.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
93092025-03-01T01:24:13.219ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.700675ms iteration = 57 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
93102025-03-01T01:24:13.221ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
93112025-03-01T01:24:13.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
93122025-03-01T01:24:13.223ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93132025-03-01T01:24:13.225ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7, lookup_type: ById(8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7) } result = Ok(())
93142025-03-01T01:24:13.225ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
93152025-03-01T01:24:13.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
93162025-03-01T01:24:13.238ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 original_time_created = 2025-03-01 01:14:50.436545 UTC target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 time_created = 2025-03-01 01:14:50.436545 UTC
93172025-03-01T01:24:13.238ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.937088ms iteration = 57 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7","time_created":"2025-03-01T01:14:50.436545Z"}
93182025-03-01T01:24:13.253ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 3f6cf61b-82cd-4d31-84bc-92d985489b67 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
93192025-03-01T01:24:13.254ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 3f6cf61b-82cd-4d31-84bc-92d985489b67 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
93202025-03-01T01:24:13.255ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2110 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 3f6cf61b-82cd-4d31-84bc-92d985489b67 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
93212025-03-01T01:24:14.276ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 1ea86875-ba1c-480d-ae20-84d84ab57813 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
93222025-03-01T01:24:14.276ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 1ea86875-ba1c-480d-ae20-84d84ab57813 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
93232025-03-01T01:24:14.278ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2202 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 1ea86875-ba1c-480d-ae20-84d84ab57813 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
93242025-03-01T01:24:15.298ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 8574f915-33cd-4b65-876c-7c784c0190f6 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
93252025-03-01T01:24:15.299ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 8574f915-33cd-4b65-876c-7c784c0190f6 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
93262025-03-01T01:24:15.301ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2226 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 8574f915-33cd-4b65-876c-7c784c0190f6 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
93272025-03-01T01:24:16.321ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 674b0aea-7086-4fab-9227-caf84d25ed82 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
93282025-03-01T01:24:16.321ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 674b0aea-7086-4fab-9227-caf84d25ed82 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
93292025-03-01T01:24:16.323ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2306 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 674b0aea-7086-4fab-9227-caf84d25ed82 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
93302025-03-01T01:24:17.343ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 7129ea21-eac3-4c0d-b199-ec7b716a2eed roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
93312025-03-01T01:24:17.343ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 7129ea21-eac3-4c0d-b199-ec7b716a2eed resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
93322025-03-01T01:24:17.345ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1885 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 7129ea21-eac3-4c0d-b199-ec7b716a2eed response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
93332025-03-01T01:24:17.414ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 336 local_addr = [fd00:1122:3344:101::c]:34357 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = 2fa53b44-1a52-4433-8415-318aea69449b response_code = 200 uri = /67b03f4e-4cbd-4843-9cd9-647f610abcfc
93342025-03-01T01:24:18.365ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 19d79d64-78d6-4934-b2c5-19c36893d958 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
93352025-03-01T01:24:18.365ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 19d79d64-78d6-4934-b2c5-19c36893d958 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
93362025-03-01T01:24:18.367ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2385 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 19d79d64-78d6-4934-b2c5-19c36893d958 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
93372025-03-01T01:24:19.387ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = ff1fd3de-4c23-432c-8862-69337471f3c7 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
93382025-03-01T01:24:19.387ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = ff1fd3de-4c23-432c-8862-69337471f3c7 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
93392025-03-01T01:24:19.389ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2187 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = ff1fd3de-4c23-432c-8862-69337471f3c7 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
93402025-03-01T01:24:20.409ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 31be2e56-9951-453a-92a5-9b850fda481e roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
93412025-03-01T01:24:20.409ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 31be2e56-9951-453a-92a5-9b850fda481e resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
93422025-03-01T01:24:20.411ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2116 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 31be2e56-9951-453a-92a5-9b850fda481e response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
93432025-03-01T01:24:21.431ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 7a6b0870-52ad-4218-9c10-47b8518b7bdc roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
93442025-03-01T01:24:21.431ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 7a6b0870-52ad-4218-9c10-47b8518b7bdc resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
93452025-03-01T01:24:21.433ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2282 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 7a6b0870-52ad-4218-9c10-47b8518b7bdc response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
93462025-03-01T01:24:22.452ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = b53d2069-957f-430c-8c8b-8c59025be45c roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
93472025-03-01T01:24:22.453ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = b53d2069-957f-430c-8c8b-8c59025be45c resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
93482025-03-01T01:24:22.454ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1869 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = b53d2069-957f-430c-8c8b-8c59025be45c response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
93492025-03-01T01:24:23.214ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 20 reason = Timeout
93502025-03-01T01:24:23.214ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 20 reason = Timeout
93512025-03-01T01:24:23.214ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
93522025-03-01T01:24:23.214ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
93532025-03-01T01:24:23.214ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 58 reason = Timeout
93542025-03-01T01:24:23.214ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 20 reason = Timeout
93552025-03-01T01:24:23.214ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
93562025-03-01T01:24:23.214ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
93572025-03-01T01:24:23.214ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 20 reason = Timeout
93582025-03-01T01:24:23.214ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
93592025-03-01T01:24:23.214ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 20 reason = Timeout
93602025-03-01T01:24:23.214ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
93612025-03-01T01:24:23.214ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
93622025-03-01T01:24:23.214ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 20 reason = Timeout
93632025-03-01T01:24:23.214ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
93642025-03-01T01:24:23.214ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 20 reason = Timeout
93652025-03-01T01:24:23.214ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
93662025-03-01T01:24:23.214ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 20 reason = Timeout
93672025-03-01T01:24:23.214ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 20 reason = Timeout
93682025-03-01T01:24:23.214ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
93692025-03-01T01:24:23.214ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
93702025-03-01T01:24:23.214ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 20 reason = Timeout
93712025-03-01T01:24:23.214ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
93722025-03-01T01:24:23.214ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 58 reason = Timeout
93732025-03-01T01:24:23.214ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
93742025-03-01T01:24:23.214ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
93752025-03-01T01:24:23.214ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 20 reason = Timeout
93762025-03-01T01:24:23.214ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 20 reason = Timeout
93772025-03-01T01:24:23.214ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
93782025-03-01T01:24:23.214ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
93792025-03-01T01:24:23.215ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 20 reason = Timeout
93802025-03-01T01:24:23.215ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 20 reason = Timeout
93812025-03-01T01:24:23.215ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
93822025-03-01T01:24:23.215ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 20 reason = Timeout
93832025-03-01T01:24:23.215ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
93842025-03-01T01:24:23.215ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 21 reason = Timeout
93852025-03-01T01:24:23.215ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
93862025-03-01T01:24:23.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
93872025-03-01T01:24:23.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
93882025-03-01T01:24:23.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
93892025-03-01T01:24:23.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
93902025-03-01T01:24:23.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
93912025-03-01T01:24:23.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
93922025-03-01T01:24:23.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
93932025-03-01T01:24:23.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
93942025-03-01T01:24:23.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
93952025-03-01T01:24:23.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
93962025-03-01T01:24:23.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
93972025-03-01T01:24:23.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
93982025-03-01T01:24:23.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
93992025-03-01T01:24:23.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
94002025-03-01T01:24:23.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
94012025-03-01T01:24:23.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
94022025-03-01T01:24:23.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
94032025-03-01T01:24:23.218ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1473, tv_nsec: 906398528 } })
94042025-03-01T01:24:23.218ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1154
94052025-03-01T01:24:23.219ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94062025-03-01T01:24:23.221ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 6.083684ms iteration = 20 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
94072025-03-01T01:24:23.221ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
94082025-03-01T01:24:23.221ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
94092025-03-01T01:24:23.221ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94102025-03-01T01:24:23.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
94112025-03-01T01:24:23.224ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94122025-03-01T01:24:23.224ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
94132025-03-01T01:24:23.224ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
94142025-03-01T01:24:23.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
94152025-03-01T01:24:23.225ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94162025-03-01T01:24:23.227ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
94172025-03-01T01:24:23.227ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
94182025-03-01T01:24:23.227ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 12.174698ms iteration = 20 status = {"errors":[],"garbage_collect_requested":[]}
94192025-03-01T01:24:23.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
94202025-03-01T01:24:23.227ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
94212025-03-01T01:24:23.227ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
94222025-03-01T01:24:23.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
94232025-03-01T01:24:23.228ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94242025-03-01T01:24:23.229ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94252025-03-01T01:24:23.229ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1473, tv_nsec: 917908052 } })
94262025-03-01T01:24:23.230ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1154
94272025-03-01T01:24:23.231ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
94282025-03-01T01:24:23.231ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
94292025-03-01T01:24:23.231ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
94302025-03-01T01:24:23.232ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
94312025-03-01T01:24:23.232ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
94322025-03-01T01:24:23.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
94332025-03-01T01:24:23.232ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
94342025-03-01T01:24:23.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
94352025-03-01T01:24:23.233ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94362025-03-01T01:24:23.235ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
94372025-03-01T01:24:23.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
94382025-03-01T01:24:23.236ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94392025-03-01T01:24:23.236ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
94402025-03-01T01:24:23.237ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
94412025-03-01T01:24:23.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
94422025-03-01T01:24:23.237ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
94432025-03-01T01:24:23.237ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1473, tv_nsec: 925291592 } })
94442025-03-01T01:24:23.237ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1154 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66
94452025-03-01T01:24:23.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
94462025-03-01T01:24:23.237ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
94472025-03-01T01:24:23.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
94482025-03-01T01:24:23.238ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
94492025-03-01T01:24:23.238ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
94502025-03-01T01:24:23.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
94512025-03-01T01:24:23.245ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94522025-03-01T01:24:23.248ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7, lookup_type: ById(8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7) } result = Ok(())
94532025-03-01T01:24:23.248ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
94542025-03-01T01:24:23.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
94552025-03-01T01:24:23.260ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
94562025-03-01T01:24:23.260ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
94572025-03-01T01:24:23.260ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
94582025-03-01T01:24:23.261ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
94592025-03-01T01:24:23.264ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
94602025-03-01T01:24:23.264ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
94612025-03-01T01:24:23.264ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
94622025-03-01T01:24:23.264ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
94632025-03-01T01:24:23.264ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 original_time_created = 2025-03-01 01:14:50.436545 UTC target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 time_created = 2025-03-01 01:14:50.436545 UTC
94642025-03-01T01:24:23.265ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 50.161762ms iteration = 58 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7","time_created":"2025-03-01T01:14:50.436545Z"}
94652025-03-01T01:24:23.275ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
94662025-03-01T01:24:23.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
94672025-03-01T01:24:23.276ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
94682025-03-01T01:24:23.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
94692025-03-01T01:24:23.279ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 64.890322ms iteration = 20 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
94702025-03-01T01:24:23.283ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
94712025-03-01T01:24:23.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
94722025-03-01T01:24:23.284ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 69.504836ms iteration = 20 status = {"errors":[],"finish_invoked_ok":[]}
94732025-03-01T01:24:23.286ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
94742025-03-01T01:24:23.287ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
94752025-03-01T01:24:23.289ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94762025-03-01T01:24:23.289ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94772025-03-01T01:24:23.290ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
94782025-03-01T01:24:23.290ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 75.928157ms iteration = 20 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
94792025-03-01T01:24:23.292ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
94802025-03-01T01:24:23.292ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
94812025-03-01T01:24:23.292ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
94822025-03-01T01:24:23.292ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 3471264f-127e-4a25-bc10-2e8249e8d70a, lookup_type: ById(3471264f-127e-4a25-bc10-2e8249e8d70a) } result = Ok(())
94832025-03-01T01:24:23.292ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
94842025-03-01T01:24:23.293ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
94852025-03-01T01:24:23.294ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
94862025-03-01T01:24:23.294ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
94872025-03-01T01:24:23.300ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
94882025-03-01T01:24:23.300ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
94892025-03-01T01:24:23.300ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0b628ff9-4883-4967-ba33-c9dd9db0b23b", "content-length": "26", "date": "Sat, 01 Mar 2025 01:24:23 GMT"} })
94902025-03-01T01:24:23.300ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
94912025-03-01T01:24:23.300ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94922025-03-01T01:24:23.303ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 88.551784ms iteration = 20 status = 0
94932025-03-01T01:24:23.303ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
94942025-03-01T01:24:23.303ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
94952025-03-01T01:24:23.303ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
94962025-03-01T01:24:23.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
94972025-03-01T01:24:23.309ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 94.969675ms iteration = 58 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
94982025-03-01T01:24:23.315ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
94992025-03-01T01:24:23.315ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
95002025-03-01T01:24:23.315ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
95012025-03-01T01:24:23.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
95022025-03-01T01:24:23.316ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
95032025-03-01T01:24:23.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
95042025-03-01T01:24:23.318ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 103.772034ms iteration = 20 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
95052025-03-01T01:24:23.331ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1162 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 zone_address = fd00:1122:3344:101::2
95062025-03-01T01:24:23.331ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
95072025-03-01T01:24:23.332ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1ff3a8de-38b2-4a6e-9829-fc3e9ffad63f", "content-length": "26", "date": "Sat, 01 Mar 2025 01:24:23 GMT"} })
95082025-03-01T01:24:23.332ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1167 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
95092025-03-01T01:24:23.334ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66
95102025-03-01T01:24:23.337ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
95112025-03-01T01:24:23.337ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
95122025-03-01T01:24:23.337ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f9d32885-4e2b-48e1-8648-06782c0b1a61", "content-length": "26", "date": "Sat, 01 Mar 2025 01:24:23 GMT"} })
95132025-03-01T01:24:23.337ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
95142025-03-01T01:24:23.341ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
95152025-03-01T01:24:23.341ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 126.276253ms iteration = 20 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
95162025-03-01T01:24:23.341ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
95172025-03-01T01:24:23.358ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 144.141586ms iteration = 20 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
95182025-03-01T01:24:23.366ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
95192025-03-01T01:24:23.366ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
95202025-03-01T01:24:23.366ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 151.570877ms iteration = 20 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
95212025-03-01T01:24:23.390ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
95222025-03-01T01:24:23.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
95232025-03-01T01:24:23.396ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95242025-03-01T01:24:23.398ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
95252025-03-01T01:24:23.398ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
95262025-03-01T01:24:23.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
95272025-03-01T01:24:23.443ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 228.089147ms iteration = 21 status = {"physical_disks_added":0}
95282025-03-01T01:24:23.471ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 256.698649ms iteration = 20 status = {}
95292025-03-01T01:24:23.474ZINFOnexus (BackgroundTasks): VPC route manager sled 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
95302025-03-01T01:24:23.474ZDEBGnexus (BackgroundTasks): client request SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
95312025-03-01T01:24:23.502ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
95322025-03-01T01:24:23.502ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "6618eaef-6c17-4937-bb3f-588b1f7f8e5d", "content-length": "2", "date": "Sat, 01 Mar 2025 01:24:22 GMT"} })
95332025-03-01T01:24:23.504ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
95342025-03-01T01:24:23.504ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
95352025-03-01T01:24:23.507ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 292.482028ms iteration = 20 status = null
95362025-03-01T01:24:23.513ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 3d11ed85-561b-451b-840b-95f1e4055f35 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
95372025-03-01T01:24:23.514ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 3d11ed85-561b-451b-840b-95f1e4055f35 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
95382025-03-01T01:24:23.514ZDEBGnexus (BackgroundTasks): client response SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "8e75f074-d9ec-4525-acc0-69945913814a", "content-length": "372", "date": "Sat, 01 Mar 2025 01:24:23 GMT"} })
95392025-03-01T01:24:23.514ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
95402025-03-01T01:24:23.514ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
95412025-03-01T01:24:23.515ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95422025-03-01T01:24:23.516ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2821 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 3d11ed85-561b-451b-840b-95f1e4055f35 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
95432025-03-01T01:24:23.517ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
95442025-03-01T01:24:23.517ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
95452025-03-01T01:24:23.517ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
95462025-03-01T01:24:23.570ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
95472025-03-01T01:24:23.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
95482025-03-01T01:24:23.581ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 7f9c3c14-58c5-473f-8692-6376be44401e, rack_id: 4854cb88-dfba-4609-8f9d-72aac08cef66, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(cb10d0c6-a704-4231-b148-4f9ae21a03f8) } rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 switch_location = Switch0
95492025-03-01T01:24:23.581ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
95502025-03-01T01:24:23.581ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
95512025-03-01T01:24:23.581ZDEBGnexus (BackgroundTasks): client request SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
95522025-03-01T01:24:23.581ZDEBGnexus (BackgroundTasks): client response SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "d7e7bed4-9993-433d-8cc4-581732b65d1f", "date": "Sat, 01 Mar 2025 01:24:23 GMT"} })
95532025-03-01T01:24:23.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
95542025-03-01T01:24:23.581ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
95552025-03-01T01:24:23.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
95562025-03-01T01:24:23.585ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
95572025-03-01T01:24:23.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
95582025-03-01T01:24:23.590ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
95592025-03-01T01:24:23.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
95602025-03-01T01:24:23.593ZINFOnexus (BackgroundTasks): VPC route manager sled 3471264f-127e-4a25-bc10-2e8249e8d70a push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
95612025-03-01T01:24:23.593ZDEBGnexus (BackgroundTasks): client request SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
95622025-03-01T01:24:23.594ZDEBGnexus (BackgroundTasks): client response SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "0e62acd7-71cc-4887-98a1-ff5e28794e26", "date": "Sat, 01 Mar 2025 01:24:23 GMT"} })
95632025-03-01T01:24:23.595ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
95642025-03-01T01:24:23.595ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "800510f8-a2f9-4063-8f4e-d84d90f107c6", "content-length": "134", "date": "Sat, 01 Mar 2025 01:24:22 GMT"} })
95652025-03-01T01:24:23.596ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
95662025-03-01T01:24:23.596ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = cb10d0c6-a704-4231-b148-4f9ae21a03f8
95672025-03-01T01:24:23.596ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
95682025-03-01T01:24:23.596ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
95692025-03-01T01:24:23.596ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
95702025-03-01T01:24:23.596ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
95712025-03-01T01:24:23.596ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
95722025-03-01T01:24:23.596ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
95732025-03-01T01:24:23.596ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
95742025-03-01T01:24:23.596ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
95752025-03-01T01:24:23.596ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66
95762025-03-01T01:24:23.596ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
95772025-03-01T01:24:23.597ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 382.278697ms iteration = 20 status = {}
95782025-03-01T01:24:23.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
95792025-03-01T01:24:23.599ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
95802025-03-01T01:24:23.599ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "19cd8ef6-d83b-4414-8cf9-ec1103926d8c", "content-length": "2", "date": "Sat, 01 Mar 2025 01:24:22 GMT"} })
95812025-03-01T01:24:23.599ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
95822025-03-01T01:24:23.599ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "8419157d-3719-4a1e-8d5f-af9d17916b36", "content-length": "52", "date": "Sat, 01 Mar 2025 01:24:22 GMT"} })
95832025-03-01T01:24:23.599ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 switch_location = Switch0
95842025-03-01T01:24:23.599ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
95852025-03-01T01:24:23.628ZDEBGnexus (BackgroundTasks): client request SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
95862025-03-01T01:24:23.714ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "bfb355a9-f992-4177-8ad7-b5d306dd75a6", "date": "Sat, 01 Mar 2025 01:24:23 GMT"} })
95872025-03-01T01:24:23.714ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 switch = Switch0
95882025-03-01T01:24:23.714ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
95892025-03-01T01:24:23.714ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "01a8a291-ad2f-41e4-b391-3e85a138d035", "content-length": "682", "date": "Sat, 01 Mar 2025 01:24:23 GMT"} })
95902025-03-01T01:24:23.714ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
95912025-03-01T01:24:23.715ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
95922025-03-01T01:24:23.715ZDEBGnexus (BackgroundTasks): client response SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "b923e844-f640-46cc-8d27-4a22b43278a8", "content-length": "691", "date": "Sat, 01 Mar 2025 01:24:23 GMT"} })
95932025-03-01T01:24:23.715ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
95942025-03-01T01:24:23.715ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
95952025-03-01T01:24:23.715ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
95962025-03-01T01:24:23.717ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 502.492976ms iteration = 20 status = {}
95972025-03-01T01:24:23.718ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
95982025-03-01T01:24:23.718ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
95992025-03-01T01:24:23.817ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
96002025-03-01T01:24:23.817ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
96012025-03-01T01:24:23.819ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
96022025-03-01T01:24:23.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
96032025-03-01T01:24:23.827ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 612.300913ms iteration = 20 status = {}
96042025-03-01T01:24:24.537ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = ff9d9922-20ec-431b-a302-3c7dfd8c3408 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
96052025-03-01T01:24:24.537ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = ff9d9922-20ec-431b-a302-3c7dfd8c3408 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
96062025-03-01T01:24:24.539ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2179 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = ff9d9922-20ec-431b-a302-3c7dfd8c3408 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
96072025-03-01T01:24:25.559ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = fa67f5b7-ba3e-476f-b796-52a85fe81d00 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
96082025-03-01T01:24:25.559ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = fa67f5b7-ba3e-476f-b796-52a85fe81d00 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
96092025-03-01T01:24:25.562ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2859 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = fa67f5b7-ba3e-476f-b796-52a85fe81d00 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
96102025-03-01T01:24:26.581ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = d16afdee-d0eb-4ec7-89b8-3674308fb074 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
96112025-03-01T01:24:26.581ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = d16afdee-d0eb-4ec7-89b8-3674308fb074 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
96122025-03-01T01:24:26.583ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2634 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = d16afdee-d0eb-4ec7-89b8-3674308fb074 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
96132025-03-01T01:24:27.414ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 317 local_addr = [fd00:1122:3344:101::c]:34357 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = c656b180-b26a-49a8-bc72-6cfec9812a30 response_code = 200 uri = /67b03f4e-4cbd-4843-9cd9-647f610abcfc
96142025-03-01T01:24:27.603ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 207d87df-e08e-43b1-902c-d5db94cbe60f roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
96152025-03-01T01:24:27.603ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 207d87df-e08e-43b1-902c-d5db94cbe60f resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
96162025-03-01T01:24:27.605ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1725 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 207d87df-e08e-43b1-902c-d5db94cbe60f response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
96172025-03-01T01:24:28.625ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 5da0eef4-b5b7-4fde-ba73-25e267b67c81 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
96182025-03-01T01:24:28.626ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 5da0eef4-b5b7-4fde-ba73-25e267b67c81 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
96192025-03-01T01:24:28.627ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2408 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 5da0eef4-b5b7-4fde-ba73-25e267b67c81 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
96202025-03-01T01:24:29.647ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 7c0c5023-30c0-4cd5-870b-dab68916177d roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
96212025-03-01T01:24:29.647ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 7c0c5023-30c0-4cd5-870b-dab68916177d resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
96222025-03-01T01:24:29.649ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2552 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 7c0c5023-30c0-4cd5-870b-dab68916177d response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
96232025-03-01T01:24:30.669ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c9f23e82-d633-4633-b18b-e32034099afb roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
96242025-03-01T01:24:30.670ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c9f23e82-d633-4633-b18b-e32034099afb resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
96252025-03-01T01:24:30.671ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2162 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c9f23e82-d633-4633-b18b-e32034099afb response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
96262025-03-01T01:24:31.691ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 7c241261-c559-43be-b070-539e9d7ecb27 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
96272025-03-01T01:24:31.691ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 7c241261-c559-43be-b070-539e9d7ecb27 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
96282025-03-01T01:24:31.692ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1883 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 7c241261-c559-43be-b070-539e9d7ecb27 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
96292025-03-01T01:24:32.711ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 1d376a28-bf6f-4eb6-9be5-4f6d420075a1 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
96302025-03-01T01:24:32.712ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 1d376a28-bf6f-4eb6-9be5-4f6d420075a1 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
96312025-03-01T01:24:32.713ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1854 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 1d376a28-bf6f-4eb6-9be5-4f6d420075a1 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
96322025-03-01T01:24:33.213ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 59 reason = Timeout
96332025-03-01T01:24:33.213ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 59 reason = Timeout
96342025-03-01T01:24:33.213ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96352025-03-01T01:24:33.213ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
96362025-03-01T01:24:33.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
96372025-03-01T01:24:33.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96382025-03-01T01:24:33.215ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
96392025-03-01T01:24:33.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
96402025-03-01T01:24:33.216ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96412025-03-01T01:24:33.219ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
96422025-03-01T01:24:33.219ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96432025-03-01T01:24:33.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96442025-03-01T01:24:33.220ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96452025-03-01T01:24:33.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96462025-03-01T01:24:33.222ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96472025-03-01T01:24:33.224ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7, lookup_type: ById(8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7) } result = Ok(())
96482025-03-01T01:24:33.224ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96492025-03-01T01:24:33.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96502025-03-01T01:24:33.236ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 original_time_created = 2025-03-01 01:14:50.436545 UTC target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 time_created = 2025-03-01 01:14:50.436545 UTC
96512025-03-01T01:24:33.236ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.619931ms iteration = 59 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7","time_created":"2025-03-01T01:14:50.436545Z"}
96522025-03-01T01:24:33.245ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.551423ms iteration = 59 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
96532025-03-01T01:24:33.732ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 15639f16-66ab-40d1-8a3d-1447d8e79112 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
96542025-03-01T01:24:33.733ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 15639f16-66ab-40d1-8a3d-1447d8e79112 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
96552025-03-01T01:24:33.734ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2141 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 15639f16-66ab-40d1-8a3d-1447d8e79112 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
96562025-03-01T01:24:34.755ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c63d36e5-aa02-479e-9f7d-2d10f37edf86 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
96572025-03-01T01:24:34.755ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c63d36e5-aa02-479e-9f7d-2d10f37edf86 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
96582025-03-01T01:24:34.757ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2212 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c63d36e5-aa02-479e-9f7d-2d10f37edf86 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
96592025-03-01T01:24:35.777ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c8f99533-ef07-4c2c-9be5-947a716aad55 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
96602025-03-01T01:24:35.777ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c8f99533-ef07-4c2c-9be5-947a716aad55 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
96612025-03-01T01:24:35.779ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1922 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c8f99533-ef07-4c2c-9be5-947a716aad55 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
96622025-03-01T01:24:36.798ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 24e35701-7fc2-425f-9323-9e423e776b33 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
96632025-03-01T01:24:36.799ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 24e35701-7fc2-425f-9323-9e423e776b33 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
96642025-03-01T01:24:36.800ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2099 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 24e35701-7fc2-425f-9323-9e423e776b33 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
96652025-03-01T01:24:37.414ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 385 local_addr = [fd00:1122:3344:101::c]:34357 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = e3fef09c-f8bd-45c8-b05a-a154303d5c5a response_code = 200 uri = /67b03f4e-4cbd-4843-9cd9-647f610abcfc
96662025-03-01T01:24:37.822ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = a2be8fa9-359b-4a75-8139-d119ba020eb0 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
96672025-03-01T01:24:37.822ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = a2be8fa9-359b-4a75-8139-d119ba020eb0 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
96682025-03-01T01:24:37.824ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2134 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = a2be8fa9-359b-4a75-8139-d119ba020eb0 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
96692025-03-01T01:24:38.844ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = bacc2c7f-198a-4ce6-a447-8946d302e02e roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
96702025-03-01T01:24:38.845ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = bacc2c7f-198a-4ce6-a447-8946d302e02e resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
96712025-03-01T01:24:38.847ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2519 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = bacc2c7f-198a-4ce6-a447-8946d302e02e response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
96722025-03-01T01:24:39.867ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = e750aba4-4147-4d4f-ad2a-97b4b870754a roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
96732025-03-01T01:24:39.867ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = e750aba4-4147-4d4f-ad2a-97b4b870754a resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
96742025-03-01T01:24:39.869ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2136 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = e750aba4-4147-4d4f-ad2a-97b4b870754a response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
96752025-03-01T01:24:40.889ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = f7bc3079-8cae-4393-8a34-dfd409baa1ac roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
96762025-03-01T01:24:40.890ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = f7bc3079-8cae-4393-8a34-dfd409baa1ac resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
96772025-03-01T01:24:40.891ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2270 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = f7bc3079-8cae-4393-8a34-dfd409baa1ac response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
96782025-03-01T01:24:41.912ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 627f8e94-64fa-48ed-bdfa-e1a0b9e26d9f roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
96792025-03-01T01:24:41.912ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 627f8e94-64fa-48ed-bdfa-e1a0b9e26d9f resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
96802025-03-01T01:24:41.913ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1457 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 627f8e94-64fa-48ed-bdfa-e1a0b9e26d9f response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
96812025-03-01T01:24:42.932ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 5fcdd54b-7704-4c04-b368-d5f357e88fdb roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
96822025-03-01T01:24:42.933ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 5fcdd54b-7704-4c04-b368-d5f357e88fdb resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
96832025-03-01T01:24:42.934ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2237 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 5fcdd54b-7704-4c04-b368-d5f357e88fdb response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
96842025-03-01T01:24:43.214ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 60 reason = Timeout
96852025-03-01T01:24:43.214ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 60 reason = Timeout
96862025-03-01T01:24:43.214ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96872025-03-01T01:24:43.214ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
96882025-03-01T01:24:43.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96892025-03-01T01:24:43.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
96902025-03-01T01:24:43.216ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96912025-03-01T01:24:43.216ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
96922025-03-01T01:24:43.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
96932025-03-01T01:24:43.218ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.155944ms iteration = 60 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
96942025-03-01T01:24:43.218ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
96952025-03-01T01:24:43.218ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96962025-03-01T01:24:43.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96972025-03-01T01:24:43.220ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96982025-03-01T01:24:43.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96992025-03-01T01:24:43.222ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97002025-03-01T01:24:43.224ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7, lookup_type: ById(8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7) } result = Ok(())
97012025-03-01T01:24:43.224ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
97022025-03-01T01:24:43.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
97032025-03-01T01:24:43.237ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 original_time_created = 2025-03-01 01:14:50.436545 UTC target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 time_created = 2025-03-01 01:14:50.436545 UTC
97042025-03-01T01:24:43.237ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.149922ms iteration = 60 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7","time_created":"2025-03-01T01:14:50.436545Z"}
97052025-03-01T01:24:43.954ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 4570925d-4631-4859-b79f-ded472d0dc79 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
97062025-03-01T01:24:43.954ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 4570925d-4631-4859-b79f-ded472d0dc79 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
97072025-03-01T01:24:43.956ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1971 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 4570925d-4631-4859-b79f-ded472d0dc79 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
97082025-03-01T01:24:44.976ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 409f0c13-e5ca-4123-b29d-7e20184b5f61 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
97092025-03-01T01:24:44.976ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 409f0c13-e5ca-4123-b29d-7e20184b5f61 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
97102025-03-01T01:24:44.978ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1898 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 409f0c13-e5ca-4123-b29d-7e20184b5f61 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
97112025-03-01T01:24:45.997ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 576f0e0b-fa60-418f-9197-11ab72725796 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
97122025-03-01T01:24:45.997ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 576f0e0b-fa60-418f-9197-11ab72725796 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
97132025-03-01T01:24:45.999ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1745 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 576f0e0b-fa60-418f-9197-11ab72725796 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
97142025-03-01T01:24:47.020ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = d83878a5-7b1c-40d7-b202-eccb46d1624b roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
97152025-03-01T01:24:47.021ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = d83878a5-7b1c-40d7-b202-eccb46d1624b resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
97162025-03-01T01:24:47.022ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1890 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = d83878a5-7b1c-40d7-b202-eccb46d1624b response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
97172025-03-01T01:24:47.414ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 366 local_addr = [fd00:1122:3344:101::c]:34357 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = c2c29773-19cd-4fb7-86a7-dd6d976d9b1b response_code = 200 uri = /67b03f4e-4cbd-4843-9cd9-647f610abcfc
97182025-03-01T01:24:48.041ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c7bd4bff-cbd2-4706-b68e-87f45464853b roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
97192025-03-01T01:24:48.041ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c7bd4bff-cbd2-4706-b68e-87f45464853b resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
97202025-03-01T01:24:48.043ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2163 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c7bd4bff-cbd2-4706-b68e-87f45464853b response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
97212025-03-01T01:24:49.063ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 447d341e-59a4-4ccf-b6db-899c5eddfb93 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
97222025-03-01T01:24:49.063ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 447d341e-59a4-4ccf-b6db-899c5eddfb93 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
97232025-03-01T01:24:49.065ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2159 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 447d341e-59a4-4ccf-b6db-899c5eddfb93 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
97242025-03-01T01:24:50.085ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = e801c80e-733f-40ae-9331-92e60edc7a1e roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
97252025-03-01T01:24:50.085ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = e801c80e-733f-40ae-9331-92e60edc7a1e resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
97262025-03-01T01:24:50.087ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2146 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = e801c80e-733f-40ae-9331-92e60edc7a1e response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
97272025-03-01T01:24:51.107ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 91e5cd1c-dbf7-4e7b-9e88-b2be3ad1b9d6 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
97282025-03-01T01:24:51.107ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 91e5cd1c-dbf7-4e7b-9e88-b2be3ad1b9d6 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
97292025-03-01T01:24:51.109ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1701 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 91e5cd1c-dbf7-4e7b-9e88-b2be3ad1b9d6 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
97302025-03-01T01:24:52.130ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = a8444333-80a7-45c5-b871-b4cc5cbdeb7d roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
97312025-03-01T01:24:52.130ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = a8444333-80a7-45c5-b871-b4cc5cbdeb7d resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
97322025-03-01T01:24:52.132ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2080 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = a8444333-80a7-45c5-b871-b4cc5cbdeb7d response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
97332025-03-01T01:24:53.152ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 589a1714-6d8d-4105-90f9-428b25213607 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
97342025-03-01T01:24:53.153ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 589a1714-6d8d-4105-90f9-428b25213607 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
97352025-03-01T01:24:53.154ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2081 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 589a1714-6d8d-4105-90f9-428b25213607 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
97362025-03-01T01:24:53.213ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 21 reason = Timeout
97372025-03-01T01:24:53.214ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 21 reason = Timeout
97382025-03-01T01:24:53.214ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
97392025-03-01T01:24:53.214ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
97402025-03-01T01:24:53.214ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 21 reason = Timeout
97412025-03-01T01:24:53.214ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
97422025-03-01T01:24:53.214ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 11 reason = Timeout
97432025-03-01T01:24:53.214ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
97442025-03-01T01:24:53.214ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 21 reason = Timeout
97452025-03-01T01:24:53.214ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 61 reason = Timeout
97462025-03-01T01:24:53.214ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
97472025-03-01T01:24:53.214ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
97482025-03-01T01:24:53.214ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 21 reason = Timeout
97492025-03-01T01:24:53.214ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
97502025-03-01T01:24:53.214ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
97512025-03-01T01:24:53.214ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 21 reason = Timeout
97522025-03-01T01:24:53.214ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 13 reason = Timeout
97532025-03-01T01:24:53.214ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
97542025-03-01T01:24:53.214ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 2 reason = Timeout
97552025-03-01T01:24:53.214ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
97562025-03-01T01:24:53.214ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 11 reason = Timeout
97572025-03-01T01:24:53.214ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-03-01 01:14:53.214132926 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
97582025-03-01T01:24:53.214ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 21 reason = Timeout
97592025-03-01T01:24:53.214ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
97602025-03-01T01:24:53.214ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
97612025-03-01T01:24:53.214ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 11 reason = Timeout
97622025-03-01T01:24:53.214ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 61 reason = Timeout
97632025-03-01T01:24:53.214ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 21 reason = Timeout
97642025-03-01T01:24:53.214ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
97652025-03-01T01:24:53.214ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
97662025-03-01T01:24:53.214ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 21 reason = Timeout
97672025-03-01T01:24:53.214ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
97682025-03-01T01:24:53.214ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
97692025-03-01T01:24:53.214ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 11 reason = Timeout
97702025-03-01T01:24:53.214ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
97712025-03-01T01:24:53.214ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 11 reason = Timeout
97722025-03-01T01:24:53.214ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 22 reason = Timeout
97732025-03-01T01:24:53.214ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
97742025-03-01T01:24:53.214ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 21 reason = Timeout
97752025-03-01T01:24:53.214ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
97762025-03-01T01:24:53.214ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 11 reason = Timeout
97772025-03-01T01:24:53.214ZDEBGnexus (BackgroundTasks): activating background_task = saga_recovery iteration = 2 reason = Timeout
97782025-03-01T01:24:53.214ZDEBGnexus (SagaRecoverer): listing candidate sagas for recovery
97792025-03-01T01:24:53.214ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
97802025-03-01T01:24:53.214ZDEBGnexus (SagaRecoverer): roles roles = RoleSet { roles: {} }
97812025-03-01T01:24:53.214ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 21 reason = Timeout
97822025-03-01T01:24:53.214ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 11 reason = Timeout
97832025-03-01T01:24:53.214ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
97842025-03-01T01:24:53.214ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
97852025-03-01T01:24:53.214ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
97862025-03-01T01:24:53.214ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_rendezvous iteration = 4 reason = Timeout
97872025-03-01T01:24:53.214ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 21 reason = Timeout
97882025-03-01T01:24:53.214ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
97892025-03-01T01:24:53.214ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 11 reason = Timeout
97902025-03-01T01:24:53.214ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
97912025-03-01T01:24:53.214ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 12 reason = Timeout
97922025-03-01T01:24:53.214ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
97932025-03-01T01:24:53.214ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7
97942025-03-01T01:24:53.214ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 13.17\u{b5}s iteration = 12 status = {"enabled":false,"target_id":"8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7"}
97952025-03-01T01:24:53.214ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 21 reason = Timeout
97962025-03-01T01:24:53.214ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 13 reason = Timeout
97972025-03-01T01:24:53.214ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
97982025-03-01T01:24:53.214ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 21 reason = Timeout
97992025-03-01T01:24:53.214ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
98002025-03-01T01:24:53.214ZDEBGnexus (BackgroundTasks): activating background_task = tuf_artifact_replication iteration = 3 reason = Timeout
98012025-03-01T01:24:53.214ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 11 reason = Timeout
98022025-03-01T01:24:53.214ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
98032025-03-01T01:24:53.214ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 3 reason = Timeout
98042025-03-01T01:24:53.214ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
98052025-03-01T01:24:53.214ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
98062025-03-01T01:24:53.214ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
98072025-03-01T01:24:53.214ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
98082025-03-01T01:24:53.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
98092025-03-01T01:24:53.214ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 21 reason = Timeout
98102025-03-01T01:24:53.214ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 11 reason = Timeout
98112025-03-01T01:24:53.214ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
98122025-03-01T01:24:53.214ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
98132025-03-01T01:24:53.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
98142025-03-01T01:24:53.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
98152025-03-01T01:24:53.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
98162025-03-01T01:24:53.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
98172025-03-01T01:24:53.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
98182025-03-01T01:24:53.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
98192025-03-01T01:24:53.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
98202025-03-01T01:24:53.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
98212025-03-01T01:24:53.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
98222025-03-01T01:24:53.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
98232025-03-01T01:24:53.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
98242025-03-01T01:24:53.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
98252025-03-01T01:24:53.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
98262025-03-01T01:24:53.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
98272025-03-01T01:24:53.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
98282025-03-01T01:24:53.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
98292025-03-01T01:24:53.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
98302025-03-01T01:24:53.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
98312025-03-01T01:24:53.214ZDEBGnexus (SagaRecoverer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000003a8a, .. }) resource = Database result = Ok(())
98322025-03-01T01:24:53.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
98332025-03-01T01:24:53.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
98342025-03-01T01:24:53.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
98352025-03-01T01:24:53.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
98362025-03-01T01:24:53.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
98372025-03-01T01:24:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
98382025-03-01T01:24:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
98392025-03-01T01:24:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
98402025-03-01T01:24:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
98412025-03-01T01:24:53.215ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2e37f4af-57dc-468e-80e3-cf2aea2ffdc8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5f6eb3bd-0126-40e0-98ef-ee33df084158.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("5f6eb3bd-0126-40e0-98ef-ee33df084158.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1503, tv_nsec: 903019429 } })
98422025-03-01T01:24:53.215ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("3a9b8294-d9f3-4130-a669-e74c6f1f65a0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("450e8d93-9ed3-4721-9fe9-42521f60bc93.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a4f72c78-99c6-478d-b490-f7d8793d4173.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("a4f72c78-99c6-478d-b490-f7d8793d4173.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1503, tv_nsec: 903035449 } })
98432025-03-01T01:24:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
98442025-03-01T01:24:53.215ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
98452025-03-01T01:24:53.215ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.255566ms iteration = 11 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
98462025-03-01T01:24:53.215ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
98472025-03-01T01:24:53.215ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.439399ms iteration = 11 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
98482025-03-01T01:24:53.218ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
98492025-03-01T01:24:53.218ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
98502025-03-01T01:24:53.218ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 4.636544ms iteration = 11 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
98512025-03-01T01:24:53.218ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.579483ms iteration = 21 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
98522025-03-01T01:24:53.219ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1503, tv_nsec: 906996920 } })
98532025-03-01T01:24:53.219ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1154
98542025-03-01T01:24:53.220ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1503, tv_nsec: 908216275 } })
98552025-03-01T01:24:53.220ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1154
98562025-03-01T01:24:53.220ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98572025-03-01T01:24:53.220ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98582025-03-01T01:24:53.221ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-03-01 01:14:53.214132926 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
98592025-03-01T01:24:53.221ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 7.773388ms iteration = 11 status = {"expiration":"2025-03-01T01:14:53.214132926Z","pruned":[]}
98602025-03-01T01:24:53.223ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
98612025-03-01T01:24:53.223ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
98622025-03-01T01:24:53.223ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
98632025-03-01T01:24:53.223ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
98642025-03-01T01:24:53.223ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
98652025-03-01T01:24:53.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
98662025-03-01T01:24:53.228ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 14.425494ms iteration = 11 status = {"errors":[],"found_port_ok":[]}
98672025-03-01T01:24:53.229ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
98682025-03-01T01:24:53.229ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
98692025-03-01T01:24:53.232ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
98702025-03-01T01:24:53.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
98712025-03-01T01:24:53.252ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
98722025-03-01T01:24:53.252ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
98732025-03-01T01:24:53.252ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
98742025-03-01T01:24:53.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
98752025-03-01T01:24:53.253ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
98762025-03-01T01:24:53.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
98772025-03-01T01:24:53.255ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98782025-03-01T01:24:53.258ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
98792025-03-01T01:24:53.258ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
98802025-03-01T01:24:53.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
98812025-03-01T01:24:53.263ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98822025-03-01T01:24:53.265ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
98832025-03-01T01:24:53.265ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
98842025-03-01T01:24:53.265ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 51.588721ms iteration = 21 status = {"errors":[],"garbage_collect_requested":[]}
98852025-03-01T01:24:53.265ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
98862025-03-01T01:24:53.265ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
98872025-03-01T01:24:53.266ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
98882025-03-01T01:24:53.268ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98892025-03-01T01:24:53.269ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
98902025-03-01T01:24:53.269ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1503, tv_nsec: 957623691 } })
98912025-03-01T01:24:53.269ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
98922025-03-01T01:24:53.269ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1154 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66
98932025-03-01T01:24:53.271ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98942025-03-01T01:24:53.273ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
98952025-03-01T01:24:53.274ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
98962025-03-01T01:24:53.274ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
98972025-03-01T01:24:53.274ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
98982025-03-01T01:24:53.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
98992025-03-01T01:24:53.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
99002025-03-01T01:24:53.275ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99012025-03-01T01:24:53.275ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
99022025-03-01T01:24:53.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
99032025-03-01T01:24:53.276ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
99042025-03-01T01:24:53.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
99052025-03-01T01:24:53.277ZDEBGnexus (BackgroundTasks): inventory_prune_one: eligible for removal background_task = inventory_collection candidates = [(cb9bd69a-6bb8-4de9-b08b-24f1d024639b, 0), (f819233f-94a4-41a1-a22b-66a6a0928089, 0), (10e9ceea-fbdc-4a09-a4f9-ec3dadf7591b, 0), (604327b1-d744-4ec6-ab1e-d73a3fc09ea9, 0)] collection_id = cb9bd69a-6bb8-4de9-b08b-24f1d024639b
99062025-03-01T01:24:53.277ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
99072025-03-01T01:24:53.277ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
99082025-03-01T01:24:53.277ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
99092025-03-01T01:24:53.277ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
99102025-03-01T01:24:53.277ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
99112025-03-01T01:24:53.281ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99122025-03-01T01:24:53.281ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99132025-03-01T01:24:53.282ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
99142025-03-01T01:24:53.282ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
99152025-03-01T01:24:53.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
99162025-03-01T01:24:53.284ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
99172025-03-01T01:24:53.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
99182025-03-01T01:24:53.284ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99192025-03-01T01:24:53.285ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
99202025-03-01T01:24:53.287ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
99212025-03-01T01:24:53.287ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
99222025-03-01T01:24:53.287ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
99232025-03-01T01:24:53.289ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99242025-03-01T01:24:53.291ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
99252025-03-01T01:24:53.291ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
99262025-03-01T01:24:53.292ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
99272025-03-01T01:24:53.292ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
99282025-03-01T01:24:53.292ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
99292025-03-01T01:24:53.293ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99302025-03-01T01:24:53.294ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 80.453949ms iteration = 61 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
99312025-03-01T01:24:53.295ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99322025-03-01T01:24:53.295ZINFOnexus (SagaRecoverer): listed in-progress sagas count = 0 file = nexus/src/app/background/tasks/saga_recovery.rs:438
99332025-03-01T01:24:53.295ZDEBGnexus (BackgroundTasks): activation complete background_task = saga_recovery elapsed = 80.851757ms iteration = 2 status = {"last_pass":{"Success":{"nfailed":0,"nfound":0,"nrecovered":0,"nremoved":0,"nskipped":0}},"ntotal_failures":0,"ntotal_finished":0,"ntotal_recovered":0,"ntotal_sec_errors_bad_state":0,"ntotal_sec_errors_missing":0,"ntotal_started":0,"recent_failures":[],"recent_recoveries":[]}
99342025-03-01T01:24:53.295ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
99352025-03-01T01:24:53.295ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
99362025-03-01T01:24:53.297ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
99372025-03-01T01:24:53.297ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
99382025-03-01T01:24:53.298ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
99392025-03-01T01:24:53.298ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
99402025-03-01T01:24:53.298ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
99412025-03-01T01:24:53.298ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
99422025-03-01T01:24:53.301ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99432025-03-01T01:24:53.301ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99442025-03-01T01:24:53.302ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99452025-03-01T01:24:53.302ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
99462025-03-01T01:24:53.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
99472025-03-01T01:24:53.305ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
99482025-03-01T01:24:53.305ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
99492025-03-01T01:24:53.305ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Inventory result = Ok(())
99502025-03-01T01:24:53.305ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
99512025-03-01T01:24:53.305ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
99522025-03-01T01:24:53.305ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
99532025-03-01T01:24:53.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
99542025-03-01T01:24:53.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
99552025-03-01T01:24:53.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
99562025-03-01T01:24:53.307ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
99572025-03-01T01:24:53.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
99582025-03-01T01:24:53.307ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
99592025-03-01T01:24:53.307ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
99602025-03-01T01:24:53.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
99612025-03-01T01:24:53.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
99622025-03-01T01:24:53.309ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
99632025-03-01T01:24:53.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
99642025-03-01T01:24:53.316ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
99652025-03-01T01:24:53.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
99662025-03-01T01:24:53.316ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
99672025-03-01T01:24:53.316ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
99682025-03-01T01:24:53.316ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
99692025-03-01T01:24:53.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
99702025-03-01T01:24:53.318ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99712025-03-01T01:24:53.320ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 106.354676ms iteration = 21 status = {"errors":[],"finish_invoked_ok":[]}
99722025-03-01T01:24:53.322ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
99732025-03-01T01:24:53.322ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
99742025-03-01T01:24:53.323ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
99752025-03-01T01:24:53.326ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
99762025-03-01T01:24:53.326ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
99772025-03-01T01:24:53.326ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
99782025-03-01T01:24:53.326ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
99792025-03-01T01:24:53.326ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
99802025-03-01T01:24:53.326ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
99812025-03-01T01:24:53.326ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
99822025-03-01T01:24:53.326ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 112.88138ms iteration = 21 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
99832025-03-01T01:24:53.326ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
99842025-03-01T01:24:53.326ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
99852025-03-01T01:24:53.326ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
99862025-03-01T01:24:53.326ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
99872025-03-01T01:24:53.327ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
99882025-03-01T01:24:53.330ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 116.799679ms iteration = 21 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
99892025-03-01T01:24:53.333ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
99902025-03-01T01:24:53.333ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 119.533285ms iteration = 21 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
99912025-03-01T01:24:53.335ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99922025-03-01T01:24:53.340ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
99932025-03-01T01:24:53.340ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
99942025-03-01T01:24:53.340ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
99952025-03-01T01:24:53.346ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99962025-03-01T01:24:53.348ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
99972025-03-01T01:24:53.350ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7, lookup_type: ById(8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7) } result = Ok(())
99982025-03-01T01:24:53.350ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
99992025-03-01T01:24:53.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100002025-03-01T01:24:53.353ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
100012025-03-01T01:24:53.356ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
100022025-03-01T01:24:53.356ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
100032025-03-01T01:24:53.356ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 141.711106ms iteration = 11 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
100042025-03-01T01:24:53.356ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
100052025-03-01T01:24:53.356ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100062025-03-01T01:24:53.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
100072025-03-01T01:24:53.357ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100082025-03-01T01:24:53.359ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
100092025-03-01T01:24:53.359ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
100102025-03-01T01:24:53.359ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
100112025-03-01T01:24:53.361ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100122025-03-01T01:24:53.362ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
100132025-03-01T01:24:53.362ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
100142025-03-01T01:24:53.362ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
100152025-03-01T01:24:53.365ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
100162025-03-01T01:24:53.365ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
100172025-03-01T01:24:53.365ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
100182025-03-01T01:24:53.366ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
100192025-03-01T01:24:53.366ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
100202025-03-01T01:24:53.366ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
100212025-03-01T01:24:53.366ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
100222025-03-01T01:24:53.366ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "52e63de2-76bd-486e-aae9-412f1e0bc8c0", "content-length": "26", "date": "Sat, 01 Mar 2025 01:24:53 GMT"} })
100232025-03-01T01:24:53.366ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
100242025-03-01T01:24:53.367ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
100252025-03-01T01:24:53.367ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
100262025-03-01T01:24:53.368ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
100272025-03-01T01:24:53.368ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 153.928686ms iteration = 21 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
100282025-03-01T01:24:53.368ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
100292025-03-01T01:24:53.369ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
100302025-03-01T01:24:53.369ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
100312025-03-01T01:24:53.369ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
100322025-03-01T01:24:53.369ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
100332025-03-01T01:24:53.370ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
100342025-03-01T01:24:53.370ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
100352025-03-01T01:24:53.370ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4ef3d5e2-b0e4-463e-900f-166f15c458a3", "content-length": "26", "date": "Sat, 01 Mar 2025 01:24:53 GMT"} })
100362025-03-01T01:24:53.370ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
100372025-03-01T01:24:53.374ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100382025-03-01T01:24:53.374ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100392025-03-01T01:24:53.374ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
100402025-03-01T01:24:53.377ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100412025-03-01T01:24:53.378ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 3471264f-127e-4a25-bc10-2e8249e8d70a, lookup_type: ById(3471264f-127e-4a25-bc10-2e8249e8d70a) } result = Ok(())
100422025-03-01T01:24:53.378ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
100432025-03-01T01:24:53.378ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
100442025-03-01T01:24:53.380ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
100452025-03-01T01:24:53.380ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
100462025-03-01T01:24:53.380ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
100472025-03-01T01:24:53.380ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
100482025-03-01T01:24:53.380ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
100492025-03-01T01:24:53.380ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
100502025-03-01T01:24:53.380ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
100512025-03-01T01:24:53.381ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
100522025-03-01T01:24:53.381ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
100532025-03-01T01:24:53.381ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
100542025-03-01T01:24:53.385ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 171.3171ms iteration = 21 status = 0
100552025-03-01T01:24:53.391ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
100562025-03-01T01:24:53.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
100572025-03-01T01:24:53.393ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 179.296822ms iteration = 21 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
100582025-03-01T01:24:53.394ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100592025-03-01T01:24:53.394ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100602025-03-01T01:24:53.396ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 original_time_created = 2025-03-01 01:14:50.436545 UTC target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 time_created = 2025-03-01 01:14:50.436545 UTC
100612025-03-01T01:24:53.396ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 181.924886ms iteration = 61 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7","time_created":"2025-03-01T01:14:50.436545Z"}
100622025-03-01T01:24:53.397ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
100632025-03-01T01:24:53.397ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
100642025-03-01T01:24:53.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
100652025-03-01T01:24:53.397ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
100662025-03-01T01:24:53.397ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
100672025-03-01T01:24:53.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
100682025-03-01T01:24:53.399ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
100692025-03-01T01:24:53.399ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
100702025-03-01T01:24:53.399ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 185.640651ms iteration = 21 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
100712025-03-01T01:24:53.400ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
100722025-03-01T01:24:53.400ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
100732025-03-01T01:24:53.406ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
100742025-03-01T01:24:53.407ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
100752025-03-01T01:24:53.409ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
100762025-03-01T01:24:53.410ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
100772025-03-01T01:24:53.411ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100782025-03-01T01:24:53.412ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
100792025-03-01T01:24:53.412ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
100802025-03-01T01:24:53.414ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
100812025-03-01T01:24:53.414ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
100822025-03-01T01:24:53.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
100832025-03-01T01:24:53.416ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
100842025-03-01T01:24:53.417ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
100852025-03-01T01:24:53.418ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
100862025-03-01T01:24:53.418ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
100872025-03-01T01:24:53.418ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
100882025-03-01T01:24:53.419ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100892025-03-01T01:24:53.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
100902025-03-01T01:24:53.419ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
100912025-03-01T01:24:53.419ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = cce65e3e-6c86-4cdd-98ad-9a38c98082e8 dns_zone_name = oxide.test found_so_far = 0 version = 2
100922025-03-01T01:24:53.419ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
100932025-03-01T01:24:53.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
100942025-03-01T01:24:53.424ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
100952025-03-01T01:24:53.424ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
100962025-03-01T01:24:53.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
100972025-03-01T01:24:53.430ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1162 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 zone_address = fd00:1122:3344:101::2
100982025-03-01T01:24:53.430ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
100992025-03-01T01:24:53.430ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3e44943f-bf4d-4942-95c6-399487d5a73f", "content-length": "26", "date": "Sat, 01 Mar 2025 01:24:53 GMT"} })
101002025-03-01T01:24:53.430ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1167 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
101012025-03-01T01:24:53.433ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66
101022025-03-01T01:24:53.453ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
101032025-03-01T01:24:53.453ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 0a9e4b5c-53a1-4f0a-8849-98a8b1852af3 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
101042025-03-01T01:24:53.453ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
101052025-03-01T01:24:53.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
101062025-03-01T01:24:53.467ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-03-01T01:14:49.537343Z, time_modified: 2025-03-01T01:14:49.537343Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 1682a303-6254-452b-b4cf-160ed9dc3fc9, db_silo: Silo { identity: SiloIdentity { id: 1682a303-6254-452b-b4cf-160ed9dc3fc9, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-03-01T01:14:54.631650Z, time_modified: 2025-03-01T01:14:54.631650Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "851c0b739689cfb98a2e401e6047fa98e9fcc283d9fc3f660bd69842a9c06be9" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 1682a303-6254-452b-b4cf-160ed9dc3fc9, db_silo: Silo { identity: SiloIdentity { id: 1682a303-6254-452b-b4cf-160ed9dc3fc9, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-03-01T01:14:54.631650Z, time_modified: 2025-03-01T01:14:54.631650Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "851c0b739689cfb98a2e401e6047fa98e9fcc283d9fc3f660bd69842a9c06be9" }] }) }
101072025-03-01T01:24:53.467ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 253.439292ms iteration = 11 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"1682a303-6254-452b-b4cf-160ed9dc3fc9","tls_certs":["851c0b739689cfb98a2e401e6047fa98e9fcc283d9fc3f660bd69842a9c06be9"]}},"default_endpoint":{"silo_id":"1682a303-6254-452b-b4cf-160ed9dc3fc9","tls_certs":["851c0b739689cfb98a2e401e6047fa98e9fcc283d9fc3f660bd69842a9c06be9"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
101082025-03-01T01:24:53.482ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
101092025-03-01T01:24:53.482ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 268.5487ms iteration = 11 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
101102025-03-01T01:24:53.519ZINFOnexus (BackgroundTasks): removed inventory collection background_task = inventory_collection collection_id = cb9bd69a-6bb8-4de9-b08b-24f1d024639b file = nexus/db-queries/src/db/datastore/inventory.rs:1442 ncabooses = 12 nclickhouse_keeper_membership = 0 ncollections = 1 ndatasets = 84 nerrors = 0 nnics = 6 nnvme_disk_firmware = 11 nphysical_disks = 11 nrot_pages = 8 nrots = 2 nsled_agent_zones = 1 nsled_agents = 1 nsps = 2 nzones = 28 nzpools = 9
101112025-03-01T01:24:53.519ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
101122025-03-01T01:24:53.519ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
101132025-03-01T01:24:53.523ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
101142025-03-01T01:24:53.547ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 333.604836ms iteration = 22 status = {"physical_disks_added":0}
101152025-03-01T01:24:53.571ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
101162025-03-01T01:24:53.572ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "578a31a0-c564-4ebf-88c7-2ff58cbf3e9a", "content-length": "2", "date": "Sat, 01 Mar 2025 01:24:52 GMT"} })
101172025-03-01T01:24:53.574ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
101182025-03-01T01:24:53.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
101192025-03-01T01:24:53.583ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 369.888165ms iteration = 21 status = {}
101202025-03-01T01:24:53.608ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
101212025-03-01T01:24:53.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
101222025-03-01T01:24:53.611ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101232025-03-01T01:24:53.611ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101242025-03-01T01:24:53.613ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
101252025-03-01T01:24:53.613ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
101262025-03-01T01:24:53.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
101272025-03-01T01:24:53.615ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
101282025-03-01T01:24:53.615ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
101292025-03-01T01:24:53.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
101302025-03-01T01:24:53.631ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
101312025-03-01T01:24:53.631ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "b8e50e52-9dbb-44fa-8dc5-cea838831f74", "date": "Sat, 01 Mar 2025 01:24:53 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
101322025-03-01T01:24:53.631ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
101332025-03-01T01:24:53.632ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "aba0cf3b-d30b-45b3-a085-4619566ff1b5", "date": "Sat, 01 Mar 2025 01:24:53 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
101342025-03-01T01:24:53.632ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
101352025-03-01T01:24:53.634ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
101362025-03-01T01:24:53.634ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 420.052067ms iteration = 13 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
101372025-03-01T01:24:53.642ZINFOnexus (BackgroundTasks): VPC route manager sled 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
101382025-03-01T01:24:53.642ZDEBGnexus (BackgroundTasks): client request SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
101392025-03-01T01:24:53.645ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
101402025-03-01T01:24:53.645ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101412025-03-01T01:24:53.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
101422025-03-01T01:24:53.647ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 433.073122ms iteration = 21 status = null
101432025-03-01T01:24:53.647ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101442025-03-01T01:24:53.648ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = cce65e3e-6c86-4cdd-98ad-9a38c98082e8 dns_zone_name = oxide.test found_so_far = 1 version = 2
101452025-03-01T01:24:53.648ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
101462025-03-01T01:24:53.648ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-03-01 01:14:54.679503 UTC dns_group = external generation = 2
101472025-03-01T01:24:53.648ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 434.086102ms iteration = 11 status = {"generation":2}
101482025-03-01T01:24:53.648ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
101492025-03-01T01:24:53.649ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
101502025-03-01T01:24:53.649ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
101512025-03-01T01:24:53.650ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
101522025-03-01T01:24:53.650ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
101532025-03-01T01:24:53.650ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
101542025-03-01T01:24:53.650ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
101552025-03-01T01:24:53.650ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
101562025-03-01T01:24:53.650ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
101572025-03-01T01:24:53.650ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
101582025-03-01T01:24:53.651ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(f819233f-94a4-41a1-a22b-66a6a0928089, 0), (10e9ceea-fbdc-4a09-a4f9-ec3dadf7591b, 0), (604327b1-d744-4ec6-ab1e-d73a3fc09ea9, 0)]
101592025-03-01T01:24:53.651ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1504, tv_nsec: 339646353 } })
101602025-03-01T01:24:53.652ZINFOnexus (BackgroundTasks): ensured all Crucible datasets present in inventory have database records background_task = blueprint_rendezvous file = nexus/reconfigurator/rendezvous/src/crucible_dataset.rs:113 num_already_exist = 9 num_inserted = 0 num_not_in_inventory = 0
101612025-03-01T01:24:53.652ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_rendezvous elapsed = 438.294629ms iteration = 4 status = {"blueprint_id":"8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7","inventory_collection_id":"604327b1-d744-4ec6-ab1e-d73a3fc09ea9","stats":{"crucible_dataset":{"num_already_exist":9,"num_inserted":0,"num_not_in_inventory":0},"debug_dataset":{"num_already_exist":9,"num_already_tombstoned":0,"num_inserted":0,"num_not_in_inventory":0,"num_tombstoned":0}}}
101622025-03-01T01:24:53.652ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
101632025-03-01T01:24:53.653ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
101642025-03-01T01:24:53.653ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 0a9e4b5c-53a1-4f0a-8849-98a8b1852af3 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
101652025-03-01T01:24:53.653ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
101662025-03-01T01:24:53.653ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-03-01 01:14:53.460216 UTC dns_group = internal generation = 1
101672025-03-01T01:24:53.653ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 438.764598ms iteration = 11 status = {"generation":1}
101682025-03-01T01:24:53.654ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
101692025-03-01T01:24:53.654ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
101702025-03-01T01:24:53.655ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
101712025-03-01T01:24:53.656ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
101722025-03-01T01:24:53.657ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101732025-03-01T01:24:53.658ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
101742025-03-01T01:24:53.658ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "049786c1-1dd2-47ba-b3cc-c044a8e4c4c9", "date": "Sat, 01 Mar 2025 01:24:53 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
101752025-03-01T01:24:53.658ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
101762025-03-01T01:24:53.660ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "6f52e0d6-efcf-42aa-b3d4-d11aa17b29c9", "date": "Sat, 01 Mar 2025 01:24:53 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
101772025-03-01T01:24:53.660ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
101782025-03-01T01:24:53.661ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
101792025-03-01T01:24:53.661ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
101802025-03-01T01:24:53.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
101812025-03-01T01:24:53.662ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "1b189b21-ae55-461e-a595-de02409eb449", "date": "Sat, 01 Mar 2025 01:24:53 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
101822025-03-01T01:24:53.662ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
101832025-03-01T01:24:53.663ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
101842025-03-01T01:24:53.663ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
101852025-03-01T01:24:53.663ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
101862025-03-01T01:24:53.663ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 449.820723ms iteration = 13 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
101872025-03-01T01:24:53.664ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
101882025-03-01T01:24:53.664ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
101892025-03-01T01:24:53.687ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101902025-03-01T01:24:53.690ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
101912025-03-01T01:24:53.690ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
101922025-03-01T01:24:53.690ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
101932025-03-01T01:24:53.693ZDEBGnexus (BackgroundTasks): client request SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = tuf_artifact_replication body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/artifacts
101942025-03-01T01:24:53.715ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101952025-03-01T01:24:53.724ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
101962025-03-01T01:24:53.724ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
101972025-03-01T01:24:53.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
101982025-03-01T01:24:53.728ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
101992025-03-01T01:24:53.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
102002025-03-01T01:24:53.731ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
102012025-03-01T01:24:53.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
102022025-03-01T01:24:53.734ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
102032025-03-01T01:24:53.734ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
102042025-03-01T01:24:53.734ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
102052025-03-01T01:24:53.734ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/ignition
102062025-03-01T01:24:53.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
102072025-03-01T01:24:53.735ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "3bcaa512-6375-4aaf-9bbc-1e8d1ea93986", "content-length": "476", "date": "Sat, 01 Mar 2025 01:24:53 GMT"} })
102082025-03-01T01:24:53.735ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
102092025-03-01T01:24:53.735ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "2faa788a-0ab6-4a77-b3e4-2b6881509604", "content-length": "734", "date": "Sat, 01 Mar 2025 01:24:53 GMT"} })
102102025-03-01T01:24:53.735ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
102112025-03-01T01:24:53.736ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "25bce02a-435e-4472-a5b3-c3673c7667d7", "content-length": "111", "date": "Sat, 01 Mar 2025 01:24:53 GMT"} })
102122025-03-01T01:24:53.736ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
102132025-03-01T01:24:53.736ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "0c666f55-1b1a-433a-bb0c-a8eb2a763210", "content-length": "111", "date": "Sat, 01 Mar 2025 01:24:53 GMT"} })
102142025-03-01T01:24:53.736ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
102152025-03-01T01:24:53.736ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "73477d3f-d7cb-4f05-82ef-6aaf436d5fca", "content-length": "167", "date": "Sat, 01 Mar 2025 01:24:53 GMT"} })
102162025-03-01T01:24:53.736ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
102172025-03-01T01:24:53.737ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "52ff9b0a-8569-4ccc-96f5-271d6b072cd7", "content-length": "167", "date": "Sat, 01 Mar 2025 01:24:53 GMT"} })
102182025-03-01T01:24:53.737ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
102192025-03-01T01:24:53.737ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
102202025-03-01T01:24:53.737ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "fccea88a-75f6-4d5e-b018-17eff0b3b3e3", "content-length": "175", "date": "Sat, 01 Mar 2025 01:24:53 GMT"} })
102212025-03-01T01:24:53.737ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
102222025-03-01T01:24:53.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
102232025-03-01T01:24:53.737ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "ac676a54-f9a9-4fe2-887f-e9a4c13ec110", "content-length": "175", "date": "Sat, 01 Mar 2025 01:24:53 GMT"} })
102242025-03-01T01:24:53.737ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
102252025-03-01T01:24:53.738ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "64d124fc-bbc6-4287-8729-b63ad6bf97f0", "content-length": "702", "date": "Sat, 01 Mar 2025 01:24:53 GMT"} })
102262025-03-01T01:24:53.738ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
102272025-03-01T01:24:53.738ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "1d0bf644-eca2-4519-a069-830b96af7553", "content-length": "727", "date": "Sat, 01 Mar 2025 01:24:53 GMT"} })
102282025-03-01T01:24:53.738ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
102292025-03-01T01:24:53.738ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "7b27ea12-f2e7-40bb-914c-ec57659ea230", "content-length": "729", "date": "Sat, 01 Mar 2025 01:24:53 GMT"} })
102302025-03-01T01:24:53.738ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
102312025-03-01T01:24:53.738ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "c4063f9e-220c-4e0f-81e4-577b4a145b12", "content-length": "728", "date": "Sat, 01 Mar 2025 01:24:53 GMT"} })
102322025-03-01T01:24:53.738ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
102332025-03-01T01:24:53.738ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "83a8b71a-1f33-4af1-8b45-f9597210920e", "content-length": "722", "date": "Sat, 01 Mar 2025 01:24:53 GMT"} })
102342025-03-01T01:24:53.738ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
102352025-03-01T01:24:53.739ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "9b0006c4-635c-4146-94ec-4dc26f0ffe30", "content-length": "109", "date": "Sat, 01 Mar 2025 01:24:53 GMT"} })
102362025-03-01T01:24:53.739ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
102372025-03-01T01:24:53.739ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "1392fe9f-6246-4edc-9e42-7a7888d3161e", "content-length": "109", "date": "Sat, 01 Mar 2025 01:24:53 GMT"} })
102382025-03-01T01:24:53.739ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
102392025-03-01T01:24:53.739ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "d051384c-381e-4258-85f0-1d06194eb62f", "content-length": "169", "date": "Sat, 01 Mar 2025 01:24:53 GMT"} })
102402025-03-01T01:24:53.739ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
102412025-03-01T01:24:53.740ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "ce4f05b1-1a07-4374-801c-f41bdc35b653", "content-length": "169", "date": "Sat, 01 Mar 2025 01:24:53 GMT"} })
102422025-03-01T01:24:53.740ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
102432025-03-01T01:24:53.740ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
102442025-03-01T01:24:53.740ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "891f393d-6f08-452d-903e-9beabac051f8", "content-length": "178", "date": "Sat, 01 Mar 2025 01:24:53 GMT"} })
102452025-03-01T01:24:53.740ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
102462025-03-01T01:24:53.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
102472025-03-01T01:24:53.741ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "4916d1b8-5d64-497f-b758-777d906ab99f", "content-length": "178", "date": "Sat, 01 Mar 2025 01:24:53 GMT"} })
102482025-03-01T01:24:53.741ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
102492025-03-01T01:24:53.741ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "53808224-febf-4526-9ca4-7791a8f14446", "content-length": "702", "date": "Sat, 01 Mar 2025 01:24:53 GMT"} })
102502025-03-01T01:24:53.741ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
102512025-03-01T01:24:53.741ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "857c7f2d-9187-46b2-9b92-c7d83fac9c18", "content-length": "727", "date": "Sat, 01 Mar 2025 01:24:53 GMT"} })
102522025-03-01T01:24:53.741ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
102532025-03-01T01:24:53.741ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "9f4f15dc-5fa8-46d4-a458-836ad0356a14", "content-length": "729", "date": "Sat, 01 Mar 2025 01:24:53 GMT"} })
102542025-03-01T01:24:53.741ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
102552025-03-01T01:24:53.741ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "304fe60b-5ce9-48d0-a77f-2cfb32089f24", "content-length": "728", "date": "Sat, 01 Mar 2025 01:24:53 GMT"} })
102562025-03-01T01:24:53.741ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
102572025-03-01T01:24:53.742ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
102582025-03-01T01:24:53.760ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
102592025-03-01T01:24:53.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
102602025-03-01T01:24:53.762ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
102612025-03-01T01:24:53.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
102622025-03-01T01:24:53.762ZDEBGnexus (BackgroundTasks): client response SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "86e86331-c6a3-43dc-bd28-45cd7e60351a", "content-length": "372", "date": "Sat, 01 Mar 2025 01:24:53 GMT"} })
102632025-03-01T01:24:53.762ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
102642025-03-01T01:24:53.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
102652025-03-01T01:24:53.763ZDEBGnexus (BackgroundTasks): client response SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = tuf_artifact_replication result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/artifacts", status: 200, headers: {"content-type": "application/json", "x-request-id": "7137871c-cb94-43a2-908b-7524ec442b44", "content-length": "2", "date": "Sat, 01 Mar 2025 01:24:53 GMT"} })
102662025-03-01T01:24:53.763ZINFOnexus (BackgroundTasks): Successfully got artifact list background_task = tuf_artifact_replication file = nexus/src/app/background/tasks/tuf_artifact_replication.rs:619 sled = http://[fd00:1122:3344:101::1]:12345
102672025-03-01T01:24:53.764ZDEBGnexus (BackgroundTasks): activation complete background_task = tuf_artifact_replication elapsed = 550.165207ms iteration = 3 status = {"last_run_counters":{"copy_err":0,"copy_ok":0,"delete_err":0,"delete_ok":0,"list_err":0,"list_ok":1,"put_err":0,"put_ok":0},"lifetime_counters":{"copy_err":0,"copy_ok":0,"delete_err":0,"delete_ok":0,"list_err":0,"list_ok":3,"put_err":0,"put_ok":0},"local_repos":0,"request_debug_ringbuf":[{"operation":"list","target_sled":"3471264f-127e-4a25-bc10-2e8249e8d70a","time":"2025-03-01T01:14:53.612860610Z"},{"operation":"list","target_sled":"3471264f-127e-4a25-bc10-2e8249e8d70a","time":"2025-03-01T01:19:53.750515495Z"},{"operation":"list","target_sled":"3471264f-127e-4a25-bc10-2e8249e8d70a","time":"2025-03-01T01:24:53.763219301Z"}]}
102682025-03-01T01:24:53.771ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102692025-03-01T01:24:53.773ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
102702025-03-01T01:24:53.773ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
102712025-03-01T01:24:53.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
102722025-03-01T01:24:53.781ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102732025-03-01T01:24:53.782ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
102742025-03-01T01:24:53.783ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
102752025-03-01T01:24:53.783ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
102762025-03-01T01:24:53.784ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
102772025-03-01T01:24:53.784ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
102782025-03-01T01:24:53.785ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 7f9c3c14-58c5-473f-8692-6376be44401e, rack_id: 4854cb88-dfba-4609-8f9d-72aac08cef66, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(cb10d0c6-a704-4231-b148-4f9ae21a03f8) } rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 switch_location = Switch0
102792025-03-01T01:24:53.785ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
102802025-03-01T01:24:53.785ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
102812025-03-01T01:24:53.785ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102822025-03-01T01:24:53.787ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
102832025-03-01T01:24:53.787ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
102842025-03-01T01:24:53.787ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
102852025-03-01T01:24:53.795ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
102862025-03-01T01:24:53.796ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "df65df7e-5dc3-4ee0-bbd9-846d6c8730d7", "content-length": "134", "date": "Sat, 01 Mar 2025 01:24:53 GMT"} })
102872025-03-01T01:24:53.796ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
102882025-03-01T01:24:53.796ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = cb10d0c6-a704-4231-b148-4f9ae21a03f8
102892025-03-01T01:24:53.796ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
102902025-03-01T01:24:53.796ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
102912025-03-01T01:24:53.796ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
102922025-03-01T01:24:53.796ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
102932025-03-01T01:24:53.796ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
102942025-03-01T01:24:53.796ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
102952025-03-01T01:24:53.796ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
102962025-03-01T01:24:53.796ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
102972025-03-01T01:24:53.797ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66
102982025-03-01T01:24:53.797ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
102992025-03-01T01:24:53.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
103002025-03-01T01:24:53.797ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
103012025-03-01T01:24:53.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
103022025-03-01T01:24:53.798ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103032025-03-01T01:24:53.799ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
103042025-03-01T01:24:53.799ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "5b545f02-4ebb-4c51-b5b3-911871639bdb", "content-length": "2", "date": "Sat, 01 Mar 2025 01:24:53 GMT"} })
103052025-03-01T01:24:53.799ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
103062025-03-01T01:24:53.799ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "2fd5efbb-4986-4ba5-b6cc-bb780d3c44d3", "content-length": "52", "date": "Sat, 01 Mar 2025 01:24:53 GMT"} })
103072025-03-01T01:24:53.799ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 switch_location = Switch0
103082025-03-01T01:24:53.799ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
103092025-03-01T01:24:53.802ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
103102025-03-01T01:24:53.802ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
103112025-03-01T01:24:53.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
103122025-03-01T01:24:53.804ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
103132025-03-01T01:24:53.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
103142025-03-01T01:24:53.805ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
103152025-03-01T01:24:53.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
103162025-03-01T01:24:53.806ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103172025-03-01T01:24:53.813ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
103182025-03-01T01:24:53.813ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
103192025-03-01T01:24:53.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
103202025-03-01T01:24:53.815ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103212025-03-01T01:24:53.817ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
103222025-03-01T01:24:53.817ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
103232025-03-01T01:24:53.817ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
103242025-03-01T01:24:53.820ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("external-dns"): [NetworkInterface { id: 2a869d60-39e8-4bdc-8d02-111de31939c0, kind: Service { id: 2e37f4af-57dc-468e-80e3-cf2aea2ffdc8 }, name: Name("external-dns-2e37f4af-57dc-468e-80e3-cf2aea2ffdc8"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 253, 67])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6758d14d-4902-4627-81d2-7dad7e53fa1b, kind: Service { id: 5f6eb3bd-0126-40e0-98ef-ee33df084158 }, name: Name("external-dns-5f6eb3bd-0126-40e0-98ef-ee33df084158"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 249, 39])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("nexus"): [NetworkInterface { id: 300c1ff3-79a6-4732-8c05-98761eb20b54, kind: Service { id: 2787d512-9167-42df-aaa9-77fdf2945e21 }, name: Name("nexus-2787d512-9167-42df-aaa9-77fdf2945e21"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 202, 80])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 406c5523-104c-4a97-b243-5d6f7c1d545c, kind: Service { id: 67b03f4e-4cbd-4843-9cd9-647f610abcfc }, name: Name("nexus-67b03f4e-4cbd-4843-9cd9-647f610abcfc"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 240, 110])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 846bca27-d2f4-4703-8203-b5fe6f2c25c0, kind: Service { id: e72cb471-220b-4fe2-ad51-f1274aedd6cc }, name: Name("nexus-e72cb471-220b-4fe2-ad51-f1274aedd6cc"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 180, 221])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })], Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })]} vpc_interfaces = {}
103252025-03-01T01:24:53.820ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
103262025-03-01T01:24:53.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
103272025-03-01T01:24:53.822ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103282025-03-01T01:24:53.823ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
103292025-03-01T01:24:53.823ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
103302025-03-01T01:24:53.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
103312025-03-01T01:24:53.825ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
103322025-03-01T01:24:53.825ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 2a869d60-39e8-4bdc-8d02-111de31939c0, kind: Service { id: 2e37f4af-57dc-468e-80e3-cf2aea2ffdc8 }, name: Name("external-dns-2e37f4af-57dc-468e-80e3-cf2aea2ffdc8"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 253, 67])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6758d14d-4902-4627-81d2-7dad7e53fa1b, kind: Service { id: 5f6eb3bd-0126-40e0-98ef-ee33df084158 }, name: Name("external-dns-5f6eb3bd-0126-40e0-98ef-ee33df084158"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 249, 39])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 300c1ff3-79a6-4732-8c05-98761eb20b54, kind: Service { id: 2787d512-9167-42df-aaa9-77fdf2945e21 }, name: Name("nexus-2787d512-9167-42df-aaa9-77fdf2945e21"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 202, 80])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 406c5523-104c-4a97-b243-5d6f7c1d545c, kind: Service { id: 67b03f4e-4cbd-4843-9cd9-647f610abcfc }, name: Name("nexus-67b03f4e-4cbd-4843-9cd9-647f610abcfc"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 240, 110])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 846bca27-d2f4-4703-8203-b5fe6f2c25c0, kind: Service { id: e72cb471-220b-4fe2-ad51-f1274aedd6cc }, name: Name("nexus-e72cb471-220b-4fe2-ad51-f1274aedd6cc"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 180, 221])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
103332025-03-01T01:24:53.825ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
103342025-03-01T01:24:53.826ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
103352025-03-01T01:24:53.826ZDEBGnexus (BackgroundTasks): client request SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
103362025-03-01T01:24:53.913ZDEBGnexus (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[fd00:1122:3344:101::1]:12345
103372025-03-01T01:24:53.913ZDEBGnexus (BackgroundTasks): client request SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/inventory
103382025-03-01T01:24:53.921ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "44d01482-172e-4d26-97f8-aa9ae100411c", "date": "Sat, 01 Mar 2025 01:24:53 GMT"} })
103392025-03-01T01:24:53.921ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 switch = Switch0
103402025-03-01T01:24:53.921ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
103412025-03-01T01:24:53.922ZDEBGnexus (BackgroundTasks): client response SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "b7c7528e-4bc0-47af-b9d9-eb8e3b8a2290", "date": "Sat, 01 Mar 2025 01:24:53 GMT"} })
103422025-03-01T01:24:53.922ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
103432025-03-01T01:24:53.922ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
103442025-03-01T01:24:53.922ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "8d64b0ed-e53e-4751-8b90-9d71d6284ea8", "content-length": "682", "date": "Sat, 01 Mar 2025 01:24:53 GMT"} })
103452025-03-01T01:24:53.922ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
103462025-03-01T01:24:53.923ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
103472025-03-01T01:24:53.926ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
103482025-03-01T01:24:53.926ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
103492025-03-01T01:24:53.927ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
103502025-03-01T01:24:53.928ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
103512025-03-01T01:24:53.930ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
103522025-03-01T01:24:53.930ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
103532025-03-01T01:24:53.931ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
103542025-03-01T01:24:53.932ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
103552025-03-01T01:24:53.934ZDEBGnexus (BackgroundTasks): client request SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
103562025-03-01T01:24:53.936ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
103572025-03-01T01:24:53.936ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
103582025-03-01T01:24:53.938ZINFOnexus (BackgroundTasks): VPC route manager sled 3471264f-127e-4a25-bc10-2e8249e8d70a push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
103592025-03-01T01:24:53.938ZDEBGnexus (BackgroundTasks): client request SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
103602025-03-01T01:24:53.943ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 729.581942ms iteration = 21 status = {}
103612025-03-01T01:24:53.946ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: 3471264f-127e-4a25-bc10-2e8249e8d70a, time_created: 2025-03-01T01:14:51.548737Z, time_modified: 2025-03-01T01:14:51.548737Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: 4854cb88-dfba-4609-8f9d-72aac08cef66, is_scrimlet: true, serial_number: "sock", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)), repo_depot_port: SqlU16(12348) }]
103622025-03-01T01:24:53.946ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
103632025-03-01T01:24:53.946ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
103642025-03-01T01:24:53.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
103652025-03-01T01:24:53.948ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
103662025-03-01T01:24:53.948ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
103672025-03-01T01:24:53.949ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103682025-03-01T01:24:53.952ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: 3471264f-127e-4a25-bc10-2e8249e8d70a, lookup_type: ById(3471264f-127e-4a25-bc10-2e8249e8d70a) } result = Ok(())
103692025-03-01T01:24:53.982ZDEBGnexus (BackgroundTasks): client response SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "3b492f9d-99c6-4d6e-adf6-58f8ecb7bc6f", "date": "Sat, 01 Mar 2025 01:24:53 GMT"} })
103702025-03-01T01:24:53.983ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 769.144419ms iteration = 21 status = {}
103712025-03-01T01:24:53.983ZDEBGnexus (BackgroundTasks): client response SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "d53230fd-461c-4998-95e0-190047120f19", "content-length": "691", "date": "Sat, 01 Mar 2025 01:24:53 GMT"} })
103722025-03-01T01:24:53.983ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
103732025-03-01T01:24:53.983ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
103742025-03-01T01:24:53.983ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
103752025-03-01T01:24:53.984ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
103762025-03-01T01:24:53.984ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "ec787537-874e-4e87-ab4b-4807c6a39d16", "date": "Sat, 01 Mar 2025 01:24:53 GMT"} })
103772025-03-01T01:24:53.985ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 770.963674ms iteration = 21 status = {}
103782025-03-01T01:24:53.986ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
103792025-03-01T01:24:53.986ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 772.329713ms
103802025-03-01T01:24:53.986ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 772.339283ms iteration = 3 status = {}
103812025-03-01T01:24:54.177ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 06490a64-d2e8-4c6c-b527-b2cf79a7b3af roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
103822025-03-01T01:24:54.178ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 06490a64-d2e8-4c6c-b527-b2cf79a7b3af resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
103832025-03-01T01:24:54.180ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2362 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 06490a64-d2e8-4c6c-b527-b2cf79a7b3af response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
103842025-03-01T01:24:54.224ZDEBGnexus (BackgroundTasks): client response SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "2edb2f6c-7e25-4501-b67b-c1bb8e4d5180", "content-length": "30795", "date": "Sat, 01 Mar 2025 01:24:53 GMT"} })
103852025-03-01T01:24:54.226ZDEBGnexus (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
103862025-03-01T01:24:54.226ZDEBGnexus (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
103872025-03-01T01:24:54.226ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
103882025-03-01T01:24:54.228ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
103892025-03-01T01:24:54.228ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
103902025-03-01T01:24:54.257ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103912025-03-01T01:24:54.259ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
103922025-03-01T01:24:54.259ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
103932025-03-01T01:24:54.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
103942025-03-01T01:24:54.460ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = 618f3682-4574-49a0-a1a1-800f8a231b85 file = nexus/db-queries/src/db/datastore/inventory.rs:1010
103952025-03-01T01:24:54.460ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = 618f3682-4574-49a0-a1a1-800f8a231b85 time_started = 2025-03-01 01:24:53.734632 UTC
103962025-03-01T01:24:54.460ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 23 reason = Dependency
103972025-03-01T01:24:54.460ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
103982025-03-01T01:24:54.460ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 1.245982441s iteration = 2 status = {"collection_id":"618f3682-4574-49a0-a1a1-800f8a231b85","time_done":"2025-03-01 01:24:54.226605 UTC","time_started":"2025-03-01 01:24:53.734632 UTC"}
103992025-03-01T01:24:54.460ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_rendezvous iteration = 5 reason = Dependency
104002025-03-01T01:24:54.460ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
104012025-03-01T01:24:54.460ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
104022025-03-01T01:24:54.460ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
104032025-03-01T01:24:54.462ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104042025-03-01T01:24:54.464ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Inventory result = Ok(())
104052025-03-01T01:24:54.464ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
104062025-03-01T01:24:54.465ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
104072025-03-01T01:24:54.491ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104082025-03-01T01:24:54.493ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
104092025-03-01T01:24:54.493ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
104102025-03-01T01:24:54.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
104112025-03-01T01:24:54.496ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
104122025-03-01T01:24:54.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
104132025-03-01T01:24:54.498ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104142025-03-01T01:24:54.499ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
104152025-03-01T01:24:54.499ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
104162025-03-01T01:24:54.499ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
104172025-03-01T01:24:54.534ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 74.215392ms iteration = 23 status = {"physical_disks_added":0}
104182025-03-01T01:24:54.621ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
104192025-03-01T01:24:54.622ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
104202025-03-01T01:24:54.672ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
104212025-03-01T01:24:54.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
104222025-03-01T01:24:54.702ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104232025-03-01T01:24:54.704ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
104242025-03-01T01:24:54.704ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
104252025-03-01T01:24:54.704ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
104262025-03-01T01:24:54.705ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104272025-03-01T01:24:54.707ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
104282025-03-01T01:24:54.707ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
104292025-03-01T01:24:54.707ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
104302025-03-01T01:24:54.709ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
104312025-03-01T01:24:54.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
104322025-03-01T01:24:54.739ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104332025-03-01T01:24:54.741ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
104342025-03-01T01:24:54.741ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
104352025-03-01T01:24:54.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
104362025-03-01T01:24:54.743ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104372025-03-01T01:24:54.744ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
104382025-03-01T01:24:54.744ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
104392025-03-01T01:24:54.744ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
104402025-03-01T01:24:54.747ZINFOnexus (BackgroundTasks): ensured all Crucible datasets present in inventory have database records background_task = blueprint_rendezvous file = nexus/reconfigurator/rendezvous/src/crucible_dataset.rs:113 num_already_exist = 9 num_inserted = 0 num_not_in_inventory = 0
104412025-03-01T01:24:54.747ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_rendezvous elapsed = 287.150109ms iteration = 5 status = {"blueprint_id":"8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7","inventory_collection_id":"d00a8475-701c-4371-8725-b920c0690965","stats":{"crucible_dataset":{"num_already_exist":9,"num_inserted":0,"num_not_in_inventory":0},"debug_dataset":{"num_already_exist":9,"num_already_tombstoned":0,"num_inserted":0,"num_not_in_inventory":0,"num_tombstoned":0}}}
104422025-03-01T01:24:55.203ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 6717478b-f90c-45dd-8c19-3bdadbe65793 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
104432025-03-01T01:24:55.203ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 6717478b-f90c-45dd-8c19-3bdadbe65793 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
104442025-03-01T01:24:55.205ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2370 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 6717478b-f90c-45dd-8c19-3bdadbe65793 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
104452025-03-01T01:24:56.226ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 25c8bbba-cc8d-457b-8be9-805f8451e1fd roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
104462025-03-01T01:24:56.227ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 25c8bbba-cc8d-457b-8be9-805f8451e1fd resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
104472025-03-01T01:24:56.228ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2278 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 25c8bbba-cc8d-457b-8be9-805f8451e1fd response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
104482025-03-01T01:24:57.249ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 2227865f-86fa-4ab9-ba25-124d056404cb roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
104492025-03-01T01:24:57.249ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 2227865f-86fa-4ab9-ba25-124d056404cb resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
104502025-03-01T01:24:57.251ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2598 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 2227865f-86fa-4ab9-ba25-124d056404cb response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
104512025-03-01T01:24:57.415ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 400 local_addr = [fd00:1122:3344:101::c]:34357 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = d2b820d0-ae05-4cc7-be7b-3a4f357e82bb response_code = 200 uri = /67b03f4e-4cbd-4843-9cd9-647f610abcfc
104522025-03-01T01:24:58.270ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 80a00f8f-a8f7-4a24-b792-ed31d9c640dc roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
104532025-03-01T01:24:58.270ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 80a00f8f-a8f7-4a24-b792-ed31d9c640dc resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
104542025-03-01T01:24:58.272ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2757 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 80a00f8f-a8f7-4a24-b792-ed31d9c640dc response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
104552025-03-01T01:24:59.292ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 1ee4d578-14bb-484d-94b6-2ca70a836e25 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
104562025-03-01T01:24:59.292ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 1ee4d578-14bb-484d-94b6-2ca70a836e25 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
104572025-03-01T01:24:59.294ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2330 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 1ee4d578-14bb-484d-94b6-2ca70a836e25 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
104582025-03-01T01:25:00.314ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = d17bfa17-8d35-428d-a97a-f8e163164a1b roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
104592025-03-01T01:25:00.314ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = d17bfa17-8d35-428d-a97a-f8e163164a1b resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
104602025-03-01T01:25:00.316ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2358 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = d17bfa17-8d35-428d-a97a-f8e163164a1b response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
104612025-03-01T01:25:01.337ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 620c0b5f-2e09-431f-8802-53323540af02 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
104622025-03-01T01:25:01.337ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 620c0b5f-2e09-431f-8802-53323540af02 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
104632025-03-01T01:25:01.339ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1707 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 620c0b5f-2e09-431f-8802-53323540af02 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
104642025-03-01T01:25:02.359ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 7b0f7788-f89f-4940-b083-82ab9677e54d roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
104652025-03-01T01:25:02.360ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 7b0f7788-f89f-4940-b083-82ab9677e54d resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
104662025-03-01T01:25:02.362ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2573 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 7b0f7788-f89f-4940-b083-82ab9677e54d response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
104672025-03-01T01:25:03.214ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 62 reason = Timeout
104682025-03-01T01:25:03.214ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 62 reason = Timeout
104692025-03-01T01:25:03.214ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104702025-03-01T01:25:03.214ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
104712025-03-01T01:25:03.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104722025-03-01T01:25:03.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
104732025-03-01T01:25:03.216ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104742025-03-01T01:25:03.219ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
104752025-03-01T01:25:03.219ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104762025-03-01T01:25:03.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104772025-03-01T01:25:03.220ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104782025-03-01T01:25:03.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104792025-03-01T01:25:03.222ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104802025-03-01T01:25:03.225ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7, lookup_type: ById(8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7) } result = Ok(())
104812025-03-01T01:25:03.225ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104822025-03-01T01:25:03.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104832025-03-01T01:25:03.236ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 original_time_created = 2025-03-01 01:14:50.436545 UTC target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 time_created = 2025-03-01 01:14:50.436545 UTC
104842025-03-01T01:25:03.236ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.449327ms iteration = 62 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7","time_created":"2025-03-01T01:14:50.436545Z"}
104852025-03-01T01:25:03.243ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
104862025-03-01T01:25:03.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
104872025-03-01T01:25:03.272ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 58.671045ms iteration = 62 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
104882025-03-01T01:25:03.382ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 6149bc12-3c05-4d2b-8341-810521e84150 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
104892025-03-01T01:25:03.383ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 6149bc12-3c05-4d2b-8341-810521e84150 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
104902025-03-01T01:25:03.384ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2166 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 6149bc12-3c05-4d2b-8341-810521e84150 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
104912025-03-01T01:25:04.404ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 65396392-293b-4be4-b418-bcf6d4df59e0 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
104922025-03-01T01:25:04.405ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 65396392-293b-4be4-b418-bcf6d4df59e0 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
104932025-03-01T01:25:04.407ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2479 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 65396392-293b-4be4-b418-bcf6d4df59e0 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
104942025-03-01T01:25:05.427ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 9c42fc54-4841-4cbf-bc29-faad2f3d3361 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
104952025-03-01T01:25:05.427ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 9c42fc54-4841-4cbf-bc29-faad2f3d3361 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
104962025-03-01T01:25:05.428ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1836 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 9c42fc54-4841-4cbf-bc29-faad2f3d3361 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
104972025-03-01T01:25:06.447ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 19c94c35-aa13-4e5d-b95d-127af4add433 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
104982025-03-01T01:25:06.447ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 19c94c35-aa13-4e5d-b95d-127af4add433 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
104992025-03-01T01:25:06.449ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2001 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 19c94c35-aa13-4e5d-b95d-127af4add433 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
105002025-03-01T01:25:07.414ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 362 local_addr = [fd00:1122:3344:101::c]:34357 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = 0d63f2d3-157d-40c0-a89d-c4dacb9043f6 response_code = 200 uri = /67b03f4e-4cbd-4843-9cd9-647f610abcfc
105012025-03-01T01:25:07.468ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 6eb20bd4-b4b7-4a05-a819-dca2721c5777 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
105022025-03-01T01:25:07.469ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 6eb20bd4-b4b7-4a05-a819-dca2721c5777 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
105032025-03-01T01:25:07.471ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2396 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 6eb20bd4-b4b7-4a05-a819-dca2721c5777 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
105042025-03-01T01:25:08.491ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = cb47807b-78d1-4202-a9ac-4c22367b12bf roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
105052025-03-01T01:25:08.492ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = cb47807b-78d1-4202-a9ac-4c22367b12bf resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
105062025-03-01T01:25:08.493ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1703 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = cb47807b-78d1-4202-a9ac-4c22367b12bf response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
105072025-03-01T01:25:09.514ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 61ed27cf-2c5d-4d3c-9b3d-9da5042993b6 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
105082025-03-01T01:25:09.515ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 61ed27cf-2c5d-4d3c-9b3d-9da5042993b6 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
105092025-03-01T01:25:09.517ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2254 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 61ed27cf-2c5d-4d3c-9b3d-9da5042993b6 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
105102025-03-01T01:25:10.537ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 4a0ad221-9519-4f47-ade6-12ac9999d70e roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
105112025-03-01T01:25:10.537ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 4a0ad221-9519-4f47-ade6-12ac9999d70e resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
105122025-03-01T01:25:10.538ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1817 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 4a0ad221-9519-4f47-ade6-12ac9999d70e response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
105132025-03-01T01:25:11.558ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 3e4cc8b1-2d2d-43b5-ac0e-52694aff0485 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
105142025-03-01T01:25:11.559ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 3e4cc8b1-2d2d-43b5-ac0e-52694aff0485 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
105152025-03-01T01:25:11.560ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2083 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 3e4cc8b1-2d2d-43b5-ac0e-52694aff0485 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
105162025-03-01T01:25:12.580ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 0bfd4835-41b6-45ce-87ba-b5958683d9c2 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
105172025-03-01T01:25:12.581ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 0bfd4835-41b6-45ce-87ba-b5958683d9c2 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
105182025-03-01T01:25:12.583ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2746 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 0bfd4835-41b6-45ce-87ba-b5958683d9c2 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
105192025-03-01T01:25:13.213ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 63 reason = Timeout
105202025-03-01T01:25:13.213ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 63 reason = Timeout
105212025-03-01T01:25:13.213ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
105222025-03-01T01:25:13.213ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
105232025-03-01T01:25:13.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
105242025-03-01T01:25:13.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
105252025-03-01T01:25:13.215ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
105262025-03-01T01:25:13.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
105272025-03-01T01:25:13.215ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105282025-03-01T01:25:13.218ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
105292025-03-01T01:25:13.218ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
105302025-03-01T01:25:13.218ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
105312025-03-01T01:25:13.220ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
105322025-03-01T01:25:13.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
105332025-03-01T01:25:13.221ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105342025-03-01T01:25:13.224ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7, lookup_type: ById(8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7) } result = Ok(())
105352025-03-01T01:25:13.224ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
105362025-03-01T01:25:13.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
105372025-03-01T01:25:13.236ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 original_time_created = 2025-03-01 01:14:50.436545 UTC target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 time_created = 2025-03-01 01:14:50.436545 UTC
105382025-03-01T01:25:13.236ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.799654ms iteration = 63 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7","time_created":"2025-03-01T01:14:50.436545Z"}
105392025-03-01T01:25:13.241ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 28.210845ms iteration = 63 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
105402025-03-01T01:25:13.603ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 76f2685e-dbd8-4bb7-ab43-8694e260384a roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
105412025-03-01T01:25:13.604ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 76f2685e-dbd8-4bb7-ab43-8694e260384a resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
105422025-03-01T01:25:13.606ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2486 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 76f2685e-dbd8-4bb7-ab43-8694e260384a response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
105432025-03-01T01:25:14.626ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = cd89ad8e-a00b-4600-9d1f-86bfe4565270 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
105442025-03-01T01:25:14.626ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = cd89ad8e-a00b-4600-9d1f-86bfe4565270 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
105452025-03-01T01:25:14.627ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1738 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = cd89ad8e-a00b-4600-9d1f-86bfe4565270 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
105462025-03-01T01:25:15.648ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 5a6226fc-f57c-4f63-88d2-afec3e501733 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
105472025-03-01T01:25:15.648ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 5a6226fc-f57c-4f63-88d2-afec3e501733 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
105482025-03-01T01:25:15.650ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2560 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 5a6226fc-f57c-4f63-88d2-afec3e501733 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
105492025-03-01T01:25:16.671ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 6cdb3b63-2ae9-4075-a6a2-f3002e188164 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
105502025-03-01T01:25:16.671ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 6cdb3b63-2ae9-4075-a6a2-f3002e188164 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
105512025-03-01T01:25:16.673ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2152 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 6cdb3b63-2ae9-4075-a6a2-f3002e188164 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
105522025-03-01T01:25:17.414ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 330 local_addr = [fd00:1122:3344:101::c]:34357 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = ec8f966a-c101-4485-ac09-c555cb79b904 response_code = 200 uri = /67b03f4e-4cbd-4843-9cd9-647f610abcfc
105532025-03-01T01:25:17.693ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 446166ce-8610-4ea4-887d-e7dd118d4dea roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
105542025-03-01T01:25:17.693ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 446166ce-8610-4ea4-887d-e7dd118d4dea resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
105552025-03-01T01:25:17.696ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2595 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 446166ce-8610-4ea4-887d-e7dd118d4dea response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
105562025-03-01T01:25:18.715ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = a57bde3c-0878-4ad6-bb58-49f07cec52af roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
105572025-03-01T01:25:18.716ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = a57bde3c-0878-4ad6-bb58-49f07cec52af resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
105582025-03-01T01:25:18.717ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2044 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = a57bde3c-0878-4ad6-bb58-49f07cec52af response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
105592025-03-01T01:25:19.736ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = fb6efa72-0086-44ab-91c9-b75bf4c23dc2 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
105602025-03-01T01:25:19.737ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = fb6efa72-0086-44ab-91c9-b75bf4c23dc2 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
105612025-03-01T01:25:19.738ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2003 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = fb6efa72-0086-44ab-91c9-b75bf4c23dc2 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
105622025-03-01T01:25:20.758ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 782c9957-96b3-494d-b862-dab2fad384c3 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
105632025-03-01T01:25:20.758ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 782c9957-96b3-494d-b862-dab2fad384c3 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
105642025-03-01T01:25:20.760ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2169 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 782c9957-96b3-494d-b862-dab2fad384c3 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
105652025-03-01T01:25:21.779ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 6e534b2b-fe15-4924-a834-610b6cca5262 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
105662025-03-01T01:25:21.779ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 6e534b2b-fe15-4924-a834-610b6cca5262 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
105672025-03-01T01:25:21.781ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1922 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 6e534b2b-fe15-4924-a834-610b6cca5262 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
105682025-03-01T01:25:22.799ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 99478225-c5a2-4d4b-9ed3-ecfc4c7ca823 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
105692025-03-01T01:25:22.799ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 99478225-c5a2-4d4b-9ed3-ecfc4c7ca823 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
105702025-03-01T01:25:22.801ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2377 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 99478225-c5a2-4d4b-9ed3-ecfc4c7ca823 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
105712025-03-01T01:25:23.213ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 22 reason = Timeout
105722025-03-01T01:25:23.213ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 22 reason = Timeout
105732025-03-01T01:25:23.213ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
105742025-03-01T01:25:23.213ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
105752025-03-01T01:25:23.213ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 22 reason = Timeout
105762025-03-01T01:25:23.213ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 22 reason = Timeout
105772025-03-01T01:25:23.213ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
105782025-03-01T01:25:23.213ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
105792025-03-01T01:25:23.213ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 22 reason = Timeout
105802025-03-01T01:25:23.213ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
105812025-03-01T01:25:23.213ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 64 reason = Timeout
105822025-03-01T01:25:23.213ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 22 reason = Timeout
105832025-03-01T01:25:23.213ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
105842025-03-01T01:25:23.213ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 22 reason = Timeout
105852025-03-01T01:25:23.213ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
105862025-03-01T01:25:23.213ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
105872025-03-01T01:25:23.213ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
105882025-03-01T01:25:23.213ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 22 reason = Timeout
105892025-03-01T01:25:23.213ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 22 reason = Timeout
105902025-03-01T01:25:23.213ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
105912025-03-01T01:25:23.213ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 64 reason = Timeout
105922025-03-01T01:25:23.213ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
105932025-03-01T01:25:23.213ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 24 reason = Timeout
105942025-03-01T01:25:23.214ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
105952025-03-01T01:25:23.214ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 22 reason = Timeout
105962025-03-01T01:25:23.214ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
105972025-03-01T01:25:23.214ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
105982025-03-01T01:25:23.214ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 22 reason = Timeout
105992025-03-01T01:25:23.214ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
106002025-03-01T01:25:23.214ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 22 reason = Timeout
106012025-03-01T01:25:23.214ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 22 reason = Timeout
106022025-03-01T01:25:23.214ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 22 reason = Timeout
106032025-03-01T01:25:23.214ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
106042025-03-01T01:25:23.214ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
106052025-03-01T01:25:23.214ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
106062025-03-01T01:25:23.214ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 22 reason = Timeout
106072025-03-01T01:25:23.214ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
106082025-03-01T01:25:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
106092025-03-01T01:25:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
106102025-03-01T01:25:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
106112025-03-01T01:25:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
106122025-03-01T01:25:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
106132025-03-01T01:25:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
106142025-03-01T01:25:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
106152025-03-01T01:25:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
106162025-03-01T01:25:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
106172025-03-01T01:25:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
106182025-03-01T01:25:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
106192025-03-01T01:25:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
106202025-03-01T01:25:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
106212025-03-01T01:25:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
106222025-03-01T01:25:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
106232025-03-01T01:25:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
106242025-03-01T01:25:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
106252025-03-01T01:25:23.216ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106262025-03-01T01:25:23.216ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 2.828118ms iteration = 22 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
106272025-03-01T01:25:23.217ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
106282025-03-01T01:25:23.217ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
106292025-03-01T01:25:23.218ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
106302025-03-01T01:25:23.222ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106312025-03-01T01:25:23.224ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1533, tv_nsec: 912218646 } })
106322025-03-01T01:25:23.224ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1154
106332025-03-01T01:25:23.225ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
106342025-03-01T01:25:23.225ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
106352025-03-01T01:25:23.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
106362025-03-01T01:25:23.227ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1533, tv_nsec: 915620775 } })
106372025-03-01T01:25:23.227ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1154
106382025-03-01T01:25:23.228ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106392025-03-01T01:25:23.231ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
106402025-03-01T01:25:23.231ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
106412025-03-01T01:25:23.231ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
106422025-03-01T01:25:23.238ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
106432025-03-01T01:25:23.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
106442025-03-01T01:25:23.240ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1533, tv_nsec: 928230042 } })
106452025-03-01T01:25:23.240ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1154 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66
106462025-03-01T01:25:23.253ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
106472025-03-01T01:25:23.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
106482025-03-01T01:25:23.256ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 42.573057ms iteration = 22 status = {"errors":[],"finish_invoked_ok":[]}
106492025-03-01T01:25:23.256ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106502025-03-01T01:25:23.257ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
106512025-03-01T01:25:23.257ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
106522025-03-01T01:25:23.257ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
106532025-03-01T01:25:23.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
106542025-03-01T01:25:23.258ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
106552025-03-01T01:25:23.258ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
106562025-03-01T01:25:23.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
106572025-03-01T01:25:23.258ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106582025-03-01T01:25:23.260ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106592025-03-01T01:25:23.261ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
106602025-03-01T01:25:23.261ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
106612025-03-01T01:25:23.261ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
106622025-03-01T01:25:23.261ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
106632025-03-01T01:25:23.261ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
106642025-03-01T01:25:23.262ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 48.030528ms iteration = 22 status = {"errors":[],"garbage_collect_requested":[]}
106652025-03-01T01:25:23.262ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
106662025-03-01T01:25:23.262ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
106672025-03-01T01:25:23.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
106682025-03-01T01:25:23.262ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106692025-03-01T01:25:23.262ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
106702025-03-01T01:25:23.263ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
106712025-03-01T01:25:23.263ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
106722025-03-01T01:25:23.263ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
106732025-03-01T01:25:23.263ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
106742025-03-01T01:25:23.263ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
106752025-03-01T01:25:23.265ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
106762025-03-01T01:25:23.265ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
106772025-03-01T01:25:23.265ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
106782025-03-01T01:25:23.265ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
106792025-03-01T01:25:23.266ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
106802025-03-01T01:25:23.269ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
106812025-03-01T01:25:23.269ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 56.114263ms iteration = 22 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
106822025-03-01T01:25:23.269ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106832025-03-01T01:25:23.272ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
106842025-03-01T01:25:23.272ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
106852025-03-01T01:25:23.272ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
106862025-03-01T01:25:23.291ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
106872025-03-01T01:25:23.291ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
106882025-03-01T01:25:23.291ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
106892025-03-01T01:25:23.291ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 78.005319ms iteration = 22 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
106902025-03-01T01:25:23.292ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
106912025-03-01T01:25:23.292ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
106922025-03-01T01:25:23.292ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
106932025-03-01T01:25:23.297ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
106942025-03-01T01:25:23.297ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
106952025-03-01T01:25:23.297ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 83.891829ms iteration = 22 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
106962025-03-01T01:25:23.298ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 84.857198ms iteration = 64 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
106972025-03-01T01:25:23.303ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106982025-03-01T01:25:23.305ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7, lookup_type: ById(8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7) } result = Ok(())
106992025-03-01T01:25:23.305ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
107002025-03-01T01:25:23.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
107012025-03-01T01:25:23.330ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
107022025-03-01T01:25:23.330ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
107032025-03-01T01:25:23.330ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
107042025-03-01T01:25:23.330ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
107052025-03-01T01:25:23.330ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1f1e92d0-b7c1-4bdb-8803-52ee5862c88a", "content-length": "26", "date": "Sat, 01 Mar 2025 01:25:23 GMT"} })
107062025-03-01T01:25:23.330ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
107072025-03-01T01:25:23.332ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
107082025-03-01T01:25:23.359ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
107092025-03-01T01:25:23.359ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
107102025-03-01T01:25:23.360ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "37e0e54a-9713-4b0b-9353-7ed574400a4c", "content-length": "26", "date": "Sat, 01 Mar 2025 01:25:23 GMT"} })
107112025-03-01T01:25:23.360ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
107122025-03-01T01:25:23.362ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
107132025-03-01T01:25:23.444ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1162 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 zone_address = fd00:1122:3344:101::2
107142025-03-01T01:25:23.444ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
107152025-03-01T01:25:23.444ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "604a268c-838f-4c0d-a5b3-91d9440df68f", "content-length": "26", "date": "Sat, 01 Mar 2025 01:25:23 GMT"} })
107162025-03-01T01:25:23.444ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1167 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
107172025-03-01T01:25:23.445ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66
107182025-03-01T01:25:23.471ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 257.626598ms iteration = 22 status = {}
107192025-03-01T01:25:23.477ZINFOnexus (BackgroundTasks): VPC route manager sled 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
107202025-03-01T01:25:23.477ZDEBGnexus (BackgroundTasks): client request SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
107212025-03-01T01:25:23.477ZDEBGnexus (BackgroundTasks): client response SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "95e65260-23ce-42b9-a258-2c48d860b8ac", "content-length": "372", "date": "Sat, 01 Mar 2025 01:25:23 GMT"} })
107222025-03-01T01:25:23.477ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
107232025-03-01T01:25:23.478ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
107242025-03-01T01:25:23.479ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
107252025-03-01T01:25:23.480ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
107262025-03-01T01:25:23.480ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
107272025-03-01T01:25:23.481ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
107282025-03-01T01:25:23.481ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107292025-03-01T01:25:23.484ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
107302025-03-01T01:25:23.484ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
107312025-03-01T01:25:23.484ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
107322025-03-01T01:25:23.484ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
107332025-03-01T01:25:23.485ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "9cf4e28c-77ca-4aa7-b819-8c7595f8ec27", "content-length": "2", "date": "Sat, 01 Mar 2025 01:25:22 GMT"} })
107342025-03-01T01:25:23.487ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
107352025-03-01T01:25:23.487ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
107362025-03-01T01:25:23.489ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 275.527483ms iteration = 22 status = null
107372025-03-01T01:25:23.502ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 original_time_created = 2025-03-01 01:14:50.436545 UTC target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 time_created = 2025-03-01 01:14:50.436545 UTC
107382025-03-01T01:25:23.502ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 288.232111ms iteration = 64 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7","time_created":"2025-03-01T01:14:50.436545Z"}
107392025-03-01T01:25:23.517ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
107402025-03-01T01:25:23.517ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 303.273668ms iteration = 22 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
107412025-03-01T01:25:23.519ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107422025-03-01T01:25:23.521ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
107432025-03-01T01:25:23.521ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
107442025-03-01T01:25:23.521ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
107452025-03-01T01:25:23.523ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107462025-03-01T01:25:23.526ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 312.68431ms iteration = 22 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
107472025-03-01T01:25:23.528ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 3471264f-127e-4a25-bc10-2e8249e8d70a, lookup_type: ById(3471264f-127e-4a25-bc10-2e8249e8d70a) } result = Ok(())
107482025-03-01T01:25:23.528ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
107492025-03-01T01:25:23.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
107502025-03-01T01:25:23.530ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 316.367615ms iteration = 22 status = 0
107512025-03-01T01:25:23.530ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
107522025-03-01T01:25:23.530ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
107532025-03-01T01:25:23.530ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 317.091239ms iteration = 22 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
107542025-03-01T01:25:23.532ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
107552025-03-01T01:25:23.532ZDEBGnexus (BackgroundTasks): client request SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
107562025-03-01T01:25:23.532ZDEBGnexus (BackgroundTasks): client response SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "76785bf3-05be-4e4d-94a9-30f6045636a4", "date": "Sat, 01 Mar 2025 01:25:23 GMT"} })
107572025-03-01T01:25:23.532ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
107582025-03-01T01:25:23.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
107592025-03-01T01:25:23.535ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
107602025-03-01T01:25:23.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
107612025-03-01T01:25:23.538ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
107622025-03-01T01:25:23.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
107632025-03-01T01:25:23.542ZINFOnexus (BackgroundTasks): VPC route manager sled 3471264f-127e-4a25-bc10-2e8249e8d70a push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
107642025-03-01T01:25:23.542ZDEBGnexus (BackgroundTasks): client request SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
107652025-03-01T01:25:23.542ZDEBGnexus (BackgroundTasks): client response SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "c15f9119-f448-405f-9566-c2b3e97878f0", "date": "Sat, 01 Mar 2025 01:25:23 GMT"} })
107662025-03-01T01:25:23.543ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 329.771348ms iteration = 22 status = {}
107672025-03-01T01:25:23.580ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
107682025-03-01T01:25:23.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
107692025-03-01T01:25:23.583ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 7f9c3c14-58c5-473f-8692-6376be44401e, rack_id: 4854cb88-dfba-4609-8f9d-72aac08cef66, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(cb10d0c6-a704-4231-b148-4f9ae21a03f8) } rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 switch_location = Switch0
107702025-03-01T01:25:23.583ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
107712025-03-01T01:25:23.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
107722025-03-01T01:25:23.588ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
107732025-03-01T01:25:23.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
107742025-03-01T01:25:23.595ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
107752025-03-01T01:25:23.595ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "45448316-a921-4ccc-87fc-6e07e494e455", "content-length": "134", "date": "Sat, 01 Mar 2025 01:25:22 GMT"} })
107762025-03-01T01:25:23.595ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
107772025-03-01T01:25:23.595ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = cb10d0c6-a704-4231-b148-4f9ae21a03f8
107782025-03-01T01:25:23.595ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
107792025-03-01T01:25:23.596ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
107802025-03-01T01:25:23.596ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
107812025-03-01T01:25:23.596ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
107822025-03-01T01:25:23.596ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
107832025-03-01T01:25:23.596ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
107842025-03-01T01:25:23.596ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
107852025-03-01T01:25:23.596ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
107862025-03-01T01:25:23.596ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66
107872025-03-01T01:25:23.596ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
107882025-03-01T01:25:23.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
107892025-03-01T01:25:23.598ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
107902025-03-01T01:25:23.598ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "8117ab86-c8cf-45a4-ae6c-a468bc775f55", "content-length": "2", "date": "Sat, 01 Mar 2025 01:25:22 GMT"} })
107912025-03-01T01:25:23.598ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
107922025-03-01T01:25:23.598ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "2ed9a22c-e1e3-4a24-a12e-08cbe6ddbce6", "content-length": "52", "date": "Sat, 01 Mar 2025 01:25:22 GMT"} })
107932025-03-01T01:25:23.598ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 switch_location = Switch0
107942025-03-01T01:25:23.598ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
107952025-03-01T01:25:23.617ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 403.126992ms iteration = 24 status = {"physical_disks_added":0}
107962025-03-01T01:25:23.618ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107972025-03-01T01:25:23.620ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
107982025-03-01T01:25:23.620ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
107992025-03-01T01:25:23.621ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
108002025-03-01T01:25:23.622ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108012025-03-01T01:25:23.624ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
108022025-03-01T01:25:23.624ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
108032025-03-01T01:25:23.624ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
108042025-03-01T01:25:23.698ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "a5a559df-acf3-4d8b-a3bc-150c91e15a62", "date": "Sat, 01 Mar 2025 01:25:23 GMT"} })
108052025-03-01T01:25:23.698ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 switch = Switch0
108062025-03-01T01:25:23.698ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
108072025-03-01T01:25:23.698ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "3ff0d9c3-327e-4926-bca0-9adb3117c900", "content-length": "682", "date": "Sat, 01 Mar 2025 01:25:23 GMT"} })
108082025-03-01T01:25:23.698ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
108092025-03-01T01:25:23.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
108102025-03-01T01:25:23.702ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
108112025-03-01T01:25:23.703ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
108122025-03-01T01:25:23.705ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
108132025-03-01T01:25:23.705ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
108142025-03-01T01:25:23.707ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
108152025-03-01T01:25:23.708ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
108162025-03-01T01:25:23.713ZDEBGnexus (BackgroundTasks): client request SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
108172025-03-01T01:25:23.713ZDEBGnexus (BackgroundTasks): client response SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "8e843a7d-0e16-4d84-849a-188d8e98ee14", "content-length": "691", "date": "Sat, 01 Mar 2025 01:25:23 GMT"} })
108182025-03-01T01:25:23.713ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
108192025-03-01T01:25:23.713ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
108202025-03-01T01:25:23.713ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
108212025-03-01T01:25:23.714ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 500.791652ms iteration = 22 status = {}
108222025-03-01T01:25:23.714ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 500.769961ms iteration = 22 status = {}
108232025-03-01T01:25:23.889ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 4448189b-8e99-47d7-9e19-25fad48557e8 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
108242025-03-01T01:25:23.890ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 4448189b-8e99-47d7-9e19-25fad48557e8 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
108252025-03-01T01:25:23.892ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2529 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 4448189b-8e99-47d7-9e19-25fad48557e8 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
108262025-03-01T01:25:24.910ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = bc1f0013-15b9-4596-bcdb-94dfdb89596a roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
108272025-03-01T01:25:24.910ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = bc1f0013-15b9-4596-bcdb-94dfdb89596a resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
108282025-03-01T01:25:24.912ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2559 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = bc1f0013-15b9-4596-bcdb-94dfdb89596a response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
108292025-03-01T01:25:25.932ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = cf7623fa-c726-48c5-b689-b69637a24b95 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
108302025-03-01T01:25:25.933ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = cf7623fa-c726-48c5-b689-b69637a24b95 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
108312025-03-01T01:25:25.934ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2481 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = cf7623fa-c726-48c5-b689-b69637a24b95 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
108322025-03-01T01:25:26.954ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 3e75fc1f-2ba9-4774-bd25-54897ffaaad1 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
108332025-03-01T01:25:26.955ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 3e75fc1f-2ba9-4774-bd25-54897ffaaad1 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
108342025-03-01T01:25:26.957ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2419 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 3e75fc1f-2ba9-4774-bd25-54897ffaaad1 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
108352025-03-01T01:25:27.414ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 329 local_addr = [fd00:1122:3344:101::c]:34357 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = 119e1db9-2ac1-4c15-8126-2e830488ea7b response_code = 200 uri = /67b03f4e-4cbd-4843-9cd9-647f610abcfc
108362025-03-01T01:25:27.977ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 6676cedb-5d4d-4478-b95d-882865e34a95 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
108372025-03-01T01:25:27.978ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 6676cedb-5d4d-4478-b95d-882865e34a95 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
108382025-03-01T01:25:27.980ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2527 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 6676cedb-5d4d-4478-b95d-882865e34a95 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
108392025-03-01T01:25:29.000ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 7f56307f-dc06-42d9-96ed-080a9d2f7e49 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
108402025-03-01T01:25:29.000ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 7f56307f-dc06-42d9-96ed-080a9d2f7e49 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
108412025-03-01T01:25:29.002ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2290 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 7f56307f-dc06-42d9-96ed-080a9d2f7e49 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
108422025-03-01T01:25:30.024ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = ebb36f6b-6bed-4dad-9f37-96987ca2779c roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
108432025-03-01T01:25:30.024ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = ebb36f6b-6bed-4dad-9f37-96987ca2779c resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
108442025-03-01T01:25:30.026ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2316 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = ebb36f6b-6bed-4dad-9f37-96987ca2779c response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
108452025-03-01T01:25:31.046ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = b87907d8-8a21-4c35-bba0-8705eea4bb5f roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
108462025-03-01T01:25:31.046ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = b87907d8-8a21-4c35-bba0-8705eea4bb5f resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
108472025-03-01T01:25:31.047ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1713 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = b87907d8-8a21-4c35-bba0-8705eea4bb5f response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
108482025-03-01T01:25:32.068ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = fdc18808-133e-4bb0-8064-1ddadc5ed9f6 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
108492025-03-01T01:25:32.069ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = fdc18808-133e-4bb0-8064-1ddadc5ed9f6 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
108502025-03-01T01:25:32.071ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2731 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = fdc18808-133e-4bb0-8064-1ddadc5ed9f6 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
108512025-03-01T01:25:33.100ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 6c325768-0b73-44b1-9851-e4612671722e roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
108522025-03-01T01:25:33.101ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 6c325768-0b73-44b1-9851-e4612671722e resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
108532025-03-01T01:25:33.102ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2031 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 6c325768-0b73-44b1-9851-e4612671722e response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
108542025-03-01T01:25:33.213ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 65 reason = Timeout
108552025-03-01T01:25:33.213ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 65 reason = Timeout
108562025-03-01T01:25:33.213ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
108572025-03-01T01:25:33.213ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
108582025-03-01T01:25:33.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
108592025-03-01T01:25:33.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
108602025-03-01T01:25:33.215ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108612025-03-01T01:25:33.218ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
108622025-03-01T01:25:33.218ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
108632025-03-01T01:25:33.218ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
108642025-03-01T01:25:33.220ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
108652025-03-01T01:25:33.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
108662025-03-01T01:25:33.245ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
108672025-03-01T01:25:33.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
108682025-03-01T01:25:33.254ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108692025-03-01T01:25:33.256ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7, lookup_type: ById(8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7) } result = Ok(())
108702025-03-01T01:25:33.257ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
108712025-03-01T01:25:33.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
108722025-03-01T01:25:33.268ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 original_time_created = 2025-03-01 01:14:50.436545 UTC target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 time_created = 2025-03-01 01:14:50.436545 UTC
108732025-03-01T01:25:33.268ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 54.928009ms iteration = 65 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7","time_created":"2025-03-01T01:14:50.436545Z"}
108742025-03-01T01:25:33.274ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 60.513613ms iteration = 65 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
108752025-03-01T01:25:34.124ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = cdeeece2-68dd-4977-ad23-de0654e3f702 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
108762025-03-01T01:25:34.124ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = cdeeece2-68dd-4977-ad23-de0654e3f702 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
108772025-03-01T01:25:34.127ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2459 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = cdeeece2-68dd-4977-ad23-de0654e3f702 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
108782025-03-01T01:25:35.147ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 3eeb6853-4690-4da1-9451-2971d30ee19e roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
108792025-03-01T01:25:35.148ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 3eeb6853-4690-4da1-9451-2971d30ee19e resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
108802025-03-01T01:25:35.150ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2333 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 3eeb6853-4690-4da1-9451-2971d30ee19e response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
108812025-03-01T01:25:36.170ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 63afd6b5-f7e0-41fb-a7b6-e223257ab5c8 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
108822025-03-01T01:25:36.171ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 63afd6b5-f7e0-41fb-a7b6-e223257ab5c8 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
108832025-03-01T01:25:36.172ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1912 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 63afd6b5-f7e0-41fb-a7b6-e223257ab5c8 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
108842025-03-01T01:25:37.193ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 1fff8ad2-de82-4e5d-882f-70930c1b4d36 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
108852025-03-01T01:25:37.193ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 1fff8ad2-de82-4e5d-882f-70930c1b4d36 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
108862025-03-01T01:25:37.195ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2444 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 1fff8ad2-de82-4e5d-882f-70930c1b4d36 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
108872025-03-01T01:25:37.414ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 334 local_addr = [fd00:1122:3344:101::c]:34357 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = 206d675f-eaa3-4310-8e07-e9074b734e75 response_code = 200 uri = /67b03f4e-4cbd-4843-9cd9-647f610abcfc
108882025-03-01T01:25:38.216ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 9eeed300-c37f-4d09-9d6d-48ea9f5c4d8d roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
108892025-03-01T01:25:38.216ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 9eeed300-c37f-4d09-9d6d-48ea9f5c4d8d resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
108902025-03-01T01:25:38.218ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2139 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 9eeed300-c37f-4d09-9d6d-48ea9f5c4d8d response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
108912025-03-01T01:25:39.238ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 68db247e-0f20-438d-9dde-e1d07bfc5973 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
108922025-03-01T01:25:39.238ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 68db247e-0f20-438d-9dde-e1d07bfc5973 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
108932025-03-01T01:25:39.240ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1894 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 68db247e-0f20-438d-9dde-e1d07bfc5973 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
108942025-03-01T01:25:40.261ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = e1b99bee-3b0a-493d-95f6-fcc54d93d3d0 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
108952025-03-01T01:25:40.262ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = e1b99bee-3b0a-493d-95f6-fcc54d93d3d0 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
108962025-03-01T01:25:40.263ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1547 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = e1b99bee-3b0a-493d-95f6-fcc54d93d3d0 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
108972025-03-01T01:25:41.283ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 1322c8b3-b723-495d-b425-fcb726c72397 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
108982025-03-01T01:25:41.283ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 1322c8b3-b723-495d-b425-fcb726c72397 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
108992025-03-01T01:25:41.285ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2466 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 1322c8b3-b723-495d-b425-fcb726c72397 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
109002025-03-01T01:25:42.306ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = ac9f7963-c169-4222-8ede-88135f244e1d roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
109012025-03-01T01:25:42.307ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = ac9f7963-c169-4222-8ede-88135f244e1d resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
109022025-03-01T01:25:42.309ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2362 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = ac9f7963-c169-4222-8ede-88135f244e1d response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
109032025-03-01T01:25:43.214ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 66 reason = Timeout
109042025-03-01T01:25:43.214ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 66 reason = Timeout
109052025-03-01T01:25:43.214ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
109062025-03-01T01:25:43.214ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
109072025-03-01T01:25:43.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
109082025-03-01T01:25:43.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
109092025-03-01T01:25:43.256ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109102025-03-01T01:25:43.260ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
109112025-03-01T01:25:43.260ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
109122025-03-01T01:25:43.260ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
109132025-03-01T01:25:43.262ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
109142025-03-01T01:25:43.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
109152025-03-01T01:25:43.262ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
109162025-03-01T01:25:43.263ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
109172025-03-01T01:25:43.265ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109182025-03-01T01:25:43.269ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7, lookup_type: ById(8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7) } result = Ok(())
109192025-03-01T01:25:43.269ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
109202025-03-01T01:25:43.269ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
109212025-03-01T01:25:43.284ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 original_time_created = 2025-03-01 01:14:50.436545 UTC target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 time_created = 2025-03-01 01:14:50.436545 UTC
109222025-03-01T01:25:43.284ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 69.953605ms iteration = 66 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7","time_created":"2025-03-01T01:14:50.436545Z"}
109232025-03-01T01:25:43.309ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 95.192259ms iteration = 66 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
109242025-03-01T01:25:43.330ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 9036648e-e482-4d9c-9389-b38df9db3bb5 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
109252025-03-01T01:25:43.330ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 9036648e-e482-4d9c-9389-b38df9db3bb5 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
109262025-03-01T01:25:43.333ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2965 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 9036648e-e482-4d9c-9389-b38df9db3bb5 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
109272025-03-01T01:25:44.359ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 697eaf75-9704-45a9-87f1-90688d1858a9 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
109282025-03-01T01:25:44.360ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 697eaf75-9704-45a9-87f1-90688d1858a9 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
109292025-03-01T01:25:44.361ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1993 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 697eaf75-9704-45a9-87f1-90688d1858a9 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
109302025-03-01T01:25:45.382ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c8eb33a3-3f18-4941-b7b3-924813fa38d2 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
109312025-03-01T01:25:45.383ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c8eb33a3-3f18-4941-b7b3-924813fa38d2 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
109322025-03-01T01:25:45.385ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2605 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c8eb33a3-3f18-4941-b7b3-924813fa38d2 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
109332025-03-01T01:25:46.405ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 74c2e3ad-f4fc-45da-9932-5ebbdea59aec roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
109342025-03-01T01:25:46.406ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 74c2e3ad-f4fc-45da-9932-5ebbdea59aec resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
109352025-03-01T01:25:46.407ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2216 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 74c2e3ad-f4fc-45da-9932-5ebbdea59aec response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
109362025-03-01T01:25:47.414ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 312 local_addr = [fd00:1122:3344:101::c]:34357 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = c7d1c1e9-0109-481e-a6ce-c2cd3a0cbeda response_code = 200 uri = /67b03f4e-4cbd-4843-9cd9-647f610abcfc
109372025-03-01T01:25:47.429ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 8a83c7f7-fd96-4de7-836e-9078448e137f roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
109382025-03-01T01:25:47.429ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 8a83c7f7-fd96-4de7-836e-9078448e137f resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
109392025-03-01T01:25:47.431ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2323 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 8a83c7f7-fd96-4de7-836e-9078448e137f response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
109402025-03-01T01:25:48.256ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2079 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = aca99a49-7c59-4a59-af58-b9aed0dbfdb5 remote_addr = [fd00:1122:3344:101::1]:43446 req_id = f9996c68-7d89-4442-b322-8d4e9ff30ba2 uri = /vmms/aca99a49-7c59-4a59-af58-b9aed0dbfdb5 vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2025-03-01T01:25:48.226141752Z }
109412025-03-01T01:25:48.256ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43446 req_id = f9996c68-7d89-4442-b322-8d4e9ff30ba2 roles = RoleSet { roles: {} } uri = /vmms/aca99a49-7c59-4a59-af58-b9aed0dbfdb5
109422025-03-01T01:25:48.256ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43446 req_id = f9996c68-7d89-4442-b322-8d4e9ff30ba2 resource = Database result = Ok(()) uri = /vmms/aca99a49-7c59-4a59-af58-b9aed0dbfdb5
109432025-03-01T01:25:48.296ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 68557 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43446 req_id = f9996c68-7d89-4442-b322-8d4e9ff30ba2 response_code = 204 uri = /vmms/aca99a49-7c59-4a59-af58-b9aed0dbfdb5
109442025-03-01T01:25:48.296ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2079 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = aca99a49-7c59-4a59-af58-b9aed0dbfdb5 remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 5cb1259b-0d32-4768-b8c2-042555baa802 uri = /vmms/aca99a49-7c59-4a59-af58-b9aed0dbfdb5 vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2025-03-01T01:25:48.296408454Z }
109452025-03-01T01:25:48.296ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 5cb1259b-0d32-4768-b8c2-042555baa802 roles = RoleSet { roles: {} } uri = /vmms/aca99a49-7c59-4a59-af58-b9aed0dbfdb5
109462025-03-01T01:25:48.296ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 5cb1259b-0d32-4768-b8c2-042555baa802 resource = Database result = Ok(()) uri = /vmms/aca99a49-7c59-4a59-af58-b9aed0dbfdb5
109472025-03-01T01:25:48.333ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 37302 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 5cb1259b-0d32-4768-b8c2-042555baa802 response_code = 204 uri = /vmms/aca99a49-7c59-4a59-af58-b9aed0dbfdb5
109482025-03-01T01:25:48.454ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 6fdd3a58-1427-4d4b-84f6-0199168f3467 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
109492025-03-01T01:25:48.454ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 6fdd3a58-1427-4d4b-84f6-0199168f3467 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
109502025-03-01T01:25:48.456ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2151 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 6fdd3a58-1427-4d4b-84f6-0199168f3467 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
109512025-03-01T01:25:49.477ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 2584bfd2-e283-4e3b-b507-cc3f34f4bba5 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
109522025-03-01T01:25:49.477ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 2584bfd2-e283-4e3b-b507-cc3f34f4bba5 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
109532025-03-01T01:25:49.479ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2105 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 2584bfd2-e283-4e3b-b507-cc3f34f4bba5 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
109542025-03-01T01:25:50.499ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c82bb3ec-ff19-4143-a537-bcc269ab5719 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
109552025-03-01T01:25:50.499ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c82bb3ec-ff19-4143-a537-bcc269ab5719 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
109562025-03-01T01:25:50.501ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2432 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c82bb3ec-ff19-4143-a537-bcc269ab5719 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
109572025-03-01T01:25:51.520ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = ba7fa271-5cb3-463c-ace8-f74f50cd21ba roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
109582025-03-01T01:25:51.520ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = ba7fa271-5cb3-463c-ace8-f74f50cd21ba resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
109592025-03-01T01:25:51.522ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2403 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = ba7fa271-5cb3-463c-ace8-f74f50cd21ba response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
109602025-03-01T01:25:52.543ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 4e6a8638-d237-4a64-b8e8-d41fb256f349 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
109612025-03-01T01:25:52.543ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 4e6a8638-d237-4a64-b8e8-d41fb256f349 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
109622025-03-01T01:25:52.545ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1810 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 4e6a8638-d237-4a64-b8e8-d41fb256f349 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
109632025-03-01T01:25:53.214ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 23 reason = Timeout
109642025-03-01T01:25:53.214ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
109652025-03-01T01:25:53.214ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 23 reason = Timeout
109662025-03-01T01:25:53.214ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
109672025-03-01T01:25:53.214ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 12 reason = Timeout
109682025-03-01T01:25:53.214ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
109692025-03-01T01:25:53.214ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 23 reason = Timeout
109702025-03-01T01:25:53.214ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
109712025-03-01T01:25:53.214ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
109722025-03-01T01:25:53.214ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 12 reason = Timeout
109732025-03-01T01:25:53.214ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
109742025-03-01T01:25:53.214ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 13 reason = Timeout
109752025-03-01T01:25:53.214ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7
109762025-03-01T01:25:53.214ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 14.37\u{b5}s iteration = 13 status = {"enabled":false,"target_id":"8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7"}
109772025-03-01T01:25:53.214ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 12 reason = Timeout
109782025-03-01T01:25:53.214ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 23 reason = Timeout
109792025-03-01T01:25:53.214ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
109802025-03-01T01:25:53.214ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 23 reason = Timeout
109812025-03-01T01:25:53.214ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 12 reason = Timeout
109822025-03-01T01:25:53.214ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
109832025-03-01T01:25:53.214ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 23 reason = Timeout
109842025-03-01T01:25:53.214ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
109852025-03-01T01:25:53.214ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 23 reason = Timeout
109862025-03-01T01:25:53.214ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 23 reason = Timeout
109872025-03-01T01:25:53.214ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
109882025-03-01T01:25:53.214ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
109892025-03-01T01:25:53.214ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 23 reason = Timeout
109902025-03-01T01:25:53.214ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
109912025-03-01T01:25:53.214ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
109922025-03-01T01:25:53.214ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 23 reason = Timeout
109932025-03-01T01:25:53.214ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
109942025-03-01T01:25:53.214ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 14 reason = Timeout
109952025-03-01T01:25:53.214ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 23 reason = Timeout
109962025-03-01T01:25:53.214ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
109972025-03-01T01:25:53.214ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 23 reason = Timeout
109982025-03-01T01:25:53.214ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
109992025-03-01T01:25:53.214ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
110002025-03-01T01:25:53.214ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 12 reason = Timeout
110012025-03-01T01:25:53.214ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 12 reason = Timeout
110022025-03-01T01:25:53.214ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-03-01 01:15:53.214731240 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
110032025-03-01T01:25:53.214ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 12 reason = Timeout
110042025-03-01T01:25:53.214ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
110052025-03-01T01:25:53.214ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
110062025-03-01T01:25:53.214ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
110072025-03-01T01:25:53.214ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 25 reason = Timeout
110082025-03-01T01:25:53.214ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
110092025-03-01T01:25:53.214ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 67 reason = Timeout
110102025-03-01T01:25:53.214ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
110112025-03-01T01:25:53.214ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 23 reason = Timeout
110122025-03-01T01:25:53.214ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
110132025-03-01T01:25:53.214ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 12 reason = Timeout
110142025-03-01T01:25:53.214ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
110152025-03-01T01:25:53.214ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 14 reason = Timeout
110162025-03-01T01:25:53.214ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 12 reason = Timeout
110172025-03-01T01:25:53.214ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
110182025-03-01T01:25:53.214ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
110192025-03-01T01:25:53.214ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 67 reason = Timeout
110202025-03-01T01:25:53.214ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 23 reason = Timeout
110212025-03-01T01:25:53.214ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
110222025-03-01T01:25:53.215ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
110232025-03-01T01:25:53.215ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 12 reason = Timeout
110242025-03-01T01:25:53.215ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
110252025-03-01T01:25:53.215ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 23 reason = Timeout
110262025-03-01T01:25:53.215ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
110272025-03-01T01:25:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
110282025-03-01T01:25:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
110292025-03-01T01:25:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
110302025-03-01T01:25:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
110312025-03-01T01:25:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
110322025-03-01T01:25:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
110332025-03-01T01:25:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
110342025-03-01T01:25:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
110352025-03-01T01:25:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
110362025-03-01T01:25:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
110372025-03-01T01:25:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
110382025-03-01T01:25:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
110392025-03-01T01:25:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
110402025-03-01T01:25:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
110412025-03-01T01:25:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
110422025-03-01T01:25:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
110432025-03-01T01:25:53.215ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2e37f4af-57dc-468e-80e3-cf2aea2ffdc8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5f6eb3bd-0126-40e0-98ef-ee33df084158.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("5f6eb3bd-0126-40e0-98ef-ee33df084158.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1563, tv_nsec: 903453718 } })
110442025-03-01T01:25:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
110452025-03-01T01:25:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
110462025-03-01T01:25:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
110472025-03-01T01:25:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
110482025-03-01T01:25:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
110492025-03-01T01:25:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
110502025-03-01T01:25:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
110512025-03-01T01:25:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
110522025-03-01T01:25:53.215ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("3a9b8294-d9f3-4130-a669-e74c6f1f65a0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("450e8d93-9ed3-4721-9fe9-42521f60bc93.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a4f72c78-99c6-478d-b490-f7d8793d4173.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("a4f72c78-99c6-478d-b490-f7d8793d4173.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1563, tv_nsec: 903577080 } })
110532025-03-01T01:25:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
110542025-03-01T01:25:53.215ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
110552025-03-01T01:25:53.215ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.209955ms iteration = 12 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
110562025-03-01T01:25:53.216ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
110572025-03-01T01:25:53.216ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.320047ms iteration = 12 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
110582025-03-01T01:25:53.217ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
110592025-03-01T01:25:53.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
110602025-03-01T01:25:53.217ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1563, tv_nsec: 905832636 } })
110612025-03-01T01:25:53.218ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110622025-03-01T01:25:53.218ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1154
110632025-03-01T01:25:53.218ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.644034ms iteration = 23 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
110642025-03-01T01:25:53.219ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 4.520932ms iteration = 23 status = {"errors":[],"finish_invoked_ok":[]}
110652025-03-01T01:25:53.219ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1563, tv_nsec: 907985940 } })
110662025-03-01T01:25:53.220ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1154
110672025-03-01T01:25:53.220ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
110682025-03-01T01:25:53.220ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
110692025-03-01T01:25:53.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
110702025-03-01T01:25:53.223ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 8.605915ms iteration = 12 status = {"errors":[],"found_port_ok":[]}
110712025-03-01T01:25:53.228ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
110722025-03-01T01:25:53.228ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
110732025-03-01T01:25:53.230ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-03-01 01:15:53.214731240 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
110742025-03-01T01:25:53.230ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 15.573247ms iteration = 12 status = {"expiration":"2025-03-01T01:15:53.214731240Z","pruned":[]}
110752025-03-01T01:25:53.269ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
110762025-03-01T01:25:53.269ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
110772025-03-01T01:25:53.270ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110782025-03-01T01:25:53.272ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 57.92883ms iteration = 23 status = {"errors":[],"garbage_collect_requested":[]}
110792025-03-01T01:25:53.272ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
110802025-03-01T01:25:53.272ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
110812025-03-01T01:25:53.273ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110822025-03-01T01:25:53.273ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
110832025-03-01T01:25:53.273ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110842025-03-01T01:25:53.274ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
110852025-03-01T01:25:53.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
110862025-03-01T01:25:53.274ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
110872025-03-01T01:25:53.274ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
110882025-03-01T01:25:53.274ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
110892025-03-01T01:25:53.274ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110902025-03-01T01:25:53.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
110912025-03-01T01:25:53.275ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
110922025-03-01T01:25:53.276ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
110932025-03-01T01:25:53.276ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
110942025-03-01T01:25:53.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
110952025-03-01T01:25:53.276ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
110962025-03-01T01:25:53.276ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
110972025-03-01T01:25:53.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
110982025-03-01T01:25:53.276ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
110992025-03-01T01:25:53.276ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
111002025-03-01T01:25:53.276ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 61.83565ms iteration = 12 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
111012025-03-01T01:25:53.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
111022025-03-01T01:25:53.276ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111032025-03-01T01:25:53.277ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111042025-03-01T01:25:53.278ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111052025-03-01T01:25:53.278ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
111062025-03-01T01:25:53.279ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
111072025-03-01T01:25:53.279ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
111082025-03-01T01:25:53.279ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
111092025-03-01T01:25:53.280ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111102025-03-01T01:25:53.280ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
111112025-03-01T01:25:53.280ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
111122025-03-01T01:25:53.280ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
111132025-03-01T01:25:53.280ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
111142025-03-01T01:25:53.280ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
111152025-03-01T01:25:53.280ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
111162025-03-01T01:25:53.281ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111172025-03-01T01:25:53.281ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111182025-03-01T01:25:53.282ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
111192025-03-01T01:25:53.282ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
111202025-03-01T01:25:53.282ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
111212025-03-01T01:25:53.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
111222025-03-01T01:25:53.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
111232025-03-01T01:25:53.284ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
111242025-03-01T01:25:53.284ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
111252025-03-01T01:25:53.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
111262025-03-01T01:25:53.284ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
111272025-03-01T01:25:53.285ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111282025-03-01T01:25:53.286ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
111292025-03-01T01:25:53.287ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
111302025-03-01T01:25:53.287ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
111312025-03-01T01:25:53.288ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1563, tv_nsec: 976469215 } })
111322025-03-01T01:25:53.288ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1154 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66
111332025-03-01T01:25:53.289ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
111342025-03-01T01:25:53.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
111352025-03-01T01:25:53.290ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
111362025-03-01T01:25:53.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
111372025-03-01T01:25:53.290ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
111382025-03-01T01:25:53.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
111392025-03-01T01:25:53.291ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111402025-03-01T01:25:53.291ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
111412025-03-01T01:25:53.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
111422025-03-01T01:25:53.292ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111432025-03-01T01:25:53.293ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111442025-03-01T01:25:53.294ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
111452025-03-01T01:25:53.294ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
111462025-03-01T01:25:53.295ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
111472025-03-01T01:25:53.295ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
111482025-03-01T01:25:53.295ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
111492025-03-01T01:25:53.295ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
111502025-03-01T01:25:53.297ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7, lookup_type: ById(8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7) } result = Ok(())
111512025-03-01T01:25:53.297ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
111522025-03-01T01:25:53.297ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
111532025-03-01T01:25:53.313ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
111542025-03-01T01:25:53.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
111552025-03-01T01:25:53.317ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 original_time_created = 2025-03-01 01:14:50.436545 UTC target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 time_created = 2025-03-01 01:14:50.436545 UTC
111562025-03-01T01:25:53.317ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 102.58457ms iteration = 67 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7","time_created":"2025-03-01T01:14:50.436545Z"}
111572025-03-01T01:25:53.319ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
111582025-03-01T01:25:53.319ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
111592025-03-01T01:25:53.319ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
111602025-03-01T01:25:53.319ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
111612025-03-01T01:25:53.319ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
111622025-03-01T01:25:53.320ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 105.489189ms iteration = 23 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
111632025-03-01T01:25:53.321ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111642025-03-01T01:25:53.321ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
111652025-03-01T01:25:53.321ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
111662025-03-01T01:25:53.324ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111672025-03-01T01:25:53.325ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
111682025-03-01T01:25:53.325ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
111692025-03-01T01:25:53.325ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
111702025-03-01T01:25:53.325ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
111712025-03-01T01:25:53.325ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
111722025-03-01T01:25:53.325ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
111732025-03-01T01:25:53.325ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
111742025-03-01T01:25:53.325ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
111752025-03-01T01:25:53.325ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
111762025-03-01T01:25:53.326ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
111772025-03-01T01:25:53.326ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
111782025-03-01T01:25:53.326ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
111792025-03-01T01:25:53.327ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 3471264f-127e-4a25-bc10-2e8249e8d70a, lookup_type: ById(3471264f-127e-4a25-bc10-2e8249e8d70a) } result = Ok(())
111802025-03-01T01:25:53.327ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
111812025-03-01T01:25:53.327ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
111822025-03-01T01:25:53.329ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111832025-03-01T01:25:53.331ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
111842025-03-01T01:25:53.331ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 0a9e4b5c-53a1-4f0a-8849-98a8b1852af3 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
111852025-03-01T01:25:53.331ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
111862025-03-01T01:25:53.331ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
111872025-03-01T01:25:53.331ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
111882025-03-01T01:25:53.332ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
111892025-03-01T01:25:53.332ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
111902025-03-01T01:25:53.332ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
111912025-03-01T01:25:53.332ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 117.533745ms iteration = 12 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
111922025-03-01T01:25:53.332ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
111932025-03-01T01:25:53.332ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
111942025-03-01T01:25:53.332ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111952025-03-01T01:25:53.332ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
111962025-03-01T01:25:53.332ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 118.520934ms iteration = 23 status = 0
111972025-03-01T01:25:53.334ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
111982025-03-01T01:25:53.334ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
111992025-03-01T01:25:53.334ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
112002025-03-01T01:25:53.334ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
112012025-03-01T01:25:53.336ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
112022025-03-01T01:25:53.336ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
112032025-03-01T01:25:53.336ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
112042025-03-01T01:25:53.338ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
112052025-03-01T01:25:53.338ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
112062025-03-01T01:25:53.340ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112072025-03-01T01:25:53.340ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 0a9e4b5c-53a1-4f0a-8849-98a8b1852af3 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
112082025-03-01T01:25:53.340ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
112092025-03-01T01:25:53.340ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-03-01 01:14:53.460216 UTC dns_group = internal generation = 1
112102025-03-01T01:25:53.340ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 125.604779ms iteration = 12 status = {"generation":1}
112112025-03-01T01:25:53.342ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
112122025-03-01T01:25:53.342ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
112132025-03-01T01:25:53.342ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
112142025-03-01T01:25:53.342ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 127.985007ms iteration = 23 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
112152025-03-01T01:25:53.347ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 132.621642ms iteration = 67 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
112162025-03-01T01:25:53.356ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
112172025-03-01T01:25:53.356ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
112182025-03-01T01:25:53.357ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c624ff2f-d6d1-4409-a56e-b88c9258849e", "content-length": "26", "date": "Sat, 01 Mar 2025 01:25:53 GMT"} })
112192025-03-01T01:25:53.357ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
112202025-03-01T01:25:53.359ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
112212025-03-01T01:25:53.361ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
112222025-03-01T01:25:53.382ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112232025-03-01T01:25:53.387ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
112242025-03-01T01:25:53.387ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
112252025-03-01T01:25:53.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
112262025-03-01T01:25:53.391ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
112272025-03-01T01:25:53.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
112282025-03-01T01:25:53.394ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
112292025-03-01T01:25:53.394ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
112302025-03-01T01:25:53.394ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 179.746391ms iteration = 23 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
112312025-03-01T01:25:53.398ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
112322025-03-01T01:25:53.398ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 183.654551ms iteration = 23 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
112332025-03-01T01:25:53.400ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
112342025-03-01T01:25:53.400ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 185.796084ms iteration = 23 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
112352025-03-01T01:25:53.409ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-03-01T01:14:49.537343Z, time_modified: 2025-03-01T01:14:49.537343Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 1682a303-6254-452b-b4cf-160ed9dc3fc9, db_silo: Silo { identity: SiloIdentity { id: 1682a303-6254-452b-b4cf-160ed9dc3fc9, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-03-01T01:14:54.631650Z, time_modified: 2025-03-01T01:14:54.631650Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "851c0b739689cfb98a2e401e6047fa98e9fcc283d9fc3f660bd69842a9c06be9" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 1682a303-6254-452b-b4cf-160ed9dc3fc9, db_silo: Silo { identity: SiloIdentity { id: 1682a303-6254-452b-b4cf-160ed9dc3fc9, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-03-01T01:14:54.631650Z, time_modified: 2025-03-01T01:14:54.631650Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "851c0b739689cfb98a2e401e6047fa98e9fcc283d9fc3f660bd69842a9c06be9" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
112362025-03-01T01:25:53.409ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 194.484972ms iteration = 12 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"1682a303-6254-452b-b4cf-160ed9dc3fc9","tls_certs":["851c0b739689cfb98a2e401e6047fa98e9fcc283d9fc3f660bd69842a9c06be9"]}},"default_endpoint":{"silo_id":"1682a303-6254-452b-b4cf-160ed9dc3fc9","tls_certs":["851c0b739689cfb98a2e401e6047fa98e9fcc283d9fc3f660bd69842a9c06be9"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
112372025-03-01T01:25:53.469ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
112382025-03-01T01:25:53.469ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = cce65e3e-6c86-4cdd-98ad-9a38c98082e8 dns_zone_name = oxide.test found_so_far = 0 version = 2
112392025-03-01T01:25:53.469ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
112402025-03-01T01:25:53.469ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
112412025-03-01T01:25:53.471ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
112422025-03-01T01:25:53.471ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
112432025-03-01T01:25:53.471ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112442025-03-01T01:25:53.471ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "970d47f2-93ad-4218-9d59-c83837832b98", "content-length": "26", "date": "Sat, 01 Mar 2025 01:25:53 GMT"} })
112452025-03-01T01:25:53.471ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
112462025-03-01T01:25:53.476ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
112472025-03-01T01:25:53.476ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
112482025-03-01T01:25:53.476ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
112492025-03-01T01:25:53.479ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = cce65e3e-6c86-4cdd-98ad-9a38c98082e8 dns_zone_name = oxide.test found_so_far = 1 version = 2
112502025-03-01T01:25:53.479ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
112512025-03-01T01:25:53.479ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-03-01 01:14:54.679503 UTC dns_group = external generation = 2
112522025-03-01T01:25:53.479ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 265.199082ms iteration = 12 status = {"generation":2}
112532025-03-01T01:25:53.481ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
112542025-03-01T01:25:53.481ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 267.019709ms iteration = 12 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
112552025-03-01T01:25:53.487ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
112562025-03-01T01:25:53.500ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 285.285231ms iteration = 25 status = {"physical_disks_added":0}
112572025-03-01T01:25:53.563ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1162 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 zone_address = fd00:1122:3344:101::2
112582025-03-01T01:25:53.563ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
112592025-03-01T01:25:53.564ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "52a4bca5-76bf-49b8-b46b-6a7a0c7c3bc6", "content-length": "26", "date": "Sat, 01 Mar 2025 01:25:53 GMT"} })
112602025-03-01T01:25:53.564ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1167 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
112612025-03-01T01:25:53.565ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 4659bebe-5dc9-4833-9fab-0d02cfc01479 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
112622025-03-01T01:25:53.566ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66
112632025-03-01T01:25:53.566ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 4659bebe-5dc9-4833-9fab-0d02cfc01479 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
112642025-03-01T01:25:53.569ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3856 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 4659bebe-5dc9-4833-9fab-0d02cfc01479 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
112652025-03-01T01:25:53.577ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
112662025-03-01T01:25:53.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
112672025-03-01T01:25:53.578ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
112682025-03-01T01:25:53.578ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "7013b39e-cdbf-4487-9e3b-616ee6f0f7c1", "date": "Sat, 01 Mar 2025 01:25:53 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
112692025-03-01T01:25:53.578ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
112702025-03-01T01:25:53.580ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "3b6cf255-5f41-43d6-a086-0c6673b63d66", "date": "Sat, 01 Mar 2025 01:25:53 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
112712025-03-01T01:25:53.580ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
112722025-03-01T01:25:53.581ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
112732025-03-01T01:25:53.581ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 367.21649ms iteration = 14 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
112742025-03-01T01:25:53.605ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
112752025-03-01T01:25:53.606ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "231f62da-830d-4882-8477-5491a1845a3c", "content-length": "2", "date": "Sat, 01 Mar 2025 01:25:52 GMT"} })
112762025-03-01T01:25:53.608ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
112772025-03-01T01:25:53.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
112782025-03-01T01:25:53.611ZDEBGnexus (BackgroundTasks): client request SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = instance_watcher body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vmms/aca99a49-7c59-4a59-af58-b9aed0dbfdb5/state
112792025-03-01T01:25:53.611ZDEBGnexus (BackgroundTasks): client response SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = instance_watcher result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vmms/aca99a49-7c59-4a59-af58-b9aed0dbfdb5/state", status: 200, headers: {"content-type": "application/json", "x-request-id": "a9047163-e6e9-4cdc-b56b-1227384799b7", "content-length": "130", "date": "Sat, 01 Mar 2025 01:25:53 GMT"} })
112802025-03-01T01:25:53.613ZDEBGnexus (BackgroundTasks): updating instance state background_task = instance_watcher instance_id = 569a637e-763e-4e53-a4b5-dc11743374ed sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a state = SledVmmState { vmm_state: VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2025-03-01T01:25:48.296408454Z }, migration_in: None, migration_out: None } vmm_id = aca99a49-7c59-4a59-af58-b9aed0dbfdb5
112812025-03-01T01:25:53.613ZINFOnexus (BackgroundTasks): received new VMM runtime state from sled agent background_task = instance_watcher file = nexus/src/app/instance.rs:2079 instance_id = 569a637e-763e-4e53-a4b5-dc11743374ed migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = aca99a49-7c59-4a59-af58-b9aed0dbfdb5 sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a vmm_id = aca99a49-7c59-4a59-af58-b9aed0dbfdb5 vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2025-03-01T01:25:48.296408454Z }
112822025-03-01T01:25:53.613ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher instance_id = 569a637e-763e-4e53-a4b5-dc11743374ed roles = RoleSet { roles: {} } sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a vmm_id = aca99a49-7c59-4a59-af58-b9aed0dbfdb5
112832025-03-01T01:25:53.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher instance_id = 569a637e-763e-4e53-a4b5-dc11743374ed resource = Database result = Ok(()) sled_id = 3471264f-127e-4a25-bc10-2e8249e8d70a vmm_id = aca99a49-7c59-4a59-af58-b9aed0dbfdb5
112842025-03-01T01:25:53.638ZINFOnexus (BackgroundTasks): VPC route manager sled 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
112852025-03-01T01:25:53.638ZDEBGnexus (BackgroundTasks): client request SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
112862025-03-01T01:25:53.639ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 425.003657ms iteration = 23 status = {}
112872025-03-01T01:25:53.640ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112882025-03-01T01:25:53.641ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 427.0898ms iteration = 23 status = null
112892025-03-01T01:25:53.643ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
112902025-03-01T01:25:53.643ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
112912025-03-01T01:25:53.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
112922025-03-01T01:25:53.645ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
112932025-03-01T01:25:53.674ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 1 total_failed = 0 total_incomplete = 0 total_instances = 1 update_sagas_queued = 0
112942025-03-01T01:25:53.676ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 461.770096ms iteration = 23 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{"running":1},"pruned_instances":0,"total_instances":1,"update_sagas_queued":0}
112952025-03-01T01:25:53.678ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112962025-03-01T01:25:53.681ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
112972025-03-01T01:25:53.681ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
112982025-03-01T01:25:53.681ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
112992025-03-01T01:25:53.695ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
113002025-03-01T01:25:53.695ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "f3787f97-d8a3-426b-8948-29e6f977211a", "date": "Sat, 01 Mar 2025 01:25:53 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
113012025-03-01T01:25:53.695ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
113022025-03-01T01:25:53.697ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "5dd4d0f1-78c0-4718-899e-9b659abea647", "date": "Sat, 01 Mar 2025 01:25:53 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
113032025-03-01T01:25:53.697ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
113042025-03-01T01:25:53.699ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "714030ff-9917-4576-93d3-610928a973a4", "date": "Sat, 01 Mar 2025 01:25:53 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
113052025-03-01T01:25:53.699ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
113062025-03-01T01:25:53.702ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
113072025-03-01T01:25:53.702ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 487.315018ms iteration = 14 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
113082025-03-01T01:25:53.751ZDEBGnexus (BackgroundTasks): client response SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "9dfebc7f-575c-44e8-a405-168d80a0acf3", "content-length": "583", "date": "Sat, 01 Mar 2025 01:25:53 GMT"} })
113092025-03-01T01:25:53.751ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
113102025-03-01T01:25:53.752ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
113112025-03-01T01:25:53.754ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
113122025-03-01T01:25:53.755ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
113132025-03-01T01:25:53.757ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 7f9c3c14-58c5-473f-8692-6376be44401e, rack_id: 4854cb88-dfba-4609-8f9d-72aac08cef66, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(cb10d0c6-a704-4231-b148-4f9ae21a03f8) } rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 switch_location = Switch0
113142025-03-01T01:25:53.757ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
113152025-03-01T01:25:53.757ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
113162025-03-01T01:25:53.770ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
113172025-03-01T01:25:53.771ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "820044ee-57e3-45b7-be49-a2239b4f5034", "content-length": "134", "date": "Sat, 01 Mar 2025 01:25:52 GMT"} })
113182025-03-01T01:25:53.771ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
113192025-03-01T01:25:53.771ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = cb10d0c6-a704-4231-b148-4f9ae21a03f8
113202025-03-01T01:25:53.771ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
113212025-03-01T01:25:53.771ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
113222025-03-01T01:25:53.771ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
113232025-03-01T01:25:53.771ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
113242025-03-01T01:25:53.771ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
113252025-03-01T01:25:53.771ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
113262025-03-01T01:25:53.771ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
113272025-03-01T01:25:53.771ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
113282025-03-01T01:25:53.772ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66
113292025-03-01T01:25:53.772ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
113302025-03-01T01:25:53.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
113312025-03-01T01:25:53.782ZDEBGnexus (BackgroundTasks): client request SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
113322025-03-01T01:25:53.782ZDEBGnexus (BackgroundTasks): client response SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "d5b59357-e71c-4ef1-bf45-cb68ab81c415", "content-length": "810", "date": "Sat, 01 Mar 2025 01:25:53 GMT"} })
113332025-03-01T01:25:53.783ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {VirtualNetworkInterfaceHost { physical_host_ip: fd00:1122:3344:101::1, virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), vni: Vni(1136230) }} sled = sock
113342025-03-01T01:25:53.783ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
113352025-03-01T01:25:53.783ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
113362025-03-01T01:25:53.784ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 569.448369ms iteration = 23 status = {}
113372025-03-01T01:25:53.785ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
113382025-03-01T01:25:53.785ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "c224b5b8-b34b-4d48-be3e-bc7904855edb", "content-length": "2", "date": "Sat, 01 Mar 2025 01:25:52 GMT"} })
113392025-03-01T01:25:53.785ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
113402025-03-01T01:25:53.785ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "d5a5ded6-f827-4201-8d56-e15df6c3b4ea", "content-length": "52", "date": "Sat, 01 Mar 2025 01:25:52 GMT"} })
113412025-03-01T01:25:53.785ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 switch_location = Switch0
113422025-03-01T01:25:53.785ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
113432025-03-01T01:25:53.797ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {744f1975-fb15-4ab9-ae36-db6df43c1b80: {10.151.2.176: {dd673e83-bb28-43b4-80dc-cd65cf150392}, 10.151.2.175: {dd673e83-bb28-43b4-80dc-cd65cf150392}}} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
113442025-03-01T01:25:53.797ZDEBGnexus (BackgroundTasks): client request SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
113452025-03-01T01:25:53.902ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "f9e7655b-09ec-4a36-bbb4-f1de47317cd8", "date": "Sat, 01 Mar 2025 01:25:53 GMT"} })
113462025-03-01T01:25:53.902ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 switch = Switch0
113472025-03-01T01:25:53.902ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
113482025-03-01T01:25:53.902ZDEBGnexus (BackgroundTasks): client response SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "4996c0b2-4285-47d7-b08e-13086d71b054", "date": "Sat, 01 Mar 2025 01:25:53 GMT"} })
113492025-03-01T01:25:53.902ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
113502025-03-01T01:25:53.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
113512025-03-01T01:25:53.903ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "5c2c998c-35d6-47cc-b53a-72819613b0ea", "content-length": "682", "date": "Sat, 01 Mar 2025 01:25:53 GMT"} })
113522025-03-01T01:25:53.903ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
113532025-03-01T01:25:53.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
113542025-03-01T01:25:53.906ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
113552025-03-01T01:25:53.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
113562025-03-01T01:25:53.907ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
113572025-03-01T01:25:53.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
113582025-03-01T01:25:53.909ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
113592025-03-01T01:25:53.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
113602025-03-01T01:25:53.911ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
113612025-03-01T01:25:53.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
113622025-03-01T01:25:53.912ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
113632025-03-01T01:25:53.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
113642025-03-01T01:25:53.913ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
113652025-03-01T01:25:53.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
113662025-03-01T01:25:53.915ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
113672025-03-01T01:25:53.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
113682025-03-01T01:25:53.918ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
113692025-03-01T01:25:53.918ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
113702025-03-01T01:25:53.920ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 705.92321ms iteration = 23 status = {}
113712025-03-01T01:25:53.922ZINFOnexus (BackgroundTasks): VPC route manager sled 3471264f-127e-4a25-bc10-2e8249e8d70a push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
113722025-03-01T01:25:53.922ZINFOnexus (BackgroundTasks): VPC route manager sled 3471264f-127e-4a25-bc10-2e8249e8d70a push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
113732025-03-01T01:25:53.922ZDEBGnexus (BackgroundTasks): client request SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
113742025-03-01T01:25:53.922ZDEBGnexus (BackgroundTasks): client response SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "3e31bd3c-5ac6-45b2-9b08-b0cd6933f2e0", "date": "Sat, 01 Mar 2025 01:25:53 GMT"} })
113752025-03-01T01:25:53.924ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 709.390341ms iteration = 23 status = {}
113762025-03-01T01:25:54.059ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
113772025-03-01T01:25:54.059ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
113782025-03-01T01:25:54.089ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
113792025-03-01T01:25:54.089ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:45972
113802025-03-01T01:25:54.090ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:45972 req_id = cdf8f548-aae3-44c1-b092-a271a6fd315a roles = RoleSet { roles: {} } uri = /metrics/producers
113812025-03-01T01:25:54.090ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:45972 req_id = cdf8f548-aae3-44c1-b092-a271a6fd315a resource = Database result = Ok(()) uri = /metrics/producers
113822025-03-01T01:25:54.132ZINFOnexus: assigned collector to new producer collector_id = d77aa5d6-e6f9-4845-b1d4-57f91a3621e6 file = nexus/src/app/oximeter.rs:76 producer_id = 67b03f4e-4cbd-4843-9cd9-647f610abcfc
113832025-03-01T01:25:54.132ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 42229 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:45972 req_id = cdf8f548-aae3-44c1-b092-a271a6fd315a response_code = 201 uri = /metrics/producers
113842025-03-01T01:25:54.132ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "cdf8f548-aae3-44c1-b092-a271a6fd315a", "content-length": "41", "date": "Sat, 01 Mar 2025 01:25:54 GMT"} })
113852025-03-01T01:25:54.134ZDEBGnexus (producer-registration-task): registered with nexus successfully
113862025-03-01T01:25:54.134ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
113872025-03-01T01:25:54.591ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 99d47ce6-6095-48f9-9c36-c88c3c447660 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
113882025-03-01T01:25:54.591ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 99d47ce6-6095-48f9-9c36-c88c3c447660 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
113892025-03-01T01:25:54.594ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2774 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 99d47ce6-6095-48f9-9c36-c88c3c447660 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
113902025-03-01T01:25:55.614ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = a1d07186-0c71-4dd1-9327-0be2d6026265 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
113912025-03-01T01:25:55.615ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = a1d07186-0c71-4dd1-9327-0be2d6026265 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
113922025-03-01T01:25:55.616ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2281 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = a1d07186-0c71-4dd1-9327-0be2d6026265 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
113932025-03-01T01:25:56.636ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = df90aa4c-1440-415a-a7e7-736090e95da3 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
113942025-03-01T01:25:56.636ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = df90aa4c-1440-415a-a7e7-736090e95da3 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
113952025-03-01T01:25:56.638ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2046 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = df90aa4c-1440-415a-a7e7-736090e95da3 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
113962025-03-01T01:25:57.419ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 5344 local_addr = [fd00:1122:3344:101::c]:34357 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = d446b6d8-b9c7-4aac-b4a5-c480128c42c5 response_code = 200 uri = /67b03f4e-4cbd-4843-9cd9-647f610abcfc
113972025-03-01T01:25:57.658ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 511b5196-3c7e-47e6-8318-2e3e11ae51d8 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
113982025-03-01T01:25:57.658ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 511b5196-3c7e-47e6-8318-2e3e11ae51d8 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
113992025-03-01T01:25:57.660ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2291 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 511b5196-3c7e-47e6-8318-2e3e11ae51d8 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
114002025-03-01T01:25:58.012ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2079 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = aca99a49-7c59-4a59-af58-b9aed0dbfdb5 remote_addr = [fd00:1122:3344:101::1]:43446 req_id = dce850cd-d321-43b0-83b2-81a2d2f2538e uri = /vmms/aca99a49-7c59-4a59-af58-b9aed0dbfdb5 vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2025-03-01T01:25:58.012335718Z }
114012025-03-01T01:25:58.012ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43446 req_id = dce850cd-d321-43b0-83b2-81a2d2f2538e roles = RoleSet { roles: {} } uri = /vmms/aca99a49-7c59-4a59-af58-b9aed0dbfdb5
114022025-03-01T01:25:58.013ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43446 req_id = dce850cd-d321-43b0-83b2-81a2d2f2538e resource = Database result = Ok(()) uri = /vmms/aca99a49-7c59-4a59-af58-b9aed0dbfdb5
114032025-03-01T01:25:58.051ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 38743 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43446 req_id = dce850cd-d321-43b0-83b2-81a2d2f2538e response_code = 204 uri = /vmms/aca99a49-7c59-4a59-af58-b9aed0dbfdb5
114042025-03-01T01:25:58.681ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 749d4719-a939-4d48-8c01-9dd2c9afc517 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
114052025-03-01T01:25:58.682ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 749d4719-a939-4d48-8c01-9dd2c9afc517 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
114062025-03-01T01:25:58.684ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2426 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 749d4719-a939-4d48-8c01-9dd2c9afc517 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
114072025-03-01T01:25:59.704ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 7950226e-8ced-48ea-be3f-4183c400c556 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
114082025-03-01T01:25:59.704ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 7950226e-8ced-48ea-be3f-4183c400c556 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
114092025-03-01T01:25:59.705ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1830 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 7950226e-8ced-48ea-be3f-4183c400c556 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
114102025-03-01T01:26:00.481ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2079 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = aca99a49-7c59-4a59-af58-b9aed0dbfdb5 remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c080f549-8921-4032-8a4a-77de27407bdb uri = /vmms/aca99a49-7c59-4a59-af58-b9aed0dbfdb5 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2025-03-01T01:26:00.480923353Z }
114112025-03-01T01:26:00.481ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c080f549-8921-4032-8a4a-77de27407bdb roles = RoleSet { roles: {} } uri = /vmms/aca99a49-7c59-4a59-af58-b9aed0dbfdb5
114122025-03-01T01:26:00.481ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c080f549-8921-4032-8a4a-77de27407bdb resource = Database result = Ok(()) uri = /vmms/aca99a49-7c59-4a59-af58-b9aed0dbfdb5
114132025-03-01T01:26:00.515ZDEBGnexus (dropshot_internal): new VMM runtime state from sled agent requires an instance-update saga actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_in_needs_update = false migration_out_needs_update = false propolis_id = aca99a49-7c59-4a59-af58-b9aed0dbfdb5 remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c080f549-8921-4032-8a4a-77de27407bdb uri = /vmms/aca99a49-7c59-4a59-af58-b9aed0dbfdb5 vmm_needs_update = true
114142025-03-01T01:26:00.519ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c080f549-8921-4032-8a4a-77de27407bdb roles = RoleSet { roles: {} } uri = /vmms/aca99a49-7c59-4a59-af58-b9aed0dbfdb5
114152025-03-01T01:26:00.519ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c080f549-8921-4032-8a4a-77de27407bdb resource = Database result = Ok(()) uri = /vmms/aca99a49-7c59-4a59-af58-b9aed0dbfdb5
114162025-03-01T01:26:00.524ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c080f549-8921-4032-8a4a-77de27407bdb roles = RoleSet { roles: {} } uri = /vmms/aca99a49-7c59-4a59-af58-b9aed0dbfdb5
114172025-03-01T01:26:00.524ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c080f549-8921-4032-8a4a-77de27407bdb resource = Database result = Ok(()) uri = /vmms/aca99a49-7c59-4a59-af58-b9aed0dbfdb5
114182025-03-01T01:26:00.526ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c080f549-8921-4032-8a4a-77de27407bdb roles = RoleSet { roles: {} } uri = /vmms/aca99a49-7c59-4a59-af58-b9aed0dbfdb5
114192025-03-01T01:26:00.526ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c080f549-8921-4032-8a4a-77de27407bdb resource = Database result = Ok(()) uri = /vmms/aca99a49-7c59-4a59-af58-b9aed0dbfdb5
114202025-03-01T01:26:00.529ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c080f549-8921-4032-8a4a-77de27407bdb roles = RoleSet { roles: {} } uri = /vmms/aca99a49-7c59-4a59-af58-b9aed0dbfdb5
114212025-03-01T01:26:00.529ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c080f549-8921-4032-8a4a-77de27407bdb resource = Database result = Ok(()) uri = /vmms/aca99a49-7c59-4a59-af58-b9aed0dbfdb5
114222025-03-01T01:26:00.531ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c080f549-8921-4032-8a4a-77de27407bdb roles = RoleSet { roles: {} } uri = /vmms/aca99a49-7c59-4a59-af58-b9aed0dbfdb5
114232025-03-01T01:26:00.531ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c080f549-8921-4032-8a4a-77de27407bdb resource = Database result = Ok(()) uri = /vmms/aca99a49-7c59-4a59-af58-b9aed0dbfdb5
114242025-03-01T01:26:00.532ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c080f549-8921-4032-8a4a-77de27407bdb roles = RoleSet { roles: {} } uri = /vmms/aca99a49-7c59-4a59-af58-b9aed0dbfdb5
114252025-03-01T01:26:00.532ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c080f549-8921-4032-8a4a-77de27407bdb resource = Database result = Ok(()) uri = /vmms/aca99a49-7c59-4a59-af58-b9aed0dbfdb5
114262025-03-01T01:26:00.534ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c080f549-8921-4032-8a4a-77de27407bdb roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /vmms/aca99a49-7c59-4a59-af58-b9aed0dbfdb5
114272025-03-01T01:26:00.539ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c080f549-8921-4032-8a4a-77de27407bdb resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 1682a303-6254-452b-b4cf-160ed9dc3fc9, lookup_type: ById(1682a303-6254-452b-b4cf-160ed9dc3fc9) }, key: bddca329-6d2c-43a5-8d39-c2dade19860c, lookup_type: ById(bddca329-6d2c-43a5-8d39-c2dade19860c) }, key: 569a637e-763e-4e53-a4b5-dc11743374ed, lookup_type: ById(569a637e-763e-4e53-a4b5-dc11743374ed) } result = Ok(()) uri = /vmms/aca99a49-7c59-4a59-af58-b9aed0dbfdb5
114282025-03-01T01:26:00.546ZINFOnexus (dropshot_internal): starting update saga for 569a637e-763e-4e53-a4b5-dc11743374ed actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1545 instance_id = 569a637e-763e-4e53-a4b5-dc11743374ed local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c080f549-8921-4032-8a4a-77de27407bdb uri = /vmms/aca99a49-7c59-4a59-af58-b9aed0dbfdb5 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2025-03-01T01:26:00.480923353Z }
114292025-03-01T01:26:00.549ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 68013 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c080f549-8921-4032-8a4a-77de27407bdb response_code = 204 uri = /vmms/aca99a49-7c59-4a59-af58-b9aed0dbfdb5
114302025-03-01T01:26:00.549ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2079 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = aca99a49-7c59-4a59-af58-b9aed0dbfdb5 remote_addr = [fd00:1122:3344:101::1]:43446 req_id = cd2bb6ac-3e48-4b41-97c6-1359a301878c uri = /vmms/aca99a49-7c59-4a59-af58-b9aed0dbfdb5 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2025-03-01T01:26:00.480923353Z }
114312025-03-01T01:26:00.549ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43446 req_id = cd2bb6ac-3e48-4b41-97c6-1359a301878c roles = RoleSet { roles: {} } uri = /vmms/aca99a49-7c59-4a59-af58-b9aed0dbfdb5
114322025-03-01T01:26:00.549ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43446 req_id = cd2bb6ac-3e48-4b41-97c6-1359a301878c resource = Database result = Ok(()) uri = /vmms/aca99a49-7c59-4a59-af58-b9aed0dbfdb5
114332025-03-01T01:26:00.551ZDEBGnexus (dropshot_internal): preparing instance-update saga for 569a637e-763e-4e53-a4b5-dc11743374ed... actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = 569a637e-763e-4e53-a4b5-dc11743374ed local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c080f549-8921-4032-8a4a-77de27407bdb uri = /vmms/aca99a49-7c59-4a59-af58-b9aed0dbfdb5
114342025-03-01T01:26:00.551ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = 065c0fec-1bf1-48d3-93bb-27b0b75caed8 saga_name = start-instance-update
114352025-03-01T01:26:00.558ZINFOnexus (SEC): saga create dag = {"end_node":4,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[3,0,null],[2,4,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"start_instance_update.lock_instance","label":"LockInstance","name":"updater_lock"}},{"Action":{"action_name":"start_instance_update.fetch_state_and_start_real_saga","label":"FetchStateAndStartRealSaga","name":"state"}},{"Start":{"params":{"authz_instance":{"key":"569a637e-763e-4e53-a4b5-dc11743374ed","lookup_type":{"ById":"569a637e-763e-4e53-a4b5-dc11743374ed"},"parent":{"key":"bddca329-6d2c-43a5-8d39-c2dade19860c","lookup_type":{"ById":"bddca329-6d2c-43a5-8d39-c2dade19860c"},"parent":{"key":"1682a303-6254-452b-b4cf-160ed9dc3fc9","lookup_type":{"ById":"1682a303-6254-452b-b4cf-160ed9dc3fc9"},"parent":null}}},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}}}}},"End"]},"saga_name":"start-instance-update","start_node":3} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = 065c0fec-1bf1-48d3-93bb-27b0b75caed8 saga_name = start-instance-update sec_id = 67b03f4e-4cbd-4843-9cd9-647f610abcfc
114362025-03-01T01:26:00.558ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 065c0fec-1bf1-48d3-93bb-27b0b75caed8 saga_name = start-instance-update
114372025-03-01T01:26:00.583ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 33745 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43446 req_id = cd2bb6ac-3e48-4b41-97c6-1359a301878c response_code = 204 uri = /vmms/aca99a49-7c59-4a59-af58-b9aed0dbfdb5
114382025-03-01T01:26:00.598ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = 065c0fec-1bf1-48d3-93bb-27b0b75caed8 saga_name = start-instance-update
114392025-03-01T01:26:00.598ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = 065c0fec-1bf1-48d3-93bb-27b0b75caed8 saga_name = start-instance-update sec_id = 67b03f4e-4cbd-4843-9cd9-647f610abcfc
114402025-03-01T01:26:00.598ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 67b03f4e-4cbd-4843-9cd9-647f610abcfc
114412025-03-01T01:26:00.598ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 065c0fec-1bf1-48d3-93bb-27b0b75caed8
114422025-03-01T01:26:00.607ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 67b03f4e-4cbd-4843-9cd9-647f610abcfc
114432025-03-01T01:26:00.607ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = 065c0fec-1bf1-48d3-93bb-27b0b75caed8
114442025-03-01T01:26:00.613ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 67b03f4e-4cbd-4843-9cd9-647f610abcfc
114452025-03-01T01:26:00.613ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 065c0fec-1bf1-48d3-93bb-27b0b75caed8
114462025-03-01T01:26:00.619ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 67b03f4e-4cbd-4843-9cd9-647f610abcfc
114472025-03-01T01:26:00.619ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("e2a6f315-ad68-4895-a729-9c79a8d3bfca")) node_id = 0 saga_id = 065c0fec-1bf1-48d3-93bb-27b0b75caed8
114482025-03-01T01:26:00.623ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 67b03f4e-4cbd-4843-9cd9-647f610abcfc
114492025-03-01T01:26:00.623ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 065c0fec-1bf1-48d3-93bb-27b0b75caed8
114502025-03-01T01:26:00.636ZINFOnexus (SagaExecutor): instance update: attempting to lock instance file = nexus/src/app/sagas/instance_update/start.rs:93 instance_id = 569a637e-763e-4e53-a4b5-dc11743374ed saga_id = 065c0fec-1bf1-48d3-93bb-27b0b75caed8 saga_name = start-instance-update
114512025-03-01T01:26:00.636ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 065c0fec-1bf1-48d3-93bb-27b0b75caed8 saga_name = start-instance-update saga_node = LockInstance
114522025-03-01T01:26:00.636ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 065c0fec-1bf1-48d3-93bb-27b0b75caed8 saga_name = start-instance-update saga_node = LockInstance
114532025-03-01T01:26:00.638ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 065c0fec-1bf1-48d3-93bb-27b0b75caed8 saga_name = start-instance-update saga_node = LockInstance
114542025-03-01T01:26:00.638ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 065c0fec-1bf1-48d3-93bb-27b0b75caed8 saga_name = start-instance-update saga_node = LockInstance
114552025-03-01T01:26:00.640ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 065c0fec-1bf1-48d3-93bb-27b0b75caed8 saga_name = start-instance-update saga_node = LockInstance
114562025-03-01T01:26:00.640ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 065c0fec-1bf1-48d3-93bb-27b0b75caed8 saga_name = start-instance-update saga_node = LockInstance
114572025-03-01T01:26:00.642ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 065c0fec-1bf1-48d3-93bb-27b0b75caed8 saga_name = start-instance-update saga_node = LockInstance
114582025-03-01T01:26:00.642ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 065c0fec-1bf1-48d3-93bb-27b0b75caed8 saga_name = start-instance-update saga_node = LockInstance
114592025-03-01T01:26:00.643ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 065c0fec-1bf1-48d3-93bb-27b0b75caed8 saga_name = start-instance-update saga_node = LockInstance
114602025-03-01T01:26:00.643ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 065c0fec-1bf1-48d3-93bb-27b0b75caed8 saga_name = start-instance-update saga_node = LockInstance
114612025-03-01T01:26:00.644ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 065c0fec-1bf1-48d3-93bb-27b0b75caed8 saga_name = start-instance-update saga_node = LockInstance
114622025-03-01T01:26:00.644ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 065c0fec-1bf1-48d3-93bb-27b0b75caed8 saga_name = start-instance-update saga_node = LockInstance
114632025-03-01T01:26:00.646ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 065c0fec-1bf1-48d3-93bb-27b0b75caed8 saga_name = start-instance-update saga_node = LockInstance
114642025-03-01T01:26:00.649ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 1682a303-6254-452b-b4cf-160ed9dc3fc9, lookup_type: ById(1682a303-6254-452b-b4cf-160ed9dc3fc9) }, key: bddca329-6d2c-43a5-8d39-c2dade19860c, lookup_type: ById(bddca329-6d2c-43a5-8d39-c2dade19860c) }, key: 569a637e-763e-4e53-a4b5-dc11743374ed, lookup_type: ById(569a637e-763e-4e53-a4b5-dc11743374ed) } result = Ok(()) saga_id = 065c0fec-1bf1-48d3-93bb-27b0b75caed8 saga_name = start-instance-update saga_node = LockInstance
114652025-03-01T01:26:00.649ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = 569a637e-763e-4e53-a4b5-dc11743374ed saga_id = 065c0fec-1bf1-48d3-93bb-27b0b75caed8 saga_name = start-instance-update saga_node = LockInstance updater_id = e2a6f315-ad68-4895-a729-9c79a8d3bfca
114662025-03-01T01:26:00.649ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 065c0fec-1bf1-48d3-93bb-27b0b75caed8 saga_name = start-instance-update saga_node = LockInstance
114672025-03-01T01:26:00.649ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 065c0fec-1bf1-48d3-93bb-27b0b75caed8 saga_name = start-instance-update saga_node = LockInstance
114682025-03-01T01:26:00.658ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = 569a637e-763e-4e53-a4b5-dc11743374ed saga_id = 065c0fec-1bf1-48d3-93bb-27b0b75caed8 saga_name = start-instance-update saga_node = LockInstance updater_id = e2a6f315-ad68-4895-a729-9c79a8d3bfca
114692025-03-01T01:26:00.658ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 065c0fec-1bf1-48d3-93bb-27b0b75caed8 saga_name = start-instance-update saga_node = LockInstance
114702025-03-01T01:26:00.658ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 065c0fec-1bf1-48d3-93bb-27b0b75caed8 saga_name = start-instance-update saga_node = LockInstance
114712025-03-01T01:26:00.665ZDEBGnexus (SagaExecutor): instance updater lock acquired! actor_id = 001de000-05e4-4000-8000-000000000002 already_locked = true authenticated = true instance_id = 569a637e-763e-4e53-a4b5-dc11743374ed locked_gen = Generation(Generation(2)) saga_id = 065c0fec-1bf1-48d3-93bb-27b0b75caed8 saga_name = start-instance-update saga_node = LockInstance updater_id = e2a6f315-ad68-4895-a729-9c79a8d3bfca
114722025-03-01T01:26:00.665ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 67b03f4e-4cbd-4843-9cd9-647f610abcfc
114732025-03-01T01:26:00.665ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(2), "updater_id": String("e2a6f315-ad68-4895-a729-9c79a8d3bfca")}) node_id = 1 saga_id = 065c0fec-1bf1-48d3-93bb-27b0b75caed8
114742025-03-01T01:26:00.668ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 67b03f4e-4cbd-4843-9cd9-647f610abcfc
114752025-03-01T01:26:00.668ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 065c0fec-1bf1-48d3-93bb-27b0b75caed8
114762025-03-01T01:26:00.675ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 065c0fec-1bf1-48d3-93bb-27b0b75caed8 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
114772025-03-01T01:26:00.675ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 065c0fec-1bf1-48d3-93bb-27b0b75caed8 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
114782025-03-01T01:26:00.677ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 065c0fec-1bf1-48d3-93bb-27b0b75caed8 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
114792025-03-01T01:26:00.677ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 065c0fec-1bf1-48d3-93bb-27b0b75caed8 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
114802025-03-01T01:26:00.678ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 065c0fec-1bf1-48d3-93bb-27b0b75caed8 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
114812025-03-01T01:26:00.678ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 065c0fec-1bf1-48d3-93bb-27b0b75caed8 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
114822025-03-01T01:26:00.680ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 065c0fec-1bf1-48d3-93bb-27b0b75caed8 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
114832025-03-01T01:26:00.683ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 1682a303-6254-452b-b4cf-160ed9dc3fc9, lookup_type: ById(1682a303-6254-452b-b4cf-160ed9dc3fc9) }, key: bddca329-6d2c-43a5-8d39-c2dade19860c, lookup_type: ById(bddca329-6d2c-43a5-8d39-c2dade19860c) }, key: 569a637e-763e-4e53-a4b5-dc11743374ed, lookup_type: ById(569a637e-763e-4e53-a4b5-dc11743374ed) } result = Ok(()) saga_id = 065c0fec-1bf1-48d3-93bb-27b0b75caed8 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
114842025-03-01T01:26:00.683ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 065c0fec-1bf1-48d3-93bb-27b0b75caed8 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
114852025-03-01T01:26:00.683ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 065c0fec-1bf1-48d3-93bb-27b0b75caed8 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
114862025-03-01T01:26:00.690ZINFOnexus (SagaExecutor): instance update: starting real update saga... current.active_vmm = Some(Vmm { id: aca99a49-7c59-4a59-af58-b9aed0dbfdb5, time_created: 2025-03-01T01:25:39.831900Z, time_deleted: None, instance_id: 569a637e-763e-4e53-a4b5-dc11743374ed, sled_id: 3471264f-127e-4a25-bc10-2e8249e8d70a, propolis_ip: V6(Ipv6Network { addr: fd00:1122:3344:101::1:0, prefix: 128 }), propolis_port: SqlU16(12400), runtime: VmmRuntimeState { time_state_updated: 2025-03-01T01:26:00.480923Z, gen: Generation(Generation(8)), state: Destroyed } }) current.migration = None current.runtime_state = InstanceRuntimeState { time_updated: 2025-03-01T01:25:37.916102Z, gen: Generation(Generation(3)), propolis_id: Some(aca99a49-7c59-4a59-af58-b9aed0dbfdb5), dst_propolis_id: None, migration_id: None, nexus_state: Vmm, time_last_auto_restarted: None } current.target_vmm = None file = nexus/src/app/sagas/instance_update/start.rs:180 instance_id = 569a637e-763e-4e53-a4b5-dc11743374ed saga_id = 065c0fec-1bf1-48d3-93bb-27b0b75caed8 saga_name = start-instance-update update.deprovision = true update.destroy_active_vmm = Some(aca99a49-7c59-4a59-af58-b9aed0dbfdb5 (propolis)) update.destroy_target_vmm = None update.network_config_update = Some(Delete) update.new_runtime_state = InstanceRuntimeState { time_updated: 2025-03-01T01:26:00.690882700Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None }
114872025-03-01T01:26:00.697ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = 3cf04295-11fb-4fa6-845e-c6eefaf3ceb7 saga_name = instance-update
114882025-03-01T01:26:00.700ZINFOnexus (SEC): saga create dag = {"end_node":14,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[3,4,null],[4,5,null],[5,6,null],[6,7,null],[7,8,null],[9,10,null],[8,9,null],[10,11,null],[11,12,null],[13,0,null],[12,14,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"instance_update.become_updater","label":"BecomeUpdater","name":"updater_lock"}},{"Constant":{"name":"network_config_update","value":"Delete"}},{"Action":{"action_name":"instance_update.update_network_config","label":"UpdateNetworkConfig","name":"update_network_config"}},{"Action":{"action_name":"instance_update.release_virtual_provisioning","label":"ReleaseVirtualProvisioning","name":"release_virtual_provisioning"}},{"Action":{"action_name":"instance_update.unassign_oximeter_producer","label":"UnassignOximeterProducer","name":"unassign_oximeter_producer"}},{"Action":{"action_name":"instance_update.commit_instance_updates","label":"CommitInstanceUpdates","name":"commit_instance_updates"}},{"Constant":{"name":"destroy_active_vmm_params","value":{"instance_id":"569a637e-763e-4e53-a4b5-dc11743374ed","serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"vmm_id":"aca99a49-7c59-4a59-af58-b9aed0dbfdb5"}}},{"SubsagaStart":{"params_node_name":"destroy_active_vmm_params","saga_name":"destroy_active_vmm"}},{"Action":{"action_name":"destroy_vmm.release_sled_resources","label":"ReleaseSledResources","name":"release_sled_resources"}},{"Action":{"action_name":"destroy_vmm.mark_vmm_deleted","label":"MarkVmmDeleted","name":"mark_vmm_deleted"}},{"SubsagaEnd":{"name":"active_vmm_destroyed"}},{"Action":{"action_name":"instance_update.chain_successor_saga","label":"ChainSuccessorSaga","name":"chain_successor_saga"}},{"Start":{"params":{"authz_instance":{"key":"569a637e-763e-4e53-a4b5-dc11743374ed","lookup_type":{"ById":"569a637e-763e-4e53-a4b5-dc11743374ed"},"parent":{"key":"bddca329-6d2c-43a5-8d39-c2dade19860c","lookup_type":{"ById":"bddca329-6d2c-43a5-8d39-c2dade19860c"},"parent":{"key":"1682a303-6254-452b-b4cf-160ed9dc3fc9","lookup_type":{"ById":"1682a303-6254-452b-b4cf-160ed9dc3fc9"},"parent":null}}},"orig_lock":{"locked_gen":2,"updater_id":"e2a6f315-ad68-4895-a729-9c79a8d3bfca"},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"update":{"deprovision":{"cpus_diff":2,"project_id":"bddca329-6d2c-43a5-8d39-c2dade19860c","ram_diff":1073741824},"destroy_active_vmm":"aca99a49-7c59-4a59-af58-b9aed0dbfdb5","destroy_target_vmm":null,"network_config":"Delete","new_runtime":{"dst_propolis_id":null,"gen":4,"migration_id":null,"nexus_state":"NoVmm","propolis_id":null,"time_last_auto_restarted":null,"time_updated":"2025-03-01T01:26:00.690882700Z"}}}}},"End"]},"saga_name":"instance-update","start_node":13} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = 3cf04295-11fb-4fa6-845e-c6eefaf3ceb7 saga_name = instance-update sec_id = 67b03f4e-4cbd-4843-9cd9-647f610abcfc
114892025-03-01T01:26:00.700ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 3cf04295-11fb-4fa6-845e-c6eefaf3ceb7 saga_name = instance-update
114902025-03-01T01:26:00.704ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = 3cf04295-11fb-4fa6-845e-c6eefaf3ceb7 saga_name = instance-update
114912025-03-01T01:26:00.704ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = 3cf04295-11fb-4fa6-845e-c6eefaf3ceb7 saga_name = instance-update sec_id = 67b03f4e-4cbd-4843-9cd9-647f610abcfc
114922025-03-01T01:26:00.704ZDEBGnexus (SEC): saga log event new_state = N013 started sec_id = 67b03f4e-4cbd-4843-9cd9-647f610abcfc
114932025-03-01T01:26:00.704ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 13 saga_id = 3cf04295-11fb-4fa6-845e-c6eefaf3ceb7
114942025-03-01T01:26:00.708ZDEBGnexus (SEC): saga log event new_state = N013 succeeded sec_id = 67b03f4e-4cbd-4843-9cd9-647f610abcfc
114952025-03-01T01:26:00.708ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 13 saga_id = 3cf04295-11fb-4fa6-845e-c6eefaf3ceb7
114962025-03-01T01:26:00.712ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 67b03f4e-4cbd-4843-9cd9-647f610abcfc
114972025-03-01T01:26:00.712ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 3cf04295-11fb-4fa6-845e-c6eefaf3ceb7
114982025-03-01T01:26:00.715ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 67b03f4e-4cbd-4843-9cd9-647f610abcfc
114992025-03-01T01:26:00.715ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("232942d8-e902-450d-913b-d4caa8177b4b")) node_id = 0 saga_id = 3cf04295-11fb-4fa6-845e-c6eefaf3ceb7
115002025-03-01T01:26:00.718ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 67b03f4e-4cbd-4843-9cd9-647f610abcfc
115012025-03-01T01:26:00.718ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 3cf04295-11fb-4fa6-845e-c6eefaf3ceb7
115022025-03-01T01:26:00.721ZDEBGnexus (SagaExecutor): instance update: trying to become instance updater... instance_id = 569a637e-763e-4e53-a4b5-dc11743374ed parent_lock = UpdaterLock { updater_id: e2a6f315-ad68-4895-a729-9c79a8d3bfca, locked_gen: Generation(Generation(2)) } saga_id = 3cf04295-11fb-4fa6-845e-c6eefaf3ceb7 saga_name = instance-update
115032025-03-01T01:26:00.721ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 3cf04295-11fb-4fa6-845e-c6eefaf3ceb7 saga_name = instance-update saga_node = BecomeUpdater
115042025-03-01T01:26:00.721ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 3cf04295-11fb-4fa6-845e-c6eefaf3ceb7 saga_name = instance-update saga_node = BecomeUpdater
115052025-03-01T01:26:00.725ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c3b7cc1d-b504-4790-aef9-65d4fea8b4cc roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
115062025-03-01T01:26:00.726ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c3b7cc1d-b504-4790-aef9-65d4fea8b4cc resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
115072025-03-01T01:26:00.727ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1844 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c3b7cc1d-b504-4790-aef9-65d4fea8b4cc response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
115082025-03-01T01:26:00.737ZDEBGnexus (SagaExecutor): inherited lock from e2a6f315-ad68-4895-a729-9c79a8d3bfca to 232942d8-e902-450d-913b-d4caa8177b4b actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = 569a637e-763e-4e53-a4b5-dc11743374ed locked_gen = Generation(Generation(3)) parent_gen = Generation(Generation(2)) parent_id = e2a6f315-ad68-4895-a729-9c79a8d3bfca saga_id = 3cf04295-11fb-4fa6-845e-c6eefaf3ceb7 saga_name = instance-update saga_node = BecomeUpdater updater_id = 232942d8-e902-450d-913b-d4caa8177b4b
115092025-03-01T01:26:00.737ZINFOnexus (SagaExecutor): instance_update: Now, I am become Updater, the destroyer of VMMs. file = nexus/src/app/sagas/instance_update/mod.rs:964 instance_id = 569a637e-763e-4e53-a4b5-dc11743374ed saga_id = 3cf04295-11fb-4fa6-845e-c6eefaf3ceb7 saga_name = instance-update
115102025-03-01T01:26:00.737ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 67b03f4e-4cbd-4843-9cd9-647f610abcfc
115112025-03-01T01:26:00.737ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(3), "updater_id": String("232942d8-e902-450d-913b-d4caa8177b4b")}) node_id = 1 saga_id = 3cf04295-11fb-4fa6-845e-c6eefaf3ceb7
115122025-03-01T01:26:00.740ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 67b03f4e-4cbd-4843-9cd9-647f610abcfc
115132025-03-01T01:26:00.740ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 3cf04295-11fb-4fa6-845e-c6eefaf3ceb7
115142025-03-01T01:26:00.743ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 67b03f4e-4cbd-4843-9cd9-647f610abcfc
115152025-03-01T01:26:00.743ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("Delete")) node_id = 2 saga_id = 3cf04295-11fb-4fa6-845e-c6eefaf3ceb7
115162025-03-01T01:26:00.746ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 67b03f4e-4cbd-4843-9cd9-647f610abcfc
115172025-03-01T01:26:00.746ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 3cf04295-11fb-4fa6-845e-c6eefaf3ceb7
115182025-03-01T01:26:00.749ZINFOnexus (SagaExecutor): instance update: deleting network config file = nexus/src/app/sagas/instance_update/mod.rs:1017 instance_id = 569a637e-763e-4e53-a4b5-dc11743374ed saga_id = 3cf04295-11fb-4fa6-845e-c6eefaf3ceb7 saga_name = instance-update
115192025-03-01T01:26:00.749ZINFOnexus: deleting instance dpd configuration file = nexus/src/app/instance_network.rs:548 instance_id = 569a637e-763e-4e53-a4b5-dc11743374ed
115202025-03-01T01:26:00.752ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 3cf04295-11fb-4fa6-845e-c6eefaf3ceb7 saga_name = instance-update saga_node = UpdateNetworkConfig
115212025-03-01T01:26:00.752ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 3cf04295-11fb-4fa6-845e-c6eefaf3ceb7 saga_name = instance-update saga_node = UpdateNetworkConfig
115222025-03-01T01:26:00.754ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 3cf04295-11fb-4fa6-845e-c6eefaf3ceb7 saga_name = instance-update saga_node = UpdateNetworkConfig
115232025-03-01T01:26:00.755ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 3cf04295-11fb-4fa6-845e-c6eefaf3ceb7 saga_name = instance-update saga_node = UpdateNetworkConfig
115242025-03-01T01:26:00.756ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
115252025-03-01T01:26:00.756ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 3cf04295-11fb-4fa6-845e-c6eefaf3ceb7 saga_name = instance-update saga_node = UpdateNetworkConfig
115262025-03-01T01:26:00.756ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 3cf04295-11fb-4fa6-845e-c6eefaf3ceb7 saga_name = instance-update saga_node = UpdateNetworkConfig
115272025-03-01T01:26:00.758ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
115282025-03-01T01:26:00.758ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
115292025-03-01T01:26:00.759ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
115302025-03-01T01:26:00.760ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
115312025-03-01T01:26:00.761ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Fleet result = Ok(())
115322025-03-01T01:26:00.761ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
115332025-03-01T01:26:00.761ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
115342025-03-01T01:26:00.768ZDEBGnexus: notifying dendrite of updates instance_id = Some(569a637e-763e-4e53-a4b5-dc11743374ed (instance)) switch = switch0
115352025-03-01T01:26:00.768ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1571, tv_nsec: 456634706 } })
115362025-03-01T01:26:00.768ZINFOnexus: Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1154
115372025-03-01T01:26:00.799ZINFOnexus: determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
115382025-03-01T01:26:00.799ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
115392025-03-01T01:26:00.799ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f7208908-34c9-4bca-9b35-2b8b2ddc6365", "content-length": "26", "date": "Sat, 01 Mar 2025 01:26:00 GMT"} })
115402025-03-01T01:26:00.799ZINFOnexus: identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
115412025-03-01T01:26:00.800ZINFOnexus: completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
115422025-03-01T01:26:00.829ZDEBGnexus (DpdClient): client request body = None method = POST uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger
115432025-03-01T01:26:00.831ZDEBGnexus (DpdClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger", status: 200, headers: {"content-type": "application/json", "x-request-id": "cdf8aa02-bc77-40c1-8047-1d14ec08a618", "content-length": "4", "date": "Sat, 01 Mar 2025 01:25:59 GMT"} })
115442025-03-01T01:26:00.832ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 67b03f4e-4cbd-4843-9cd9-647f610abcfc
115452025-03-01T01:26:00.832ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = 3cf04295-11fb-4fa6-845e-c6eefaf3ceb7
115462025-03-01T01:26:00.835ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 67b03f4e-4cbd-4843-9cd9-647f610abcfc
115472025-03-01T01:26:00.835ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 3cf04295-11fb-4fa6-845e-c6eefaf3ceb7
115482025-03-01T01:26:00.841ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 3cf04295-11fb-4fa6-845e-c6eefaf3ceb7 saga_name = instance-update saga_node = ReleaseVirtualProvisioning
115492025-03-01T01:26:00.841ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 3cf04295-11fb-4fa6-845e-c6eefaf3ceb7 saga_name = instance-update saga_node = ReleaseVirtualProvisioning
115502025-03-01T01:26:00.857ZINFOnexus (SagaExecutor): instance update (no VMM): deallocated virtual provisioning resources file = nexus/src/app/sagas/instance_update/mod.rs:1092 instance_id = 569a637e-763e-4e53-a4b5-dc11743374ed records_deleted = [VirtualProvisioningCollection { id: 001de000-1334-4000-8000-000000000000, time_modified: Some(2025-03-01T01:26:00.844521Z), collection_type: "Fleet", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: 1682a303-6254-452b-b4cf-160ed9dc3fc9, time_modified: Some(2025-03-01T01:26:00.844521Z), collection_type: "Silo", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: bddca329-6d2c-43a5-8d39-c2dade19860c, time_modified: Some(2025-03-01T01:26:00.844521Z), collection_type: "Project", virtual_disk_bytes_provisioned: ByteCount(ByteCount(2147483648)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }] saga_id = 3cf04295-11fb-4fa6-845e-c6eefaf3ceb7 saga_name = instance-update
115512025-03-01T01:26:00.857ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 67b03f4e-4cbd-4843-9cd9-647f610abcfc
115522025-03-01T01:26:00.857ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = 3cf04295-11fb-4fa6-845e-c6eefaf3ceb7
115532025-03-01T01:26:00.860ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = 67b03f4e-4cbd-4843-9cd9-647f610abcfc
115542025-03-01T01:26:00.860ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = 3cf04295-11fb-4fa6-845e-c6eefaf3ceb7
115552025-03-01T01:26:00.863ZINFOnexus (SagaExecutor): instance update (no VMM): unassigning oximeter producer file = nexus/src/app/sagas/instance_update/mod.rs:1127 instance_id = 569a637e-763e-4e53-a4b5-dc11743374ed saga_id = 3cf04295-11fb-4fa6-845e-c6eefaf3ceb7 saga_name = instance-update
115562025-03-01T01:26:00.863ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 3cf04295-11fb-4fa6-845e-c6eefaf3ceb7 saga_name = instance-update saga_node = UnassignOximeterProducer
115572025-03-01T01:26:00.863ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 3cf04295-11fb-4fa6-845e-c6eefaf3ceb7 saga_name = instance-update saga_node = UnassignOximeterProducer
115582025-03-01T01:26:00.868ZDEBGnexus (SagaExecutor): deleted metric producer assignment collector_id = d77aa5d6-e6f9-4845-b1d4-57f91a3621e6 producer_id = 569a637e-763e-4e53-a4b5-dc11743374ed saga_id = 3cf04295-11fb-4fa6-845e-c6eefaf3ceb7 saga_name = instance-update
115592025-03-01T01:26:00.868ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 3cf04295-11fb-4fa6-845e-c6eefaf3ceb7 saga_name = instance-update saga_node = UnassignOximeterProducer
115602025-03-01T01:26:00.868ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 3cf04295-11fb-4fa6-845e-c6eefaf3ceb7 saga_name = instance-update saga_node = UnassignOximeterProducer
115612025-03-01T01:26:00.904ZINFOnexus (SagaExecutor): registered oximeter collector client file = nexus/src/app/oximeter.rs:262 id = 569a637e-763e-4e53-a4b5-dc11743374ed saga_id = 3cf04295-11fb-4fa6-845e-c6eefaf3ceb7 saga_name = instance-update
115622025-03-01T01:26:00.904ZDEBGnexus (SagaExecutor): client request body = None method = DELETE oximeter-collector = 569a637e-763e-4e53-a4b5-dc11743374ed saga_id = 3cf04295-11fb-4fa6-845e-c6eefaf3ceb7 saga_name = instance-update uri = http://[fd00:1122:3344:101::d]:12223/producers/569a637e-763e-4e53-a4b5-dc11743374ed
115632025-03-01T01:26:00.931ZDEBGnexus (SagaExecutor): client response oximeter-collector = 569a637e-763e-4e53-a4b5-dc11743374ed result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers/569a637e-763e-4e53-a4b5-dc11743374ed", status: 204, headers: {"x-request-id": "439f1faf-0c6a-4631-bd4d-0c50b853e392", "date": "Sat, 01 Mar 2025 01:26:00 GMT"} }) saga_id = 3cf04295-11fb-4fa6-845e-c6eefaf3ceb7 saga_name = instance-update
115642025-03-01T01:26:00.931ZDEBGnexus (SagaExecutor): successfully deleted producer from collector address = [fd00:1122:3344:101::d]:12223 collector_id = d77aa5d6-e6f9-4845-b1d4-57f91a3621e6 producer_id = 569a637e-763e-4e53-a4b5-dc11743374ed saga_id = 3cf04295-11fb-4fa6-845e-c6eefaf3ceb7 saga_name = instance-update
115652025-03-01T01:26:00.932ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = 67b03f4e-4cbd-4843-9cd9-647f610abcfc
115662025-03-01T01:26:00.932ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = 3cf04295-11fb-4fa6-845e-c6eefaf3ceb7
115672025-03-01T01:26:00.936ZDEBGnexus (SEC): saga log event new_state = N006 started sec_id = 67b03f4e-4cbd-4843-9cd9-647f610abcfc
115682025-03-01T01:26:00.936ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 6 saga_id = 3cf04295-11fb-4fa6-845e-c6eefaf3ceb7
115692025-03-01T01:26:00.941ZDEBGnexus (SagaExecutor): instance update: committing new runtime state and unlocking... instance_id = 569a637e-763e-4e53-a4b5-dc11743374ed lock = UpdaterLock { updater_id: 232942d8-e902-450d-913b-d4caa8177b4b, locked_gen: Generation(Generation(3)) } new_runtime = InstanceRuntimeState { time_updated: 2025-03-01T01:26:00.690882700Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = 3cf04295-11fb-4fa6-845e-c6eefaf3ceb7 saga_name = instance-update
115702025-03-01T01:26:00.941ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 3cf04295-11fb-4fa6-845e-c6eefaf3ceb7 saga_name = instance-update saga_node = CommitInstanceUpdates
115712025-03-01T01:26:00.941ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 3cf04295-11fb-4fa6-845e-c6eefaf3ceb7 saga_name = instance-update saga_node = CommitInstanceUpdates
115722025-03-01T01:26:00.976ZINFOnexus (SagaExecutor): instance update: committed update new runtime state! did_unlock = true file = nexus/src/app/sagas/instance_update/mod.rs:1176 instance_id = 569a637e-763e-4e53-a4b5-dc11743374ed new_runtime = InstanceRuntimeState { time_updated: 2025-03-01T01:26:00.690882700Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = 3cf04295-11fb-4fa6-845e-c6eefaf3ceb7 saga_name = instance-update
115732025-03-01T01:26:00.976ZDEBGnexus (SEC): saga log event new_state = N006 succeeded sec_id = 67b03f4e-4cbd-4843-9cd9-647f610abcfc
115742025-03-01T01:26:00.976ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 6 saga_id = 3cf04295-11fb-4fa6-845e-c6eefaf3ceb7
115752025-03-01T01:26:00.976ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 24 reason = Signaled
115762025-03-01T01:26:00.976ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 24 reason = Signaled
115772025-03-01T01:26:00.976ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
115782025-03-01T01:26:00.976ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
115792025-03-01T01:26:00.976ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
115802025-03-01T01:26:00.976ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
115812025-03-01T01:26:00.976ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
115822025-03-01T01:26:00.977ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115832025-03-01T01:26:00.979ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
115842025-03-01T01:26:00.979ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
115852025-03-01T01:26:00.979ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
115862025-03-01T01:26:00.980ZDEBGnexus (SEC): saga log event new_state = N007 started sec_id = 67b03f4e-4cbd-4843-9cd9-647f610abcfc
115872025-03-01T01:26:00.980ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 7 saga_id = 3cf04295-11fb-4fa6-845e-c6eefaf3ceb7
115882025-03-01T01:26:00.980ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115892025-03-01T01:26:00.982ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
115902025-03-01T01:26:00.982ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
115912025-03-01T01:26:00.982ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
115922025-03-01T01:26:00.983ZDEBGnexus (SEC): saga log event new_state = N007 succeeded sec_id = 67b03f4e-4cbd-4843-9cd9-647f610abcfc
115932025-03-01T01:26:00.983ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"instance_id": String("569a637e-763e-4e53-a4b5-dc11743374ed"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("aca99a49-7c59-4a59-af58-b9aed0dbfdb5")}) node_id = 7 saga_id = 3cf04295-11fb-4fa6-845e-c6eefaf3ceb7
115942025-03-01T01:26:00.986ZDEBGnexus (SEC): saga log event new_state = N008 started sec_id = 67b03f4e-4cbd-4843-9cd9-647f610abcfc
115952025-03-01T01:26:00.986ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 8 saga_id = 3cf04295-11fb-4fa6-845e-c6eefaf3ceb7
115962025-03-01T01:26:00.989ZDEBGnexus (SEC): saga log event new_state = N008 succeeded sec_id = 67b03f4e-4cbd-4843-9cd9-647f610abcfc
115972025-03-01T01:26:00.989ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 8 saga_id = 3cf04295-11fb-4fa6-845e-c6eefaf3ceb7
115982025-03-01T01:26:01.015ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
115992025-03-01T01:26:01.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
116002025-03-01T01:26:01.015ZINFOnexus (BackgroundTasks): VPC route manager sled 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
116012025-03-01T01:26:01.015ZDEBGnexus (BackgroundTasks): client request SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
116022025-03-01T01:26:01.016ZDEBGnexus (BackgroundTasks): client response SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "d05642d0-a17c-40c4-a77a-9cd2d32474c5", "content-length": "372", "date": "Sat, 01 Mar 2025 01:26:01 GMT"} })
116032025-03-01T01:26:01.016ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
116042025-03-01T01:26:01.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
116052025-03-01T01:26:01.019ZDEBGnexus (SEC): saga log event new_state = N009 started sec_id = 67b03f4e-4cbd-4843-9cd9-647f610abcfc
116062025-03-01T01:26:01.019ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 9 saga_id = 3cf04295-11fb-4fa6-845e-c6eefaf3ceb7
116072025-03-01T01:26:01.022ZINFOnexus (SagaExecutor): instance update (VMM destroyed): deallocating sled resource reservation file = nexus/src/app/sagas/instance_update/destroyed.rs:83 instance_id = 569a637e-763e-4e53-a4b5-dc11743374ed propolis_id = aca99a49-7c59-4a59-af58-b9aed0dbfdb5 saga_id = 3cf04295-11fb-4fa6-845e-c6eefaf3ceb7 saga_name = instance-update
116082025-03-01T01:26:01.022ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 3cf04295-11fb-4fa6-845e-c6eefaf3ceb7 saga_name = instance-update saga_node = ReleaseSledResources
116092025-03-01T01:26:01.022ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 3cf04295-11fb-4fa6-845e-c6eefaf3ceb7 saga_name = instance-update saga_node = ReleaseSledResources
116102025-03-01T01:26:01.031ZDEBGnexus (SEC): saga log event new_state = N009 succeeded sec_id = 67b03f4e-4cbd-4843-9cd9-647f610abcfc
116112025-03-01T01:26:01.031ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 9 saga_id = 3cf04295-11fb-4fa6-845e-c6eefaf3ceb7
116122025-03-01T01:26:01.034ZDEBGnexus (SEC): saga log event new_state = N010 started sec_id = 67b03f4e-4cbd-4843-9cd9-647f610abcfc
116132025-03-01T01:26:01.034ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 10 saga_id = 3cf04295-11fb-4fa6-845e-c6eefaf3ceb7
116142025-03-01T01:26:01.038ZINFOnexus (SagaExecutor): instance update (VMM destroyed): marking VMM record deleted file = nexus/src/app/sagas/instance_update/destroyed.rs:114 instance_id = 569a637e-763e-4e53-a4b5-dc11743374ed propolis_id = aca99a49-7c59-4a59-af58-b9aed0dbfdb5 saga_id = 3cf04295-11fb-4fa6-845e-c6eefaf3ceb7 saga_name = instance-update
116152025-03-01T01:26:01.038ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 3cf04295-11fb-4fa6-845e-c6eefaf3ceb7 saga_name = instance-update saga_node = MarkVmmDeleted
116162025-03-01T01:26:01.038ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 3cf04295-11fb-4fa6-845e-c6eefaf3ceb7 saga_name = instance-update saga_node = MarkVmmDeleted
116172025-03-01T01:26:01.060ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {744f1975-fb15-4ab9-ae36-db6df43c1b80: {10.151.2.175: {dd673e83-bb28-43b4-80dc-cd65cf150392}, 10.151.2.176: {dd673e83-bb28-43b4-80dc-cd65cf150392}}} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
116182025-03-01T01:26:01.060ZDEBGnexus (BackgroundTasks): client request SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
116192025-03-01T01:26:01.060ZDEBGnexus (BackgroundTasks): client response SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "345b92c9-eb54-4d96-9b7f-7c53c18cfd5a", "date": "Sat, 01 Mar 2025 01:26:01 GMT"} })
116202025-03-01T01:26:01.060ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
116212025-03-01T01:26:01.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
116222025-03-01T01:26:01.062ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
116232025-03-01T01:26:01.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
116242025-03-01T01:26:01.065ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
116252025-03-01T01:26:01.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
116262025-03-01T01:26:01.068ZINFOnexus (BackgroundTasks): VPC route manager sled 3471264f-127e-4a25-bc10-2e8249e8d70a push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
116272025-03-01T01:26:01.068ZDEBGnexus (BackgroundTasks): client request SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
116282025-03-01T01:26:01.068ZDEBGnexus (BackgroundTasks): client response SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "d2b9f47b-730d-48e1-b5ae-6a6ff1a12cc6", "date": "Sat, 01 Mar 2025 01:26:01 GMT"} })
116292025-03-01T01:26:01.069ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 93.828321ms iteration = 24 status = {}
116302025-03-01T01:26:01.078ZDEBGnexus (SEC): saga log event new_state = N010 succeeded sec_id = 67b03f4e-4cbd-4843-9cd9-647f610abcfc
116312025-03-01T01:26:01.078ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = 3cf04295-11fb-4fa6-845e-c6eefaf3ceb7
116322025-03-01T01:26:01.082ZDEBGnexus (SEC): saga log event new_state = N011 started sec_id = 67b03f4e-4cbd-4843-9cd9-647f610abcfc
116332025-03-01T01:26:01.082ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 11 saga_id = 3cf04295-11fb-4fa6-845e-c6eefaf3ceb7
116342025-03-01T01:26:01.083ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
116352025-03-01T01:26:01.083ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
116362025-03-01T01:26:01.084ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116372025-03-01T01:26:01.086ZDEBGnexus (SEC): saga log event new_state = N011 succeeded sec_id = 67b03f4e-4cbd-4843-9cd9-647f610abcfc
116382025-03-01T01:26:01.086ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 11 saga_id = 3cf04295-11fb-4fa6-845e-c6eefaf3ceb7
116392025-03-01T01:26:01.086ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
116402025-03-01T01:26:01.086ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
116412025-03-01T01:26:01.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
116422025-03-01T01:26:01.088ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116432025-03-01T01:26:01.090ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
116442025-03-01T01:26:01.090ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
116452025-03-01T01:26:01.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
116462025-03-01T01:26:01.090ZDEBGnexus (SEC): saga log event new_state = N012 started sec_id = 67b03f4e-4cbd-4843-9cd9-647f610abcfc
116472025-03-01T01:26:01.090ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 12 saga_id = 3cf04295-11fb-4fa6-845e-c6eefaf3ceb7
116482025-03-01T01:26:01.094ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 3cf04295-11fb-4fa6-845e-c6eefaf3ceb7 saga_name = instance-update saga_node = ChainSuccessorSaga
116492025-03-01T01:26:01.094ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 3cf04295-11fb-4fa6-845e-c6eefaf3ceb7 saga_name = instance-update saga_node = ChainSuccessorSaga
116502025-03-01T01:26:01.096ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 3cf04295-11fb-4fa6-845e-c6eefaf3ceb7 saga_name = instance-update saga_node = ChainSuccessorSaga
116512025-03-01T01:26:01.096ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 3cf04295-11fb-4fa6-845e-c6eefaf3ceb7 saga_name = instance-update saga_node = ChainSuccessorSaga
116522025-03-01T01:26:01.097ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 3cf04295-11fb-4fa6-845e-c6eefaf3ceb7 saga_name = instance-update saga_node = ChainSuccessorSaga
116532025-03-01T01:26:01.098ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 3cf04295-11fb-4fa6-845e-c6eefaf3ceb7 saga_name = instance-update saga_node = ChainSuccessorSaga
116542025-03-01T01:26:01.099ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 3cf04295-11fb-4fa6-845e-c6eefaf3ceb7 saga_name = instance-update saga_node = ChainSuccessorSaga
116552025-03-01T01:26:01.102ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 1682a303-6254-452b-b4cf-160ed9dc3fc9, lookup_type: ById(1682a303-6254-452b-b4cf-160ed9dc3fc9) }, key: bddca329-6d2c-43a5-8d39-c2dade19860c, lookup_type: ById(bddca329-6d2c-43a5-8d39-c2dade19860c) }, key: 569a637e-763e-4e53-a4b5-dc11743374ed, lookup_type: ById(569a637e-763e-4e53-a4b5-dc11743374ed) } result = Ok(()) saga_id = 3cf04295-11fb-4fa6-845e-c6eefaf3ceb7 saga_name = instance-update saga_node = ChainSuccessorSaga
116562025-03-01T01:26:01.102ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 3cf04295-11fb-4fa6-845e-c6eefaf3ceb7 saga_name = instance-update saga_node = ChainSuccessorSaga
116572025-03-01T01:26:01.102ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 3cf04295-11fb-4fa6-845e-c6eefaf3ceb7 saga_name = instance-update saga_node = ChainSuccessorSaga
116582025-03-01T01:26:01.123ZDEBGnexus (BackgroundTasks): client request SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
116592025-03-01T01:26:01.123ZDEBGnexus (BackgroundTasks): client response SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "e00fd4dd-d507-4d56-89f5-af7871f269db", "content-length": "691", "date": "Sat, 01 Mar 2025 01:26:01 GMT"} })
116602025-03-01T01:26:01.123ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
116612025-03-01T01:26:01.123ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
116622025-03-01T01:26:01.123ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
116632025-03-01T01:26:01.125ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 149.831042ms iteration = 24 status = {}
116642025-03-01T01:26:01.127ZDEBGnexus (SagaExecutor): instance update: instance will not reincarnate auto_restart_config = InstanceAutoRestart { policy: None, cooldown: None } instance_id = 569a637e-763e-4e53-a4b5-dc11743374ed karmic_state = WillReincarnate needs_reincarnation = false saga_id = 3cf04295-11fb-4fa6-845e-c6eefaf3ceb7 saga_name = instance-update
116652025-03-01T01:26:01.127ZDEBGnexus (SEC): saga log event new_state = N012 succeeded sec_id = 67b03f4e-4cbd-4843-9cd9-647f610abcfc
116662025-03-01T01:26:01.127ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 12 saga_id = 3cf04295-11fb-4fa6-845e-c6eefaf3ceb7
116672025-03-01T01:26:01.131ZDEBGnexus (SEC): saga log event new_state = N014 started sec_id = 67b03f4e-4cbd-4843-9cd9-647f610abcfc
116682025-03-01T01:26:01.131ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 14 saga_id = 3cf04295-11fb-4fa6-845e-c6eefaf3ceb7
116692025-03-01T01:26:01.134ZDEBGnexus (SEC): saga log event new_state = N014 succeeded sec_id = 67b03f4e-4cbd-4843-9cd9-647f610abcfc
116702025-03-01T01:26:01.134ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 14 saga_id = 3cf04295-11fb-4fa6-845e-c6eefaf3ceb7
116712025-03-01T01:26:01.138ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 3cf04295-11fb-4fa6-845e-c6eefaf3ceb7 sec_id = 67b03f4e-4cbd-4843-9cd9-647f610abcfc
116722025-03-01T01:26:01.138ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 3cf04295-11fb-4fa6-845e-c6eefaf3ceb7
116732025-03-01T01:26:01.172ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = 3cf04295-11fb-4fa6-845e-c6eefaf3ceb7 saga_name = instance-update sec_id = 67b03f4e-4cbd-4843-9cd9-647f610abcfc
116742025-03-01T01:26:01.172ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = 3cf04295-11fb-4fa6-845e-c6eefaf3ceb7 saga_name = instance-update saga_result = SagaResult { saga_id: 3cf04295-11fb-4fa6-845e-c6eefaf3ceb7, saga_log: SagaLog { saga_id: 3cf04295-11fb-4fa6-845e-c6eefaf3ceb7, unwinding: false, events: [N013 started, N013 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N005 succeeded, N006 started, N006 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N009 started, N009 succeeded, N010 started, N010 succeeded, N011 started, N011 succeeded, N012 started, N012 succeeded, N014 started, N014 succeeded], node_status: {0: Succeeded(String("232942d8-e902-450d-913b-d4caa8177b4b")), 1: Succeeded(Object {"locked_gen": Number(3), "updater_id": String("232942d8-e902-450d-913b-d4caa8177b4b")}), 2: Succeeded(String("Delete")), 3: Succeeded(Null), 4: Succeeded(Null), 5: Succeeded(Null), 6: Succeeded(Null), 7: Succeeded(Object {"instance_id": String("569a637e-763e-4e53-a4b5-dc11743374ed"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("aca99a49-7c59-4a59-af58-b9aed0dbfdb5")}), 8: Succeeded(Null), 9: Succeeded(Null), 10: Succeeded(Null), 11: Succeeded(Null), 12: Succeeded(Null), 13: Succeeded(Null), 14: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"active_vmm_destroyed": Null, "chain_successor_saga": Null, "commit_instance_updates": Null, "destroy_active_vmm_params": Object {"instance_id": String("569a637e-763e-4e53-a4b5-dc11743374ed"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("aca99a49-7c59-4a59-af58-b9aed0dbfdb5")}, "mark_vmm_deleted": Null, "network_config_update": String("Delete"), "release_sled_resources": Null, "release_virtual_provisioning": Null, "saga_instance_lock_id": String("232942d8-e902-450d-913b-d4caa8177b4b"), "unassign_oximeter_producer": Null, "update_network_config": Null, "updater_lock": Object {"locked_gen": Number(3), "updater_id": String("232942d8-e902-450d-913b-d4caa8177b4b")}} }) }
116752025-03-01T01:26:01.172ZDEBGnexus (SagaExecutor): instance update: child saga completed successfully child_saga_id = 3cf04295-11fb-4fa6-845e-c6eefaf3ceb7 instance_id = 569a637e-763e-4e53-a4b5-dc11743374ed saga_id = 065c0fec-1bf1-48d3-93bb-27b0b75caed8 saga_name = start-instance-update
116762025-03-01T01:26:01.172ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 67b03f4e-4cbd-4843-9cd9-647f610abcfc
116772025-03-01T01:26:01.172ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 2 saga_id = 065c0fec-1bf1-48d3-93bb-27b0b75caed8
116782025-03-01T01:26:01.175ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 67b03f4e-4cbd-4843-9cd9-647f610abcfc
116792025-03-01T01:26:01.175ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 065c0fec-1bf1-48d3-93bb-27b0b75caed8
116802025-03-01T01:26:01.179ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 67b03f4e-4cbd-4843-9cd9-647f610abcfc
116812025-03-01T01:26:01.179ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = 065c0fec-1bf1-48d3-93bb-27b0b75caed8
116822025-03-01T01:26:01.182ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 065c0fec-1bf1-48d3-93bb-27b0b75caed8 sec_id = 67b03f4e-4cbd-4843-9cd9-647f610abcfc
116832025-03-01T01:26:01.182ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 065c0fec-1bf1-48d3-93bb-27b0b75caed8
116842025-03-01T01:26:01.216ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = 065c0fec-1bf1-48d3-93bb-27b0b75caed8 saga_name = start-instance-update sec_id = 67b03f4e-4cbd-4843-9cd9-647f610abcfc
116852025-03-01T01:26:01.216ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = 065c0fec-1bf1-48d3-93bb-27b0b75caed8 saga_name = start-instance-update saga_result = SagaResult { saga_id: 065c0fec-1bf1-48d3-93bb-27b0b75caed8, saga_log: SagaLog { saga_id: 065c0fec-1bf1-48d3-93bb-27b0b75caed8, unwinding: false, events: [N003 started, N003 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N004 started, N004 succeeded], node_status: {0: Succeeded(String("e2a6f315-ad68-4895-a729-9c79a8d3bfca")), 1: Succeeded(Object {"locked_gen": Number(2), "updater_id": String("e2a6f315-ad68-4895-a729-9c79a8d3bfca")}), 2: Succeeded(Null), 3: Succeeded(Null), 4: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"saga_instance_lock_id": String("e2a6f315-ad68-4895-a729-9c79a8d3bfca"), "state": Null, "updater_lock": Object {"locked_gen": Number(2), "updater_id": String("e2a6f315-ad68-4895-a729-9c79a8d3bfca")}} }) }
116862025-03-01T01:26:01.748ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 75350cb5-7bbe-41ad-8cf7-6f4fd9238b11 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
116872025-03-01T01:26:01.748ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 75350cb5-7bbe-41ad-8cf7-6f4fd9238b11 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
116882025-03-01T01:26:01.750ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2450 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 75350cb5-7bbe-41ad-8cf7-6f4fd9238b11 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
116892025-03-01T01:26:02.771ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c95c62c6-f5f3-49a7-a9b8-a520ff187c31 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
116902025-03-01T01:26:02.772ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c95c62c6-f5f3-49a7-a9b8-a520ff187c31 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
116912025-03-01T01:26:02.773ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2008 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c95c62c6-f5f3-49a7-a9b8-a520ff187c31 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
116922025-03-01T01:26:03.213ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 68 reason = Timeout
116932025-03-01T01:26:03.213ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
116942025-03-01T01:26:03.213ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 68 reason = Timeout
116952025-03-01T01:26:03.213ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
116962025-03-01T01:26:03.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
116972025-03-01T01:26:03.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
116982025-03-01T01:26:03.216ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116992025-03-01T01:26:03.218ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
117002025-03-01T01:26:03.218ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
117012025-03-01T01:26:03.218ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
117022025-03-01T01:26:03.220ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
117032025-03-01T01:26:03.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
117042025-03-01T01:26:03.222ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117052025-03-01T01:26:03.225ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7, lookup_type: ById(8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7) } result = Ok(())
117062025-03-01T01:26:03.225ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
117072025-03-01T01:26:03.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
117082025-03-01T01:26:03.234ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 original_time_created = 2025-03-01 01:14:50.436545 UTC target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 time_created = 2025-03-01 01:14:50.436545 UTC
117092025-03-01T01:26:03.234ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.243753ms iteration = 68 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7","time_created":"2025-03-01T01:14:50.436545Z"}
117102025-03-01T01:26:03.241ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
117112025-03-01T01:26:03.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
117122025-03-01T01:26:03.268ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 54.650723ms iteration = 68 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
117132025-03-01T01:26:03.794ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 77ee33ca-43c0-4bc4-b148-2d2e267615f6 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
117142025-03-01T01:26:03.794ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 77ee33ca-43c0-4bc4-b148-2d2e267615f6 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
117152025-03-01T01:26:03.796ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2470 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 77ee33ca-43c0-4bc4-b148-2d2e267615f6 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
117162025-03-01T01:26:04.818ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 98bcf65b-0814-482f-9177-6660ab044ab9 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
117172025-03-01T01:26:04.818ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 98bcf65b-0814-482f-9177-6660ab044ab9 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
117182025-03-01T01:26:04.820ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2276 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 98bcf65b-0814-482f-9177-6660ab044ab9 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
117192025-03-01T01:26:05.845ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 7f483b8d-28d7-4d7e-bca9-427e213bff32 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
117202025-03-01T01:26:05.846ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 7f483b8d-28d7-4d7e-bca9-427e213bff32 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
117212025-03-01T01:26:05.848ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2620 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 7f483b8d-28d7-4d7e-bca9-427e213bff32 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
117222025-03-01T01:26:06.868ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 8101eed9-89d2-4514-82aa-9e07f7ed1dac roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
117232025-03-01T01:26:06.868ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 8101eed9-89d2-4514-82aa-9e07f7ed1dac resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
117242025-03-01T01:26:06.870ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2385 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 8101eed9-89d2-4514-82aa-9e07f7ed1dac response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
117252025-03-01T01:26:07.414ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 436 local_addr = [fd00:1122:3344:101::c]:34357 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = 63b733c8-57ed-4c04-8043-1178411e7de5 response_code = 200 uri = /67b03f4e-4cbd-4843-9cd9-647f610abcfc
117262025-03-01T01:26:07.890ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 6b6cbcd9-7237-4e68-aa2a-5c93f7f5e820 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
117272025-03-01T01:26:07.891ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 6b6cbcd9-7237-4e68-aa2a-5c93f7f5e820 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
117282025-03-01T01:26:07.892ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2106 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 6b6cbcd9-7237-4e68-aa2a-5c93f7f5e820 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
117292025-03-01T01:26:08.915ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 27f654b2-2314-4593-a5b2-06349be7aee3 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
117302025-03-01T01:26:08.915ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 27f654b2-2314-4593-a5b2-06349be7aee3 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
117312025-03-01T01:26:08.918ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3028 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 27f654b2-2314-4593-a5b2-06349be7aee3 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
117322025-03-01T01:26:09.937ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = d13426b5-2205-488d-a85b-24c6eb5fbf3b roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
117332025-03-01T01:26:09.937ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = d13426b5-2205-488d-a85b-24c6eb5fbf3b resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
117342025-03-01T01:26:09.939ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2268 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = d13426b5-2205-488d-a85b-24c6eb5fbf3b response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
117352025-03-01T01:26:10.958ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = eda583e5-3c91-4ded-aea2-2c31bc258fb0 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
117362025-03-01T01:26:10.958ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = eda583e5-3c91-4ded-aea2-2c31bc258fb0 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
117372025-03-01T01:26:10.960ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2149 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = eda583e5-3c91-4ded-aea2-2c31bc258fb0 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
117382025-03-01T01:26:11.979ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = f0361544-068a-4084-aa2b-b0ba24ec9d91 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
117392025-03-01T01:26:11.980ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = f0361544-068a-4084-aa2b-b0ba24ec9d91 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
117402025-03-01T01:26:11.982ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2526 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = f0361544-068a-4084-aa2b-b0ba24ec9d91 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
117412025-03-01T01:26:13.001ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = d0fc4621-f55b-4d48-b6c0-0c3b1324dfc7 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
117422025-03-01T01:26:13.001ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = d0fc4621-f55b-4d48-b6c0-0c3b1324dfc7 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
117432025-03-01T01:26:13.002ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1564 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = d0fc4621-f55b-4d48-b6c0-0c3b1324dfc7 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
117442025-03-01T01:26:13.213ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 69 reason = Timeout
117452025-03-01T01:26:13.213ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 69 reason = Timeout
117462025-03-01T01:26:13.213ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
117472025-03-01T01:26:13.213ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
117482025-03-01T01:26:13.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
117492025-03-01T01:26:13.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
117502025-03-01T01:26:13.216ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
117512025-03-01T01:26:13.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
117522025-03-01T01:26:13.216ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117532025-03-01T01:26:13.218ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.940871ms iteration = 69 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
117542025-03-01T01:26:13.219ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
117552025-03-01T01:26:13.219ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
117562025-03-01T01:26:13.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
117572025-03-01T01:26:13.221ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
117582025-03-01T01:26:13.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
117592025-03-01T01:26:13.223ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117602025-03-01T01:26:13.225ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7, lookup_type: ById(8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7) } result = Ok(())
117612025-03-01T01:26:13.225ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
117622025-03-01T01:26:13.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
117632025-03-01T01:26:13.247ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 original_time_created = 2025-03-01 01:14:50.436545 UTC target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 time_created = 2025-03-01 01:14:50.436545 UTC
117642025-03-01T01:26:13.247ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 33.727117ms iteration = 69 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7","time_created":"2025-03-01T01:14:50.436545Z"}
117652025-03-01T01:26:14.024ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = fdbae1a6-3d80-4db3-a3cf-03b6cc9541fb roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
117662025-03-01T01:26:14.025ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = fdbae1a6-3d80-4db3-a3cf-03b6cc9541fb resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
117672025-03-01T01:26:14.027ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2906 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = fdbae1a6-3d80-4db3-a3cf-03b6cc9541fb response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
117682025-03-01T01:26:15.047ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 58ea4346-46d9-4d55-9700-a801918a80f5 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
117692025-03-01T01:26:15.047ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 58ea4346-46d9-4d55-9700-a801918a80f5 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
117702025-03-01T01:26:15.049ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2612 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 58ea4346-46d9-4d55-9700-a801918a80f5 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
117712025-03-01T01:26:16.068ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = b923f160-29e4-4f5b-8a57-e408f4ebba57 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
117722025-03-01T01:26:16.068ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = b923f160-29e4-4f5b-8a57-e408f4ebba57 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
117732025-03-01T01:26:16.070ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2418 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = b923f160-29e4-4f5b-8a57-e408f4ebba57 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
117742025-03-01T01:26:17.090ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = fed448aa-9fc5-4041-8bed-ce9b4d31a3eb roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
117752025-03-01T01:26:17.090ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = fed448aa-9fc5-4041-8bed-ce9b4d31a3eb resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
117762025-03-01T01:26:17.092ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2305 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = fed448aa-9fc5-4041-8bed-ce9b4d31a3eb response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
117772025-03-01T01:26:17.415ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 503 local_addr = [fd00:1122:3344:101::c]:34357 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = 731ddb1f-cd8f-4349-af3a-97bea60e5d12 response_code = 200 uri = /67b03f4e-4cbd-4843-9cd9-647f610abcfc
117782025-03-01T01:26:18.112ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = e0736d8e-8479-4045-9533-f14c77d2eb6c roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
117792025-03-01T01:26:18.113ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = e0736d8e-8479-4045-9533-f14c77d2eb6c resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
117802025-03-01T01:26:18.115ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2441 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = e0736d8e-8479-4045-9533-f14c77d2eb6c response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
117812025-03-01T01:26:19.134ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 32ab26d5-80d0-4dd4-be39-f2f1a9a64de3 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
117822025-03-01T01:26:19.134ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 32ab26d5-80d0-4dd4-be39-f2f1a9a64de3 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
117832025-03-01T01:26:19.136ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2268 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 32ab26d5-80d0-4dd4-be39-f2f1a9a64de3 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
117842025-03-01T01:26:20.156ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 590a959f-ede6-4bf0-a51f-afa19025e459 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
117852025-03-01T01:26:20.156ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 590a959f-ede6-4bf0-a51f-afa19025e459 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
117862025-03-01T01:26:20.158ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2237 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 590a959f-ede6-4bf0-a51f-afa19025e459 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
117872025-03-01T01:26:21.178ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 2de3e8e9-843b-4d82-97d5-6dc4af8c9843 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
117882025-03-01T01:26:21.178ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 2de3e8e9-843b-4d82-97d5-6dc4af8c9843 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
117892025-03-01T01:26:21.180ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2351 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 2de3e8e9-843b-4d82-97d5-6dc4af8c9843 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
117902025-03-01T01:26:22.200ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = ceaaeaab-dd98-4e6b-a121-d980f176742c roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
117912025-03-01T01:26:22.200ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = ceaaeaab-dd98-4e6b-a121-d980f176742c resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
117922025-03-01T01:26:22.202ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1719 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = ceaaeaab-dd98-4e6b-a121-d980f176742c response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
117932025-03-01T01:26:22.406ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::d]:38629
117942025-03-01T01:26:22.406ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38629 req_id = e5e8ca2c-7e32-48fa-ba9f-4bb1784926c3 roles = RoleSet { roles: {} } uri = /metrics/collectors/d77aa5d6-e6f9-4845-b1d4-57f91a3621e6/producers?sort_by=id_ascending
117952025-03-01T01:26:22.407ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38629 req_id = e5e8ca2c-7e32-48fa-ba9f-4bb1784926c3 resource = Database result = Ok(()) uri = /metrics/collectors/d77aa5d6-e6f9-4845-b1d4-57f91a3621e6/producers?sort_by=id_ascending
117962025-03-01T01:26:22.410ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3210 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38629 req_id = e5e8ca2c-7e32-48fa-ba9f-4bb1784926c3 response_code = 200 uri = /metrics/collectors/d77aa5d6-e6f9-4845-b1d4-57f91a3621e6/producers?sort_by=id_ascending
117972025-03-01T01:26:22.410ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38629 req_id = c2adb32d-ad9a-46c0-982c-271eab20726d roles = RoleSet { roles: {} } uri = /metrics/collectors/d77aa5d6-e6f9-4845-b1d4-57f91a3621e6/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYmI0ODUwMS0zYzRlLTRkNDQtODgyMy1mOTc1ZTg2OTFmZmYifX0%3D
117982025-03-01T01:26:22.410ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38629 req_id = c2adb32d-ad9a-46c0-982c-271eab20726d resource = Database result = Ok(()) uri = /metrics/collectors/d77aa5d6-e6f9-4845-b1d4-57f91a3621e6/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYmI0ODUwMS0zYzRlLTRkNDQtODgyMy1mOTc1ZTg2OTFmZmYifX0%3D
117992025-03-01T01:26:22.412ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2083 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38629 req_id = c2adb32d-ad9a-46c0-982c-271eab20726d response_code = 200 uri = /metrics/collectors/d77aa5d6-e6f9-4845-b1d4-57f91a3621e6/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYmI0ODUwMS0zYzRlLTRkNDQtODgyMy1mOTc1ZTg2OTFmZmYifX0%3D
118002025-03-01T01:26:23.213ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 24 reason = Timeout
118012025-03-01T01:26:23.213ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
118022025-03-01T01:26:23.213ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 24 reason = Timeout
118032025-03-01T01:26:23.213ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
118042025-03-01T01:26:23.213ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 70 reason = Timeout
118052025-03-01T01:26:23.213ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 24 reason = Timeout
118062025-03-01T01:26:23.213ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
118072025-03-01T01:26:23.213ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
118082025-03-01T01:26:23.213ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 24 reason = Timeout
118092025-03-01T01:26:23.213ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
118102025-03-01T01:26:23.213ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 26 reason = Timeout
118112025-03-01T01:26:23.213ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
118122025-03-01T01:26:23.213ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 24 reason = Timeout
118132025-03-01T01:26:23.213ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
118142025-03-01T01:26:23.213ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 25 reason = Timeout
118152025-03-01T01:26:23.213ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 24 reason = Timeout
118162025-03-01T01:26:23.213ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
118172025-03-01T01:26:23.213ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
118182025-03-01T01:26:23.213ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 24 reason = Timeout
118192025-03-01T01:26:23.213ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
118202025-03-01T01:26:23.213ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 24 reason = Timeout
118212025-03-01T01:26:23.213ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
118222025-03-01T01:26:23.213ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 24 reason = Timeout
118232025-03-01T01:26:23.213ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
118242025-03-01T01:26:23.213ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 24 reason = Timeout
118252025-03-01T01:26:23.213ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
118262025-03-01T01:26:23.213ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 70 reason = Timeout
118272025-03-01T01:26:23.213ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 24 reason = Timeout
118282025-03-01T01:26:23.213ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
118292025-03-01T01:26:23.213ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
118302025-03-01T01:26:23.213ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
118312025-03-01T01:26:23.213ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 25 reason = Timeout
118322025-03-01T01:26:23.214ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
118332025-03-01T01:26:23.214ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
118342025-03-01T01:26:23.214ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 24 reason = Timeout
118352025-03-01T01:26:23.214ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
118362025-03-01T01:26:23.214ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 24 reason = Timeout
118372025-03-01T01:26:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
118382025-03-01T01:26:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
118392025-03-01T01:26:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
118402025-03-01T01:26:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
118412025-03-01T01:26:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
118422025-03-01T01:26:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
118432025-03-01T01:26:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
118442025-03-01T01:26:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
118452025-03-01T01:26:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
118462025-03-01T01:26:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
118472025-03-01T01:26:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
118482025-03-01T01:26:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
118492025-03-01T01:26:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
118502025-03-01T01:26:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
118512025-03-01T01:26:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
118522025-03-01T01:26:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
118532025-03-01T01:26:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
118542025-03-01T01:26:23.216ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118552025-03-01T01:26:23.216ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
118562025-03-01T01:26:23.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
118572025-03-01T01:26:23.217ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118582025-03-01T01:26:23.218ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
118592025-03-01T01:26:23.218ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
118602025-03-01T01:26:23.218ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
118612025-03-01T01:26:23.218ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.41723ms iteration = 24 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
118622025-03-01T01:26:23.218ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1593, tv_nsec: 906659543 } })
118632025-03-01T01:26:23.218ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1154
118642025-03-01T01:26:23.219ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
118652025-03-01T01:26:23.219ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
118662025-03-01T01:26:23.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
118672025-03-01T01:26:23.220ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118682025-03-01T01:26:23.220ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 71ce397c-fe59-4dbc-900f-64e06bd24b96 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
118692025-03-01T01:26:23.221ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
118702025-03-01T01:26:23.221ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 71ce397c-fe59-4dbc-900f-64e06bd24b96 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
118712025-03-01T01:26:23.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
118722025-03-01T01:26:23.221ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118732025-03-01T01:26:23.222ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
118742025-03-01T01:26:23.222ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
118752025-03-01T01:26:23.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
118762025-03-01T01:26:23.224ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118772025-03-01T01:26:23.224ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118782025-03-01T01:26:23.226ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
118792025-03-01T01:26:23.226ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
118802025-03-01T01:26:23.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
118812025-03-01T01:26:23.227ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
118822025-03-01T01:26:23.227ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
118832025-03-01T01:26:23.227ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
118842025-03-01T01:26:23.227ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
118852025-03-01T01:26:23.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
118862025-03-01T01:26:23.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
118872025-03-01T01:26:23.229ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1593, tv_nsec: 918107756 } })
118882025-03-01T01:26:23.230ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1154
118892025-03-01T01:26:23.230ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 16.67464ms iteration = 70 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
118902025-03-01T01:26:23.231ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 10326 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 71ce397c-fe59-4dbc-900f-64e06bd24b96 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
118912025-03-01T01:26:23.232ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
118922025-03-01T01:26:23.232ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118932025-03-01T01:26:23.233ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
118942025-03-01T01:26:23.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
118952025-03-01T01:26:23.233ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1593, tv_nsec: 921372563 } })
118962025-03-01T01:26:23.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
118972025-03-01T01:26:23.233ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1154 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66
118982025-03-01T01:26:23.233ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
118992025-03-01T01:26:23.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
119002025-03-01T01:26:23.234ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
119012025-03-01T01:26:23.234ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
119022025-03-01T01:26:23.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
119032025-03-01T01:26:23.257ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 43.877424ms iteration = 24 status = {"errors":[],"garbage_collect_requested":[]}
119042025-03-01T01:26:23.258ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
119052025-03-01T01:26:23.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
119062025-03-01T01:26:23.262ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 46.971097ms iteration = 24 status = {"errors":[],"finish_invoked_ok":[]}
119072025-03-01T01:26:23.262ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
119082025-03-01T01:26:23.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
119092025-03-01T01:26:23.267ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 53.482259ms iteration = 24 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
119102025-03-01T01:26:23.267ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
119112025-03-01T01:26:23.268ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
119122025-03-01T01:26:23.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
119132025-03-01T01:26:23.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
119142025-03-01T01:26:23.274ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119152025-03-01T01:26:23.276ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
119162025-03-01T01:26:23.276ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
119172025-03-01T01:26:23.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
119182025-03-01T01:26:23.278ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119192025-03-01T01:26:23.280ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
119202025-03-01T01:26:23.280ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
119212025-03-01T01:26:23.280ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
119222025-03-01T01:26:23.280ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
119232025-03-01T01:26:23.280ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7, lookup_type: ById(8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7) } result = Ok(())
119242025-03-01T01:26:23.281ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
119252025-03-01T01:26:23.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
119262025-03-01T01:26:23.281ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 1 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
119272025-03-01T01:26:23.281ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 67.806441ms iteration = 24 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":1,"total_instances":0,"update_sagas_queued":0}
119282025-03-01T01:26:23.298ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 84.90243ms iteration = 24 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
119292025-03-01T01:26:23.305ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
119302025-03-01T01:26:23.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
119312025-03-01T01:26:23.307ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
119322025-03-01T01:26:23.307ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
119332025-03-01T01:26:23.307ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2b9e6059-8cdd-43a4-bc07-19979775d797", "content-length": "26", "date": "Sat, 01 Mar 2025 01:26:23 GMT"} })
119342025-03-01T01:26:23.307ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
119352025-03-01T01:26:23.308ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
119362025-03-01T01:26:23.333ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
119372025-03-01T01:26:23.333ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
119382025-03-01T01:26:23.334ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "62070ba7-9e8d-4cd2-b3cb-1d24f83e06dd", "content-length": "26", "date": "Sat, 01 Mar 2025 01:26:23 GMT"} })
119392025-03-01T01:26:23.334ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
119402025-03-01T01:26:23.336ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
119412025-03-01T01:26:23.345ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1162 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 zone_address = fd00:1122:3344:101::2
119422025-03-01T01:26:23.345ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
119432025-03-01T01:26:23.345ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a86d6ad0-7efd-461d-9c95-28140135f094", "content-length": "26", "date": "Sat, 01 Mar 2025 01:26:23 GMT"} })
119442025-03-01T01:26:23.346ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1167 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
119452025-03-01T01:26:23.347ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66
119462025-03-01T01:26:23.350ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
119472025-03-01T01:26:23.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
119482025-03-01T01:26:23.371ZINFOnexus (BackgroundTasks): VPC route manager sled 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
119492025-03-01T01:26:23.371ZDEBGnexus (BackgroundTasks): client request SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
119502025-03-01T01:26:23.374ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
119512025-03-01T01:26:23.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
119522025-03-01T01:26:23.375ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
119532025-03-01T01:26:23.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
119542025-03-01T01:26:23.376ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
119552025-03-01T01:26:23.376ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
119562025-03-01T01:26:23.376ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
119572025-03-01T01:26:23.377ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
119582025-03-01T01:26:23.398ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 original_time_created = 2025-03-01 01:14:50.436545 UTC target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 time_created = 2025-03-01 01:14:50.436545 UTC
119592025-03-01T01:26:23.398ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 184.07274ms iteration = 70 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7","time_created":"2025-03-01T01:14:50.436545Z"}
119602025-03-01T01:26:23.400ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 187.093651ms iteration = 24 status = {}
119612025-03-01T01:26:23.407ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119622025-03-01T01:26:23.408ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119632025-03-01T01:26:23.409ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 195.419751ms iteration = 24 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
119642025-03-01T01:26:23.409ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
119652025-03-01T01:26:23.409ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
119662025-03-01T01:26:23.410ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
119672025-03-01T01:26:23.410ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
119682025-03-01T01:26:23.410ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
119692025-03-01T01:26:23.410ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 196.487643ms iteration = 24 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
119702025-03-01T01:26:23.411ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
119712025-03-01T01:26:23.411ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
119722025-03-01T01:26:23.412ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
119732025-03-01T01:26:23.417ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119742025-03-01T01:26:23.419ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 3471264f-127e-4a25-bc10-2e8249e8d70a, lookup_type: ById(3471264f-127e-4a25-bc10-2e8249e8d70a) } result = Ok(())
119752025-03-01T01:26:23.419ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
119762025-03-01T01:26:23.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
119772025-03-01T01:26:23.422ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 208.359735ms iteration = 24 status = 0
119782025-03-01T01:26:23.423ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119792025-03-01T01:26:23.424ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
119802025-03-01T01:26:23.424ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
119812025-03-01T01:26:23.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
119822025-03-01T01:26:23.427ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
119832025-03-01T01:26:23.427ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "7554fb9e-d4fd-4f2a-909e-251e98c14131", "content-length": "2", "date": "Sat, 01 Mar 2025 01:26:23 GMT"} })
119842025-03-01T01:26:23.429ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
119852025-03-01T01:26:23.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
119862025-03-01T01:26:23.432ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 218.266747ms iteration = 24 status = null
119872025-03-01T01:26:23.441ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119882025-03-01T01:26:23.441ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
119892025-03-01T01:26:23.441ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 227.763359ms iteration = 24 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
119902025-03-01T01:26:23.443ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
119912025-03-01T01:26:23.443ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
119922025-03-01T01:26:23.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
119932025-03-01T01:26:23.468ZDEBGnexus (BackgroundTasks): client response SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "9c64b6b6-573d-4f09-8a29-9a7583433907", "content-length": "372", "date": "Sat, 01 Mar 2025 01:26:23 GMT"} })
119942025-03-01T01:26:23.469ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
119952025-03-01T01:26:23.469ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
119962025-03-01T01:26:23.509ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
119972025-03-01T01:26:23.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
119982025-03-01T01:26:23.512ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 7f9c3c14-58c5-473f-8692-6376be44401e, rack_id: 4854cb88-dfba-4609-8f9d-72aac08cef66, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(cb10d0c6-a704-4231-b148-4f9ae21a03f8) } rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 switch_location = Switch0
119992025-03-01T01:26:23.512ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
120002025-03-01T01:26:23.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
120012025-03-01T01:26:23.523ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
120022025-03-01T01:26:23.523ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "405b194a-c024-40d4-beb1-f744fe10fce6", "content-length": "134", "date": "Sat, 01 Mar 2025 01:26:23 GMT"} })
120032025-03-01T01:26:23.523ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
120042025-03-01T01:26:23.523ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = cb10d0c6-a704-4231-b148-4f9ae21a03f8
120052025-03-01T01:26:23.523ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
120062025-03-01T01:26:23.523ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
120072025-03-01T01:26:23.523ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
120082025-03-01T01:26:23.523ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
120092025-03-01T01:26:23.523ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
120102025-03-01T01:26:23.523ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
120112025-03-01T01:26:23.523ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
120122025-03-01T01:26:23.523ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
120132025-03-01T01:26:23.524ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66
120142025-03-01T01:26:23.524ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
120152025-03-01T01:26:23.524ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
120162025-03-01T01:26:23.530ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
120172025-03-01T01:26:23.530ZDEBGnexus (BackgroundTasks): client request SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
120182025-03-01T01:26:23.530ZDEBGnexus (BackgroundTasks): client response SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "f86876af-4605-4179-b044-58a5a007ddfe", "date": "Sat, 01 Mar 2025 01:26:23 GMT"} })
120192025-03-01T01:26:23.530ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
120202025-03-01T01:26:23.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
120212025-03-01T01:26:23.531ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 317.825174ms iteration = 26 status = {"physical_disks_added":0}
120222025-03-01T01:26:23.556ZDEBGnexus (BackgroundTasks): client request SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
120232025-03-01T01:26:23.556ZDEBGnexus (BackgroundTasks): client response SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "ca635585-51f7-48e3-adf6-a864709ec23a", "content-length": "691", "date": "Sat, 01 Mar 2025 01:26:23 GMT"} })
120242025-03-01T01:26:23.556ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
120252025-03-01T01:26:23.556ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
120262025-03-01T01:26:23.556ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
120272025-03-01T01:26:23.557ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 343.769523ms iteration = 25 status = {}
120282025-03-01T01:26:23.557ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
120292025-03-01T01:26:23.557ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "fa8e57f7-8928-4fa7-a4d5-d61c2ae49253", "content-length": "2", "date": "Sat, 01 Mar 2025 01:26:23 GMT"} })
120302025-03-01T01:26:23.557ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
120312025-03-01T01:26:23.558ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "c54e2d42-33a1-4e40-b61f-e70be9bf45d8", "content-length": "52", "date": "Sat, 01 Mar 2025 01:26:23 GMT"} })
120322025-03-01T01:26:23.558ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 switch_location = Switch0
120332025-03-01T01:26:23.558ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
120342025-03-01T01:26:23.558ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
120352025-03-01T01:26:23.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
120362025-03-01T01:26:23.561ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
120372025-03-01T01:26:23.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
120382025-03-01T01:26:23.564ZINFOnexus (BackgroundTasks): VPC route manager sled 3471264f-127e-4a25-bc10-2e8249e8d70a push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
120392025-03-01T01:26:23.564ZDEBGnexus (BackgroundTasks): client request SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
120402025-03-01T01:26:23.665ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "09c3c8ea-9b79-46d0-aa52-3cbaba8729b0", "date": "Sat, 01 Mar 2025 01:26:23 GMT"} })
120412025-03-01T01:26:23.665ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 switch = Switch0
120422025-03-01T01:26:23.665ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
120432025-03-01T01:26:23.666ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "943be1de-9e93-4214-a0e9-62f2964ae822", "content-length": "682", "date": "Sat, 01 Mar 2025 01:26:23 GMT"} })
120442025-03-01T01:26:23.666ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
120452025-03-01T01:26:23.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
120462025-03-01T01:26:23.666ZDEBGnexus (BackgroundTasks): client response SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "10fc49c0-4e17-4b54-b6fa-bd1c22d2d823", "date": "Sat, 01 Mar 2025 01:26:23 GMT"} })
120472025-03-01T01:26:23.667ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 453.911327ms iteration = 25 status = {}
120482025-03-01T01:26:23.670ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
120492025-03-01T01:26:23.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
120502025-03-01T01:26:23.673ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
120512025-03-01T01:26:23.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
120522025-03-01T01:26:23.675ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
120532025-03-01T01:26:23.675ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
120542025-03-01T01:26:23.682ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 468.82244ms iteration = 24 status = {}
120552025-03-01T01:26:24.257ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = ab012248-4de5-4344-8590-d18c5b2beaf1 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
120562025-03-01T01:26:24.257ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = ab012248-4de5-4344-8590-d18c5b2beaf1 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
120572025-03-01T01:26:24.259ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2010 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = ab012248-4de5-4344-8590-d18c5b2beaf1 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
120582025-03-01T01:26:25.278ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = e2e62187-1125-4613-be21-4b3ff24ff2e3 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
120592025-03-01T01:26:25.278ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = e2e62187-1125-4613-be21-4b3ff24ff2e3 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
120602025-03-01T01:26:25.280ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2800 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = e2e62187-1125-4613-be21-4b3ff24ff2e3 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
120612025-03-01T01:26:26.300ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c0e1c576-4f21-4f14-b285-e59d84420fe9 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
120622025-03-01T01:26:26.300ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c0e1c576-4f21-4f14-b285-e59d84420fe9 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
120632025-03-01T01:26:26.302ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2445 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c0e1c576-4f21-4f14-b285-e59d84420fe9 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
120642025-03-01T01:26:27.323ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = df0f06b3-46d5-45a0-bc47-4a6db5c35771 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
120652025-03-01T01:26:27.323ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = df0f06b3-46d5-45a0-bc47-4a6db5c35771 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
120662025-03-01T01:26:27.325ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1695 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = df0f06b3-46d5-45a0-bc47-4a6db5c35771 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
120672025-03-01T01:26:27.414ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 424 local_addr = [fd00:1122:3344:101::c]:34357 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = 736a70b6-8c69-4e14-a6a0-1aa73acff84e response_code = 200 uri = /67b03f4e-4cbd-4843-9cd9-647f610abcfc
120682025-03-01T01:26:28.347ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c674c631-efd9-4fa4-a4fb-76152e158783 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
120692025-03-01T01:26:28.348ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c674c631-efd9-4fa4-a4fb-76152e158783 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
120702025-03-01T01:26:28.350ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2641 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c674c631-efd9-4fa4-a4fb-76152e158783 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
120712025-03-01T01:26:29.369ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = a5cfe2bb-6364-428d-b6a2-86dae900cb1e roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
120722025-03-01T01:26:29.370ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = a5cfe2bb-6364-428d-b6a2-86dae900cb1e resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
120732025-03-01T01:26:29.372ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3032 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = a5cfe2bb-6364-428d-b6a2-86dae900cb1e response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
120742025-03-01T01:26:30.390ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = cd773aa8-8b34-4663-9da7-786481842bd0 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
120752025-03-01T01:26:30.391ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = cd773aa8-8b34-4663-9da7-786481842bd0 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
120762025-03-01T01:26:30.393ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2502 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = cd773aa8-8b34-4663-9da7-786481842bd0 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
120772025-03-01T01:26:31.413ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 67475f9b-2688-4310-95b9-04b5edb0f0e7 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
120782025-03-01T01:26:31.413ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 67475f9b-2688-4310-95b9-04b5edb0f0e7 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
120792025-03-01T01:26:31.415ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1752 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 67475f9b-2688-4310-95b9-04b5edb0f0e7 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
120802025-03-01T01:26:32.434ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 6d1ffd69-a5a4-426e-9ce8-071cd3cbb9df roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
120812025-03-01T01:26:32.434ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 6d1ffd69-a5a4-426e-9ce8-071cd3cbb9df resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
120822025-03-01T01:26:32.436ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2344 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 6d1ffd69-a5a4-426e-9ce8-071cd3cbb9df response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
120832025-03-01T01:26:33.213ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 71 reason = Timeout
120842025-03-01T01:26:33.213ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
120852025-03-01T01:26:33.214ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 71 reason = Timeout
120862025-03-01T01:26:33.214ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
120872025-03-01T01:26:33.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
120882025-03-01T01:26:33.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
120892025-03-01T01:26:33.242ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120902025-03-01T01:26:33.243ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
120912025-03-01T01:26:33.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
120922025-03-01T01:26:33.245ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
120932025-03-01T01:26:33.245ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
120942025-03-01T01:26:33.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
120952025-03-01T01:26:33.247ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
120962025-03-01T01:26:33.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
120972025-03-01T01:26:33.249ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120982025-03-01T01:26:33.251ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7, lookup_type: ById(8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7) } result = Ok(())
120992025-03-01T01:26:33.251ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
121002025-03-01T01:26:33.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
121012025-03-01T01:26:33.263ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 original_time_created = 2025-03-01 01:14:50.436545 UTC target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 time_created = 2025-03-01 01:14:50.436545 UTC
121022025-03-01T01:26:33.263ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 49.785014ms iteration = 71 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7","time_created":"2025-03-01T01:14:50.436545Z"}
121032025-03-01T01:26:33.272ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 58.246987ms iteration = 71 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
121042025-03-01T01:26:33.455ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 94d743af-707b-4ada-ba93-0965d8715c1f roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
121052025-03-01T01:26:33.456ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 94d743af-707b-4ada-ba93-0965d8715c1f resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
121062025-03-01T01:26:33.457ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1770 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 94d743af-707b-4ada-ba93-0965d8715c1f response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
121072025-03-01T01:26:34.477ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = d1e82873-611b-44c2-a3b1-d593963ac5e7 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
121082025-03-01T01:26:34.478ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = d1e82873-611b-44c2-a3b1-d593963ac5e7 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
121092025-03-01T01:26:34.479ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2313 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = d1e82873-611b-44c2-a3b1-d593963ac5e7 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
121102025-03-01T01:26:35.500ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 75ff50e9-11ce-4fb8-9edd-b5ddd415e28b roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
121112025-03-01T01:26:35.500ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 75ff50e9-11ce-4fb8-9edd-b5ddd415e28b resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
121122025-03-01T01:26:35.502ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2166 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 75ff50e9-11ce-4fb8-9edd-b5ddd415e28b response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
121132025-03-01T01:26:36.521ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c6199182-e01c-464e-8f2a-30d54a143dd8 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
121142025-03-01T01:26:36.522ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c6199182-e01c-464e-8f2a-30d54a143dd8 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
121152025-03-01T01:26:36.524ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2282 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c6199182-e01c-464e-8f2a-30d54a143dd8 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
121162025-03-01T01:26:37.414ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 390 local_addr = [fd00:1122:3344:101::c]:34357 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = 8ee8c41a-e763-4de7-94d6-50e6287bae33 response_code = 200 uri = /67b03f4e-4cbd-4843-9cd9-647f610abcfc
121172025-03-01T01:26:37.543ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 54e6426a-ad8f-4cdd-afc2-349e082ce334 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
121182025-03-01T01:26:37.544ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 54e6426a-ad8f-4cdd-afc2-349e082ce334 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
121192025-03-01T01:26:37.546ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2212 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 54e6426a-ad8f-4cdd-afc2-349e082ce334 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
121202025-03-01T01:26:38.565ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 63f1f4a4-c663-4301-a666-e5e65585c241 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
121212025-03-01T01:26:38.565ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 63f1f4a4-c663-4301-a666-e5e65585c241 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
121222025-03-01T01:26:38.567ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2613 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 63f1f4a4-c663-4301-a666-e5e65585c241 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
121232025-03-01T01:26:39.587ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 255a8666-c91f-419c-b79e-e45807e6bdb8 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
121242025-03-01T01:26:39.587ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 255a8666-c91f-419c-b79e-e45807e6bdb8 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
121252025-03-01T01:26:39.589ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2245 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 255a8666-c91f-419c-b79e-e45807e6bdb8 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
121262025-03-01T01:26:40.608ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = ff40d5b5-55ab-43ac-90e9-7be84eb1a117 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
121272025-03-01T01:26:40.609ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = ff40d5b5-55ab-43ac-90e9-7be84eb1a117 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
121282025-03-01T01:26:40.610ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1904 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = ff40d5b5-55ab-43ac-90e9-7be84eb1a117 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
121292025-03-01T01:26:41.629ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = b38cf038-d8bb-4704-8c9a-a5a662f94e91 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
121302025-03-01T01:26:41.630ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = b38cf038-d8bb-4704-8c9a-a5a662f94e91 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
121312025-03-01T01:26:41.632ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2480 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = b38cf038-d8bb-4704-8c9a-a5a662f94e91 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
121322025-03-01T01:26:42.652ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 75c31939-62c2-463f-98ad-f5bad91fa863 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
121332025-03-01T01:26:42.652ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 75c31939-62c2-463f-98ad-f5bad91fa863 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
121342025-03-01T01:26:42.654ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2209 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 75c31939-62c2-463f-98ad-f5bad91fa863 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
121352025-03-01T01:26:43.214ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 72 reason = Timeout
121362025-03-01T01:26:43.214ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 72 reason = Timeout
121372025-03-01T01:26:43.214ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
121382025-03-01T01:26:43.214ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
121392025-03-01T01:26:43.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
121402025-03-01T01:26:43.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
121412025-03-01T01:26:43.216ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
121422025-03-01T01:26:43.216ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
121432025-03-01T01:26:43.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
121442025-03-01T01:26:43.219ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
121452025-03-01T01:26:43.219ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
121462025-03-01T01:26:43.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
121472025-03-01T01:26:43.221ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
121482025-03-01T01:26:43.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
121492025-03-01T01:26:43.244ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 29.732906ms iteration = 72 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
121502025-03-01T01:26:43.250ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
121512025-03-01T01:26:43.253ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7, lookup_type: ById(8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7) } result = Ok(())
121522025-03-01T01:26:43.253ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
121532025-03-01T01:26:43.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
121542025-03-01T01:26:43.264ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 original_time_created = 2025-03-01 01:14:50.436545 UTC target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 time_created = 2025-03-01 01:14:50.436545 UTC
121552025-03-01T01:26:43.264ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 50.382627ms iteration = 72 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7","time_created":"2025-03-01T01:14:50.436545Z"}
121562025-03-01T01:26:43.675ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 1250a465-add2-4507-a69b-9e3618b4c043 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
121572025-03-01T01:26:43.675ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 1250a465-add2-4507-a69b-9e3618b4c043 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
121582025-03-01T01:26:43.677ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2534 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 1250a465-add2-4507-a69b-9e3618b4c043 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
121592025-03-01T01:26:44.697ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = eda1586d-5940-4e99-bd92-7c0e2e701946 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
121602025-03-01T01:26:44.698ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = eda1586d-5940-4e99-bd92-7c0e2e701946 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
121612025-03-01T01:26:44.699ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2068 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = eda1586d-5940-4e99-bd92-7c0e2e701946 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
121622025-03-01T01:26:45.718ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = ac866319-d7b7-4607-bf2d-ca163e7d55c4 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
121632025-03-01T01:26:45.718ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = ac866319-d7b7-4607-bf2d-ca163e7d55c4 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
121642025-03-01T01:26:45.720ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2249 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = ac866319-d7b7-4607-bf2d-ca163e7d55c4 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
121652025-03-01T01:26:46.739ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 37c44681-8d30-4ec1-b0b1-8ebe755e95e1 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
121662025-03-01T01:26:46.739ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 37c44681-8d30-4ec1-b0b1-8ebe755e95e1 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
121672025-03-01T01:26:46.741ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2369 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 37c44681-8d30-4ec1-b0b1-8ebe755e95e1 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
121682025-03-01T01:26:47.414ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 360 local_addr = [fd00:1122:3344:101::c]:34357 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = db36c1bb-1030-4615-bb13-5b778a78e693 response_code = 200 uri = /67b03f4e-4cbd-4843-9cd9-647f610abcfc
121692025-03-01T01:26:47.760ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = f7694cce-6ba0-4df7-b6e7-e6ccebd31542 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
121702025-03-01T01:26:47.760ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = f7694cce-6ba0-4df7-b6e7-e6ccebd31542 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
121712025-03-01T01:26:47.762ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2389 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = f7694cce-6ba0-4df7-b6e7-e6ccebd31542 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
121722025-03-01T01:26:48.782ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 99ffce84-6cbc-4682-8381-b7c168ad8b42 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
121732025-03-01T01:26:48.782ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 99ffce84-6cbc-4682-8381-b7c168ad8b42 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
121742025-03-01T01:26:48.784ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2275 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 99ffce84-6cbc-4682-8381-b7c168ad8b42 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
121752025-03-01T01:26:49.804ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = d6367cbb-a8cd-408c-aa4f-c9ab31d57733 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
121762025-03-01T01:26:49.804ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = d6367cbb-a8cd-408c-aa4f-c9ab31d57733 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
121772025-03-01T01:26:49.806ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2109 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = d6367cbb-a8cd-408c-aa4f-c9ab31d57733 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
121782025-03-01T01:26:50.826ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = dc500f03-0999-4de1-8d39-02059307ff49 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
121792025-03-01T01:26:50.826ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = dc500f03-0999-4de1-8d39-02059307ff49 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
121802025-03-01T01:26:50.828ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2707 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = dc500f03-0999-4de1-8d39-02059307ff49 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
121812025-03-01T01:26:51.849ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 2918809b-751e-4fc6-90d5-e62f0f40c223 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
121822025-03-01T01:26:51.849ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 2918809b-751e-4fc6-90d5-e62f0f40c223 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
121832025-03-01T01:26:51.851ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2211 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 2918809b-751e-4fc6-90d5-e62f0f40c223 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
121842025-03-01T01:26:52.407ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38629 req_id = 647c3846-5421-494a-871f-b7a57e0896bf roles = RoleSet { roles: {} } uri = /metrics/collectors/d77aa5d6-e6f9-4845-b1d4-57f91a3621e6/producers?sort_by=id_ascending
121852025-03-01T01:26:52.407ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38629 req_id = 647c3846-5421-494a-871f-b7a57e0896bf resource = Database result = Ok(()) uri = /metrics/collectors/d77aa5d6-e6f9-4845-b1d4-57f91a3621e6/producers?sort_by=id_ascending
121862025-03-01T01:26:52.410ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3122 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38629 req_id = 647c3846-5421-494a-871f-b7a57e0896bf response_code = 200 uri = /metrics/collectors/d77aa5d6-e6f9-4845-b1d4-57f91a3621e6/producers?sort_by=id_ascending
121872025-03-01T01:26:52.410ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38629 req_id = d0420c0a-7dcb-462f-aa58-07fea87d1c51 roles = RoleSet { roles: {} } uri = /metrics/collectors/d77aa5d6-e6f9-4845-b1d4-57f91a3621e6/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYmI0ODUwMS0zYzRlLTRkNDQtODgyMy1mOTc1ZTg2OTFmZmYifX0%3D
121882025-03-01T01:26:52.410ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38629 req_id = d0420c0a-7dcb-462f-aa58-07fea87d1c51 resource = Database result = Ok(()) uri = /metrics/collectors/d77aa5d6-e6f9-4845-b1d4-57f91a3621e6/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYmI0ODUwMS0zYzRlLTRkNDQtODgyMy1mOTc1ZTg2OTFmZmYifX0%3D
121892025-03-01T01:26:52.413ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2589 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38629 req_id = d0420c0a-7dcb-462f-aa58-07fea87d1c51 response_code = 200 uri = /metrics/collectors/d77aa5d6-e6f9-4845-b1d4-57f91a3621e6/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYmI0ODUwMS0zYzRlLTRkNDQtODgyMy1mOTc1ZTg2OTFmZmYifX0%3D
121902025-03-01T01:26:52.869ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = e08d81ca-f077-4ec3-b18f-9cfd787ee159 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
121912025-03-01T01:26:52.869ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = e08d81ca-f077-4ec3-b18f-9cfd787ee159 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
121922025-03-01T01:26:52.870ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1913 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = e08d81ca-f077-4ec3-b18f-9cfd787ee159 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
121932025-03-01T01:26:53.214ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 13 reason = Timeout
121942025-03-01T01:26:53.214ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 25 reason = Timeout
121952025-03-01T01:26:53.214ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-03-01 01:16:53.214218481 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
121962025-03-01T01:26:53.214ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
121972025-03-01T01:26:53.214ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
121982025-03-01T01:26:53.214ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 25 reason = Timeout
121992025-03-01T01:26:53.214ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 25 reason = Timeout
122002025-03-01T01:26:53.214ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
122012025-03-01T01:26:53.214ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
122022025-03-01T01:26:53.214ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 25 reason = Timeout
122032025-03-01T01:26:53.214ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 25 reason = Timeout
122042025-03-01T01:26:53.214ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
122052025-03-01T01:26:53.214ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
122062025-03-01T01:26:53.214ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 25 reason = Timeout
122072025-03-01T01:26:53.214ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
122082025-03-01T01:26:53.214ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 25 reason = Timeout
122092025-03-01T01:26:53.214ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 25 reason = Timeout
122102025-03-01T01:26:53.214ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 14 reason = Timeout
122112025-03-01T01:26:53.214ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7
122122025-03-01T01:26:53.214ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
122132025-03-01T01:26:53.214ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 10.71\u{b5}s iteration = 14 status = {"enabled":false,"target_id":"8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7"}
122142025-03-01T01:26:53.214ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 13 reason = Timeout
122152025-03-01T01:26:53.214ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 13 reason = Timeout
122162025-03-01T01:26:53.214ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
122172025-03-01T01:26:53.214ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
122182025-03-01T01:26:53.214ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 13 reason = Timeout
122192025-03-01T01:26:53.214ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
122202025-03-01T01:26:53.214ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 13 reason = Timeout
122212025-03-01T01:26:53.214ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
122222025-03-01T01:26:53.214ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
122232025-03-01T01:26:53.214ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 73 reason = Timeout
122242025-03-01T01:26:53.214ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
122252025-03-01T01:26:53.214ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 13 reason = Timeout
122262025-03-01T01:26:53.214ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
122272025-03-01T01:26:53.214ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 73 reason = Timeout
122282025-03-01T01:26:53.214ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
122292025-03-01T01:26:53.214ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 26 reason = Timeout
122302025-03-01T01:26:53.214ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
122312025-03-01T01:26:53.214ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 26 reason = Timeout
122322025-03-01T01:26:53.214ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
122332025-03-01T01:26:53.214ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
122342025-03-01T01:26:53.214ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 25 reason = Timeout
122352025-03-01T01:26:53.214ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
122362025-03-01T01:26:53.214ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 27 reason = Timeout
122372025-03-01T01:26:53.214ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 15 reason = Timeout
122382025-03-01T01:26:53.214ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
122392025-03-01T01:26:53.214ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 6 reason = Timeout
122402025-03-01T01:26:53.214ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
122412025-03-01T01:26:53.214ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 25 reason = Timeout
122422025-03-01T01:26:53.214ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 13 reason = Timeout
122432025-03-01T01:26:53.215ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
122442025-03-01T01:26:53.215ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
122452025-03-01T01:26:53.215ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
122462025-03-01T01:26:53.215ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 13 reason = Timeout
122472025-03-01T01:26:53.215ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 15 reason = Timeout
122482025-03-01T01:26:53.215ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 13 reason = Timeout
122492025-03-01T01:26:53.215ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
122502025-03-01T01:26:53.215ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 13 reason = Timeout
122512025-03-01T01:26:53.215ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
122522025-03-01T01:26:53.215ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 25 reason = Timeout
122532025-03-01T01:26:53.215ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
122542025-03-01T01:26:53.215ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 25 reason = Timeout
122552025-03-01T01:26:53.215ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
122562025-03-01T01:26:53.215ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 25 reason = Timeout
122572025-03-01T01:26:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
122582025-03-01T01:26:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
122592025-03-01T01:26:53.215ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
122602025-03-01T01:26:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
122612025-03-01T01:26:53.215ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
122622025-03-01T01:26:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
122632025-03-01T01:26:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
122642025-03-01T01:26:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
122652025-03-01T01:26:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
122662025-03-01T01:26:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
122672025-03-01T01:26:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
122682025-03-01T01:26:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
122692025-03-01T01:26:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
122702025-03-01T01:26:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
122712025-03-01T01:26:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
122722025-03-01T01:26:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
122732025-03-01T01:26:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
122742025-03-01T01:26:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
122752025-03-01T01:26:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
122762025-03-01T01:26:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
122772025-03-01T01:26:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
122782025-03-01T01:26:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
122792025-03-01T01:26:53.215ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
122802025-03-01T01:26:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
122812025-03-01T01:26:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
122822025-03-01T01:26:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
122832025-03-01T01:26:53.215ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2e37f4af-57dc-468e-80e3-cf2aea2ffdc8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5f6eb3bd-0126-40e0-98ef-ee33df084158.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("5f6eb3bd-0126-40e0-98ef-ee33df084158.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1623, tv_nsec: 903358556 } })
122842025-03-01T01:26:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
122852025-03-01T01:26:53.215ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("3a9b8294-d9f3-4130-a669-e74c6f1f65a0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("450e8d93-9ed3-4721-9fe9-42521f60bc93.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a4f72c78-99c6-478d-b490-f7d8793d4173.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("a4f72c78-99c6-478d-b490-f7d8793d4173.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1623, tv_nsec: 903389557 } })
122862025-03-01T01:26:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
122872025-03-01T01:26:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
122882025-03-01T01:26:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
122892025-03-01T01:26:53.215ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
122902025-03-01T01:26:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
122912025-03-01T01:26:53.215ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
122922025-03-01T01:26:53.215ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
122932025-03-01T01:26:53.215ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.066502ms iteration = 13 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
122942025-03-01T01:26:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
122952025-03-01T01:26:53.215ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
122962025-03-01T01:26:53.215ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
122972025-03-01T01:26:53.215ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.391058ms iteration = 13 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
122982025-03-01T01:26:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
122992025-03-01T01:26:53.217ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1623, tv_nsec: 905485559 } })
123002025-03-01T01:26:53.217ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1154
123012025-03-01T01:26:53.217ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-03-01 01:16:53.214218481 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
123022025-03-01T01:26:53.217ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 3.679855ms iteration = 13 status = {"expiration":"2025-03-01T01:16:53.214218481Z","pruned":[]}
123032025-03-01T01:26:53.218ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.678484ms iteration = 25 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
123042025-03-01T01:26:53.218ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
123052025-03-01T01:26:53.219ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
123062025-03-01T01:26:53.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
123072025-03-01T01:26:53.220ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
123082025-03-01T01:26:53.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
123092025-03-01T01:26:53.221ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
123102025-03-01T01:26:53.221ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
123112025-03-01T01:26:53.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
123122025-03-01T01:26:53.224ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
123132025-03-01T01:26:53.224ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
123142025-03-01T01:26:53.225ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
123152025-03-01T01:26:53.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
123162025-03-01T01:26:53.226ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 12.221939ms iteration = 13 status = {"errors":[],"found_port_ok":[]}
123172025-03-01T01:26:53.227ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
123182025-03-01T01:26:53.227ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
123192025-03-01T01:26:53.227ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
123202025-03-01T01:26:53.227ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
123212025-03-01T01:26:53.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
123222025-03-01T01:26:53.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
123232025-03-01T01:26:53.229ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
123242025-03-01T01:26:53.229ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
123252025-03-01T01:26:53.231ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1623, tv_nsec: 919130337 } })
123262025-03-01T01:26:53.231ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1154
123272025-03-01T01:26:53.233ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
123282025-03-01T01:26:53.233ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
123292025-03-01T01:26:53.233ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
123302025-03-01T01:26:53.233ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
123312025-03-01T01:26:53.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
123322025-03-01T01:26:53.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
123332025-03-01T01:26:53.235ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
123342025-03-01T01:26:53.237ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
123352025-03-01T01:26:53.238ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
123362025-03-01T01:26:53.238ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
123372025-03-01T01:26:53.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
123382025-03-01T01:26:53.239ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
123392025-03-01T01:26:53.242ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
123402025-03-01T01:26:53.242ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
123412025-03-01T01:26:53.242ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
123422025-03-01T01:26:53.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
123432025-03-01T01:26:53.244ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
123442025-03-01T01:26:53.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
123452025-03-01T01:26:53.247ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
123462025-03-01T01:26:53.249ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
123472025-03-01T01:26:53.250ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
123482025-03-01T01:26:53.253ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
123492025-03-01T01:26:53.253ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
123502025-03-01T01:26:53.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
123512025-03-01T01:26:53.254ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 39.987035ms iteration = 25 status = {"errors":[],"garbage_collect_requested":[]}
123522025-03-01T01:26:53.258ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
123532025-03-01T01:26:53.259ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
123542025-03-01T01:26:53.260ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
123552025-03-01T01:26:53.261ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 46.432715ms iteration = 25 status = {"errors":[],"finish_invoked_ok":[]}
123562025-03-01T01:26:53.261ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
123572025-03-01T01:26:53.261ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
123582025-03-01T01:26:53.261ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
123592025-03-01T01:26:53.262ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
123602025-03-01T01:26:53.263ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
123612025-03-01T01:26:53.265ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
123622025-03-01T01:26:53.265ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
123632025-03-01T01:26:53.265ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
123642025-03-01T01:26:53.266ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
123652025-03-01T01:26:53.267ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
123662025-03-01T01:26:53.267ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
123672025-03-01T01:26:53.267ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
123682025-03-01T01:26:53.268ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
123692025-03-01T01:26:53.268ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
123702025-03-01T01:26:53.268ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
123712025-03-01T01:26:53.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
123722025-03-01T01:26:53.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
123732025-03-01T01:26:53.272ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
123742025-03-01T01:26:53.272ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
123752025-03-01T01:26:53.272ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
123762025-03-01T01:26:53.272ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
123772025-03-01T01:26:53.272ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
123782025-03-01T01:26:53.272ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
123792025-03-01T01:26:53.272ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
123802025-03-01T01:26:53.272ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
123812025-03-01T01:26:53.273ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
123822025-03-01T01:26:53.273ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
123832025-03-01T01:26:53.273ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 59.247367ms iteration = 13 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
123842025-03-01T01:26:53.281ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 67.172069ms iteration = 73 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
123852025-03-01T01:26:53.286ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
123862025-03-01T01:26:53.288ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
123872025-03-01T01:26:53.288ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
123882025-03-01T01:26:53.288ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
123892025-03-01T01:26:53.288ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
123902025-03-01T01:26:53.289ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
123912025-03-01T01:26:53.289ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
123922025-03-01T01:26:53.289ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
123932025-03-01T01:26:53.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
123942025-03-01T01:26:53.291ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
123952025-03-01T01:26:53.292ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
123962025-03-01T01:26:53.292ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
123972025-03-01T01:26:53.292ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
123982025-03-01T01:26:53.292ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
123992025-03-01T01:26:53.292ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
124002025-03-01T01:26:53.293ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
124012025-03-01T01:26:53.293ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
124022025-03-01T01:26:53.293ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
124032025-03-01T01:26:53.293ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
124042025-03-01T01:26:53.294ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
124052025-03-01T01:26:53.295ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
124062025-03-01T01:26:53.295ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
124072025-03-01T01:26:53.295ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
124082025-03-01T01:26:53.295ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
124092025-03-01T01:26:53.295ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
124102025-03-01T01:26:53.296ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
124112025-03-01T01:26:53.296ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
124122025-03-01T01:26:53.296ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
124132025-03-01T01:26:53.298ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7, lookup_type: ById(8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7) } result = Ok(())
124142025-03-01T01:26:53.298ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
124152025-03-01T01:26:53.299ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
124162025-03-01T01:26:53.301ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
124172025-03-01T01:26:53.301ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
124182025-03-01T01:26:53.301ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
124192025-03-01T01:26:53.301ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
124202025-03-01T01:26:53.301ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
124212025-03-01T01:26:53.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
124222025-03-01T01:26:53.301ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
124232025-03-01T01:26:53.302ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1623, tv_nsec: 990299267 } })
124242025-03-01T01:26:53.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
124252025-03-01T01:26:53.302ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1154 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66
124262025-03-01T01:26:53.304ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
124272025-03-01T01:26:53.304ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
124282025-03-01T01:26:53.304ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
124292025-03-01T01:26:53.304ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
124302025-03-01T01:26:53.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
124312025-03-01T01:26:53.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
124322025-03-01T01:26:53.305ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
124332025-03-01T01:26:53.305ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
124342025-03-01T01:26:53.305ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
124352025-03-01T01:26:53.305ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
124362025-03-01T01:26:53.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
124372025-03-01T01:26:53.307ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 93.440133ms iteration = 6 status = {"nsuccess":5}
124382025-03-01T01:26:53.308ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
124392025-03-01T01:26:53.308ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
124402025-03-01T01:26:53.308ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 93.845682ms iteration = 13 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
124412025-03-01T01:26:53.309ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
124422025-03-01T01:26:53.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
124432025-03-01T01:26:53.311ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
124442025-03-01T01:26:53.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
124452025-03-01T01:26:53.312ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
124462025-03-01T01:26:53.313ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
124472025-03-01T01:26:53.314ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 original_time_created = 2025-03-01 01:14:50.436545 UTC target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 time_created = 2025-03-01 01:14:50.436545 UTC
124482025-03-01T01:26:53.314ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 99.754992ms iteration = 73 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7","time_created":"2025-03-01T01:14:50.436545Z"}
124492025-03-01T01:26:53.316ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
124502025-03-01T01:26:53.316ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
124512025-03-01T01:26:53.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
124522025-03-01T01:26:53.317ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 3471264f-127e-4a25-bc10-2e8249e8d70a, lookup_type: ById(3471264f-127e-4a25-bc10-2e8249e8d70a) } result = Ok(())
124532025-03-01T01:26:53.317ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
124542025-03-01T01:26:53.317ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
124552025-03-01T01:26:53.319ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 104.937338ms iteration = 25 status = 0
124562025-03-01T01:26:53.322ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
124572025-03-01T01:26:53.322ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 108.381458ms iteration = 25 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
124582025-03-01T01:26:53.325ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 111.219106ms iteration = 25 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
124592025-03-01T01:26:53.326ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
124602025-03-01T01:26:53.327ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
124612025-03-01T01:26:53.330ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
124622025-03-01T01:26:53.331ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
124632025-03-01T01:26:53.332ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 118.037374ms iteration = 25 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
124642025-03-01T01:26:53.332ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
124652025-03-01T01:26:53.335ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
124662025-03-01T01:26:53.335ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 120.665938ms iteration = 25 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
124672025-03-01T01:26:53.335ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
124682025-03-01T01:26:53.335ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
124692025-03-01T01:26:53.336ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
124702025-03-01T01:26:53.336ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 122.696419ms iteration = 25 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
124712025-03-01T01:26:53.345ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
124722025-03-01T01:26:53.345ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 0a9e4b5c-53a1-4f0a-8849-98a8b1852af3 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
124732025-03-01T01:26:53.345ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
124742025-03-01T01:26:53.345ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
124752025-03-01T01:26:53.346ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
124762025-03-01T01:26:53.350ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
124772025-03-01T01:26:53.350ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
124782025-03-01T01:26:53.350ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
124792025-03-01T01:26:53.350ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
124802025-03-01T01:26:53.350ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
124812025-03-01T01:26:53.350ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 136.138253ms iteration = 25 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
124822025-03-01T01:26:53.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
124832025-03-01T01:26:53.353ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
124842025-03-01T01:26:53.353ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
124852025-03-01T01:26:53.353ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
124862025-03-01T01:26:53.353ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
124872025-03-01T01:26:53.355ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
124882025-03-01T01:26:53.355ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
124892025-03-01T01:26:53.355ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "de8b2c58-e74c-44a6-a575-7da28fd3cf57", "content-length": "26", "date": "Sat, 01 Mar 2025 01:26:53 GMT"} })
124902025-03-01T01:26:53.355ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
124912025-03-01T01:26:53.356ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 0a9e4b5c-53a1-4f0a-8849-98a8b1852af3 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
124922025-03-01T01:26:53.356ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
124932025-03-01T01:26:53.356ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-03-01 01:14:53.460216 UTC dns_group = internal generation = 1
124942025-03-01T01:26:53.356ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 141.707077ms iteration = 13 status = {"generation":1}
124952025-03-01T01:26:53.357ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
124962025-03-01T01:26:53.358ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
124972025-03-01T01:26:53.388ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
124982025-03-01T01:26:53.389ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
124992025-03-01T01:26:53.390ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
125002025-03-01T01:26:53.390ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
125012025-03-01T01:26:53.390ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "85498d2b-f90c-41b9-b2ec-d8d9fbd436b2", "content-length": "26", "date": "Sat, 01 Mar 2025 01:26:53 GMT"} })
125022025-03-01T01:26:53.390ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
125032025-03-01T01:26:53.393ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-03-01T01:14:49.537343Z, time_modified: 2025-03-01T01:14:49.537343Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 1682a303-6254-452b-b4cf-160ed9dc3fc9, db_silo: Silo { identity: SiloIdentity { id: 1682a303-6254-452b-b4cf-160ed9dc3fc9, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-03-01T01:14:54.631650Z, time_modified: 2025-03-01T01:14:54.631650Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "851c0b739689cfb98a2e401e6047fa98e9fcc283d9fc3f660bd69842a9c06be9" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 1682a303-6254-452b-b4cf-160ed9dc3fc9, db_silo: Silo { identity: SiloIdentity { id: 1682a303-6254-452b-b4cf-160ed9dc3fc9, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-03-01T01:14:54.631650Z, time_modified: 2025-03-01T01:14:54.631650Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "851c0b739689cfb98a2e401e6047fa98e9fcc283d9fc3f660bd69842a9c06be9" }] }) }
125042025-03-01T01:26:53.393ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 179.311912ms iteration = 13 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"1682a303-6254-452b-b4cf-160ed9dc3fc9","tls_certs":["851c0b739689cfb98a2e401e6047fa98e9fcc283d9fc3f660bd69842a9c06be9"]}},"default_endpoint":{"silo_id":"1682a303-6254-452b-b4cf-160ed9dc3fc9","tls_certs":["851c0b739689cfb98a2e401e6047fa98e9fcc283d9fc3f660bd69842a9c06be9"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
125052025-03-01T01:26:53.403ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
125062025-03-01T01:26:53.405ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
125072025-03-01T01:26:53.405ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = cce65e3e-6c86-4cdd-98ad-9a38c98082e8 dns_zone_name = oxide.test found_so_far = 0 version = 2
125082025-03-01T01:26:53.405ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
125092025-03-01T01:26:53.406ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
125102025-03-01T01:26:53.408ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
125112025-03-01T01:26:53.412ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
125122025-03-01T01:26:53.412ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
125132025-03-01T01:26:53.412ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
125142025-03-01T01:26:53.419ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = cce65e3e-6c86-4cdd-98ad-9a38c98082e8 dns_zone_name = oxide.test found_so_far = 1 version = 2
125152025-03-01T01:26:53.419ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
125162025-03-01T01:26:53.419ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-03-01 01:14:54.679503 UTC dns_group = external generation = 2
125172025-03-01T01:26:53.419ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 204.974146ms iteration = 13 status = {"generation":2}
125182025-03-01T01:26:53.457ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
125192025-03-01T01:26:53.457ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
125202025-03-01T01:26:53.472ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 257.748361ms iteration = 27 status = {"physical_disks_added":0}
125212025-03-01T01:26:53.474ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1162 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 zone_address = fd00:1122:3344:101::2
125222025-03-01T01:26:53.474ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
125232025-03-01T01:26:53.474ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
125242025-03-01T01:26:53.474ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 259.788352ms iteration = 13 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
125252025-03-01T01:26:53.475ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ae8a0f2f-049d-4c81-97c3-a9d154a21050", "content-length": "26", "date": "Sat, 01 Mar 2025 01:26:53 GMT"} })
125262025-03-01T01:26:53.475ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1167 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
125272025-03-01T01:26:53.477ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66
125282025-03-01T01:26:53.524ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
125292025-03-01T01:26:53.525ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "36c1df07-0617-472f-a371-ba2e4a32d30f", "content-length": "2", "date": "Sat, 01 Mar 2025 01:26:53 GMT"} })
125302025-03-01T01:26:53.527ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
125312025-03-01T01:26:53.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
125322025-03-01T01:26:53.530ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
125332025-03-01T01:26:53.558ZINFOnexus (BackgroundTasks): VPC route manager sled 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
125342025-03-01T01:26:53.558ZDEBGnexus (BackgroundTasks): client request SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
125352025-03-01T01:26:53.559ZDEBGnexus (BackgroundTasks): client response SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "09b5c06b-ed10-483e-afdb-8268c8390361", "content-length": "372", "date": "Sat, 01 Mar 2025 01:26:53 GMT"} })
125362025-03-01T01:26:53.559ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
125372025-03-01T01:26:53.560ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
125382025-03-01T01:26:53.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
125392025-03-01T01:26:53.561ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 346.947317ms iteration = 25 status = null
125402025-03-01T01:26:53.563ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
125412025-03-01T01:26:53.563ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
125422025-03-01T01:26:53.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
125432025-03-01T01:26:53.565ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
125442025-03-01T01:26:53.565ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
125452025-03-01T01:26:53.565ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "0f0307d4-c195-4963-a6e8-67c8b7887aaf", "date": "Sat, 01 Mar 2025 01:26:53 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
125462025-03-01T01:26:53.565ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
125472025-03-01T01:26:53.567ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
125482025-03-01T01:26:53.567ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
125492025-03-01T01:26:53.567ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
125502025-03-01T01:26:53.567ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "7cabcb43-8f86-4760-97e8-a62ecba5105f", "date": "Sat, 01 Mar 2025 01:26:53 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
125512025-03-01T01:26:53.567ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
125522025-03-01T01:26:53.569ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
125532025-03-01T01:26:53.569ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 355.023753ms iteration = 15 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
125542025-03-01T01:26:53.577ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 362.77667ms iteration = 25 status = {}
125552025-03-01T01:26:53.603ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
125562025-03-01T01:26:53.604ZDEBGnexus (BackgroundTasks): client request SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
125572025-03-01T01:26:53.609ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
125582025-03-01T01:26:53.610ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "c50e2d1d-41d7-4a7e-953a-17a70b98aa9d", "date": "Sat, 01 Mar 2025 01:26:53 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
125592025-03-01T01:26:53.610ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
125602025-03-01T01:26:53.615ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "21997eb1-08a2-4ed1-be6f-1ad286ad01c6", "date": "Sat, 01 Mar 2025 01:26:53 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
125612025-03-01T01:26:53.615ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
125622025-03-01T01:26:53.616ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "df00f5b3-c49d-496c-8d2e-4b46c7798e1a", "date": "Sat, 01 Mar 2025 01:26:53 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
125632025-03-01T01:26:53.616ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
125642025-03-01T01:26:53.619ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
125652025-03-01T01:26:53.619ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 404.435659ms iteration = 15 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
125662025-03-01T01:26:53.684ZDEBGnexus (BackgroundTasks): client response SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "c14a2a6e-a8bf-4c19-b81f-6d298c1dc314", "date": "Sat, 01 Mar 2025 01:26:53 GMT"} })
125672025-03-01T01:26:53.684ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
125682025-03-01T01:26:53.684ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
125692025-03-01T01:26:53.687ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
125702025-03-01T01:26:53.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
125712025-03-01T01:26:53.689ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
125722025-03-01T01:26:53.690ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
125732025-03-01T01:26:53.693ZINFOnexus (BackgroundTasks): VPC route manager sled 3471264f-127e-4a25-bc10-2e8249e8d70a push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
125742025-03-01T01:26:53.693ZDEBGnexus (BackgroundTasks): client request SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
125752025-03-01T01:26:53.693ZDEBGnexus (BackgroundTasks): client response SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "f371f4ad-8423-48df-859e-163902724b5a", "date": "Sat, 01 Mar 2025 01:26:53 GMT"} })
125762025-03-01T01:26:53.695ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 481.384206ms iteration = 26 status = {}
125772025-03-01T01:26:53.704ZDEBGnexus (BackgroundTasks): client request SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
125782025-03-01T01:26:53.704ZDEBGnexus (BackgroundTasks): client response SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "fd7b5b56-cfd0-4109-841b-520fa13ce4b4", "content-length": "691", "date": "Sat, 01 Mar 2025 01:26:53 GMT"} })
125792025-03-01T01:26:53.704ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
125802025-03-01T01:26:53.704ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
125812025-03-01T01:26:53.704ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
125822025-03-01T01:26:53.706ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 492.282138ms iteration = 26 status = {}
125832025-03-01T01:26:53.710ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
125842025-03-01T01:26:53.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
125852025-03-01T01:26:53.712ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 7f9c3c14-58c5-473f-8692-6376be44401e, rack_id: 4854cb88-dfba-4609-8f9d-72aac08cef66, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(cb10d0c6-a704-4231-b148-4f9ae21a03f8) } rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 switch_location = Switch0
125862025-03-01T01:26:53.712ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
125872025-03-01T01:26:53.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
125882025-03-01T01:26:53.722ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
125892025-03-01T01:26:53.722ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "7c1eca96-6b9c-4950-98a7-481506f5f7f8", "content-length": "134", "date": "Sat, 01 Mar 2025 01:26:53 GMT"} })
125902025-03-01T01:26:53.722ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
125912025-03-01T01:26:53.722ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = cb10d0c6-a704-4231-b148-4f9ae21a03f8
125922025-03-01T01:26:53.722ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
125932025-03-01T01:26:53.722ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
125942025-03-01T01:26:53.722ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
125952025-03-01T01:26:53.722ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
125962025-03-01T01:26:53.722ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
125972025-03-01T01:26:53.722ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
125982025-03-01T01:26:53.722ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
125992025-03-01T01:26:53.722ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
126002025-03-01T01:26:53.723ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66
126012025-03-01T01:26:53.723ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
126022025-03-01T01:26:53.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
126032025-03-01T01:26:53.724ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
126042025-03-01T01:26:53.724ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "2ecefe98-7209-4795-a74c-5c54fd3433f6", "content-length": "2", "date": "Sat, 01 Mar 2025 01:26:53 GMT"} })
126052025-03-01T01:26:53.725ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
126062025-03-01T01:26:53.725ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "071c7b34-17ca-48e6-b384-95d9b3ad3fb2", "content-length": "52", "date": "Sat, 01 Mar 2025 01:26:53 GMT"} })
126072025-03-01T01:26:53.725ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 switch_location = Switch0
126082025-03-01T01:26:53.725ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
126092025-03-01T01:26:53.817ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "f5e6239a-3657-4b1e-bc87-5d28b097baac", "date": "Sat, 01 Mar 2025 01:26:53 GMT"} })
126102025-03-01T01:26:53.817ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 switch = Switch0
126112025-03-01T01:26:53.817ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
126122025-03-01T01:26:53.817ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "3c615937-15df-4644-81a8-8b1f1f16b77b", "content-length": "682", "date": "Sat, 01 Mar 2025 01:26:53 GMT"} })
126132025-03-01T01:26:53.817ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
126142025-03-01T01:26:53.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
126152025-03-01T01:26:53.821ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
126162025-03-01T01:26:53.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
126172025-03-01T01:26:53.824ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
126182025-03-01T01:26:53.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
126192025-03-01T01:26:53.826ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
126202025-03-01T01:26:53.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
126212025-03-01T01:26:53.832ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 617.858716ms iteration = 25 status = {}
126222025-03-01T01:26:53.890ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 92e0f3ad-f095-4a70-a9d2-334c8d854f65 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
126232025-03-01T01:26:53.890ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 92e0f3ad-f095-4a70-a9d2-334c8d854f65 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
126242025-03-01T01:26:53.891ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1766 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 92e0f3ad-f095-4a70-a9d2-334c8d854f65 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
126252025-03-01T01:26:54.909ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 39ebb5b0-6022-42e4-bdbc-df0a54810eb1 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
126262025-03-01T01:26:54.910ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 39ebb5b0-6022-42e4-bdbc-df0a54810eb1 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
126272025-03-01T01:26:54.912ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2266 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 39ebb5b0-6022-42e4-bdbc-df0a54810eb1 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
126282025-03-01T01:26:55.930ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 9095b365-acc0-4b74-a0d9-0248a7ee5c7e roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
126292025-03-01T01:26:55.931ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 9095b365-acc0-4b74-a0d9-0248a7ee5c7e resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
126302025-03-01T01:26:55.933ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2327 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 9095b365-acc0-4b74-a0d9-0248a7ee5c7e response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
126312025-03-01T01:26:56.953ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 0e45b8d2-4aea-40ba-a2fc-60a7be773abe roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
126322025-03-01T01:26:56.953ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 0e45b8d2-4aea-40ba-a2fc-60a7be773abe resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
126332025-03-01T01:26:56.955ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2175 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 0e45b8d2-4aea-40ba-a2fc-60a7be773abe response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
126342025-03-01T01:26:57.414ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 377 local_addr = [fd00:1122:3344:101::c]:34357 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = cdecb77d-e71d-4e8a-afcb-4ae949c919df response_code = 200 uri = /67b03f4e-4cbd-4843-9cd9-647f610abcfc
126352025-03-01T01:26:57.974ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 12085230-c218-4310-90be-a24afa567463 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
126362025-03-01T01:26:57.975ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 12085230-c218-4310-90be-a24afa567463 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
126372025-03-01T01:26:57.977ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2787 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 12085230-c218-4310-90be-a24afa567463 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
126382025-03-01T01:26:58.998ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c5c9488e-7ab2-41b2-bed9-965e94dab3a6 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
126392025-03-01T01:26:58.998ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c5c9488e-7ab2-41b2-bed9-965e94dab3a6 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
126402025-03-01T01:26:59.000ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2136 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c5c9488e-7ab2-41b2-bed9-965e94dab3a6 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
126412025-03-01T01:27:00.021ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 7d421cea-9413-48ba-8fb7-bb830d90b901 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
126422025-03-01T01:27:00.021ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 7d421cea-9413-48ba-8fb7-bb830d90b901 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
126432025-03-01T01:27:00.023ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2426 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 7d421cea-9413-48ba-8fb7-bb830d90b901 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
126442025-03-01T01:27:01.042ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = e5456299-71ac-4c9a-9c33-e557e5bf9383 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
126452025-03-01T01:27:01.042ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = e5456299-71ac-4c9a-9c33-e557e5bf9383 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
126462025-03-01T01:27:01.044ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2206 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = e5456299-71ac-4c9a-9c33-e557e5bf9383 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
126472025-03-01T01:27:02.064ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 5ed1a9f4-9602-4925-9988-1f27c7c49bd7 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
126482025-03-01T01:27:02.064ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 5ed1a9f4-9602-4925-9988-1f27c7c49bd7 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
126492025-03-01T01:27:02.066ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2242 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 5ed1a9f4-9602-4925-9988-1f27c7c49bd7 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
126502025-03-01T01:27:03.086ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c9165c38-d8e6-4eb1-8874-afeca2c58039 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
126512025-03-01T01:27:03.086ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c9165c38-d8e6-4eb1-8874-afeca2c58039 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
126522025-03-01T01:27:03.088ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2210 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c9165c38-d8e6-4eb1-8874-afeca2c58039 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
126532025-03-01T01:27:03.214ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 74 reason = Timeout
126542025-03-01T01:27:03.214ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 74 reason = Timeout
126552025-03-01T01:27:03.214ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
126562025-03-01T01:27:03.214ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
126572025-03-01T01:27:03.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
126582025-03-01T01:27:03.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
126592025-03-01T01:27:03.216ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
126602025-03-01T01:27:03.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
126612025-03-01T01:27:03.216ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
126622025-03-01T01:27:03.218ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.889949ms iteration = 74 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
126632025-03-01T01:27:03.219ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
126642025-03-01T01:27:03.219ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
126652025-03-01T01:27:03.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
126662025-03-01T01:27:03.221ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
126672025-03-01T01:27:03.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
126682025-03-01T01:27:03.249ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
126692025-03-01T01:27:03.252ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7, lookup_type: ById(8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7) } result = Ok(())
126702025-03-01T01:27:03.252ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
126712025-03-01T01:27:03.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
126722025-03-01T01:27:03.264ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 original_time_created = 2025-03-01 01:14:50.436545 UTC target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 time_created = 2025-03-01 01:14:50.436545 UTC
126732025-03-01T01:27:03.264ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 50.150551ms iteration = 74 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7","time_created":"2025-03-01T01:14:50.436545Z"}
126742025-03-01T01:27:04.108ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 32740098-d992-4128-bbab-c79c1fde7609 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
126752025-03-01T01:27:04.108ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 32740098-d992-4128-bbab-c79c1fde7609 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
126762025-03-01T01:27:04.110ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2413 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 32740098-d992-4128-bbab-c79c1fde7609 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
126772025-03-01T01:27:05.130ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = d4013984-7004-433d-9ac5-f23098d1c0d9 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
126782025-03-01T01:27:05.131ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = d4013984-7004-433d-9ac5-f23098d1c0d9 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
126792025-03-01T01:27:05.133ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2710 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = d4013984-7004-433d-9ac5-f23098d1c0d9 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
126802025-03-01T01:27:06.153ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = d63a0a49-48f3-400b-9eca-47daa0af0d71 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
126812025-03-01T01:27:06.154ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = d63a0a49-48f3-400b-9eca-47daa0af0d71 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
126822025-03-01T01:27:06.156ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2322 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = d63a0a49-48f3-400b-9eca-47daa0af0d71 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
126832025-03-01T01:27:07.175ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 4bac6d08-f058-45b5-89d7-e4e35d7aac3b roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
126842025-03-01T01:27:07.175ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 4bac6d08-f058-45b5-89d7-e4e35d7aac3b resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
126852025-03-01T01:27:07.177ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2445 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 4bac6d08-f058-45b5-89d7-e4e35d7aac3b response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
126862025-03-01T01:27:07.414ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 385 local_addr = [fd00:1122:3344:101::c]:34357 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = 95d8d419-9a16-40df-be5f-2a3199b989b6 response_code = 200 uri = /67b03f4e-4cbd-4843-9cd9-647f610abcfc
126872025-03-01T01:27:08.197ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 79bdba29-cb57-46a5-9995-64ceacf71d50 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
126882025-03-01T01:27:08.197ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 79bdba29-cb57-46a5-9995-64ceacf71d50 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
126892025-03-01T01:27:08.199ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2278 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 79bdba29-cb57-46a5-9995-64ceacf71d50 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
126902025-03-01T01:27:09.218ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 5a77f397-ee43-4dbf-a17a-74fcc05dc3a7 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
126912025-03-01T01:27:09.218ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 5a77f397-ee43-4dbf-a17a-74fcc05dc3a7 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
126922025-03-01T01:27:09.220ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2427 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 5a77f397-ee43-4dbf-a17a-74fcc05dc3a7 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
126932025-03-01T01:27:10.239ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 342d29a3-7dfd-4cfa-b0e4-077ada47ea22 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
126942025-03-01T01:27:10.239ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 342d29a3-7dfd-4cfa-b0e4-077ada47ea22 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
126952025-03-01T01:27:10.241ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2131 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 342d29a3-7dfd-4cfa-b0e4-077ada47ea22 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
126962025-03-01T01:27:11.261ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 4250d33a-176e-473a-8068-4830bc40f3a8 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
126972025-03-01T01:27:11.261ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 4250d33a-176e-473a-8068-4830bc40f3a8 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
126982025-03-01T01:27:11.263ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2514 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 4250d33a-176e-473a-8068-4830bc40f3a8 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
126992025-03-01T01:27:12.283ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = d49aa595-0669-48ba-b4d1-94524cf96022 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
127002025-03-01T01:27:12.284ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = d49aa595-0669-48ba-b4d1-94524cf96022 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
127012025-03-01T01:27:12.286ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2568 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = d49aa595-0669-48ba-b4d1-94524cf96022 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
127022025-03-01T01:27:13.214ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 75 reason = Timeout
127032025-03-01T01:27:13.214ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
127042025-03-01T01:27:13.214ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 75 reason = Timeout
127052025-03-01T01:27:13.214ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
127062025-03-01T01:27:13.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
127072025-03-01T01:27:13.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
127082025-03-01T01:27:13.216ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
127092025-03-01T01:27:13.216ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
127102025-03-01T01:27:13.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
127112025-03-01T01:27:13.218ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.276207ms iteration = 75 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
127122025-03-01T01:27:13.218ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
127132025-03-01T01:27:13.218ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
127142025-03-01T01:27:13.218ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
127152025-03-01T01:27:13.220ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
127162025-03-01T01:27:13.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
127172025-03-01T01:27:13.222ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
127182025-03-01T01:27:13.224ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7, lookup_type: ById(8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7) } result = Ok(())
127192025-03-01T01:27:13.224ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
127202025-03-01T01:27:13.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
127212025-03-01T01:27:13.233ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 original_time_created = 2025-03-01 01:14:50.436545 UTC target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 time_created = 2025-03-01 01:14:50.436545 UTC
127222025-03-01T01:27:13.233ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.469827ms iteration = 75 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7","time_created":"2025-03-01T01:14:50.436545Z"}
127232025-03-01T01:27:13.305ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = e3a73f54-3004-4a9f-be11-b5102149d221 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
127242025-03-01T01:27:13.306ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = e3a73f54-3004-4a9f-be11-b5102149d221 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
127252025-03-01T01:27:13.307ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1914 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = e3a73f54-3004-4a9f-be11-b5102149d221 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
127262025-03-01T01:27:14.327ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 17ee225a-c511-40b6-9197-8cd9dd04786f roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
127272025-03-01T01:27:14.327ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 17ee225a-c511-40b6-9197-8cd9dd04786f resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
127282025-03-01T01:27:14.329ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2504 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 17ee225a-c511-40b6-9197-8cd9dd04786f response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
127292025-03-01T01:27:15.349ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 3f1d068b-a27f-4445-b62d-289c1863e095 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
127302025-03-01T01:27:15.349ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 3f1d068b-a27f-4445-b62d-289c1863e095 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
127312025-03-01T01:27:15.351ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2408 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 3f1d068b-a27f-4445-b62d-289c1863e095 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
127322025-03-01T01:27:16.372ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 1259b3dd-9110-42a1-b905-e9443ec31a3a roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
127332025-03-01T01:27:16.372ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 1259b3dd-9110-42a1-b905-e9443ec31a3a resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
127342025-03-01T01:27:16.374ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2558 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 1259b3dd-9110-42a1-b905-e9443ec31a3a response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
127352025-03-01T01:27:17.393ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 0e2d62a1-916b-4da6-8c14-a9649c0bd28d roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
127362025-03-01T01:27:17.394ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 0e2d62a1-916b-4da6-8c14-a9649c0bd28d resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
127372025-03-01T01:27:17.395ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2036 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 0e2d62a1-916b-4da6-8c14-a9649c0bd28d response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
127382025-03-01T01:27:17.414ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 375 local_addr = [fd00:1122:3344:101::c]:34357 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = 61737287-5c14-455e-8714-c41fd7509655 response_code = 200 uri = /67b03f4e-4cbd-4843-9cd9-647f610abcfc
127392025-03-01T01:27:18.415ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 90038921-1b98-4d2b-b5fd-dcc8ca25740f roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
127402025-03-01T01:27:18.415ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 90038921-1b98-4d2b-b5fd-dcc8ca25740f resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
127412025-03-01T01:27:18.417ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2559 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 90038921-1b98-4d2b-b5fd-dcc8ca25740f response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
127422025-03-01T01:27:19.437ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 9852de28-a56f-40c7-b0cc-2bbefb6cbe73 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
127432025-03-01T01:27:19.437ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 9852de28-a56f-40c7-b0cc-2bbefb6cbe73 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
127442025-03-01T01:27:19.439ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2620 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 9852de28-a56f-40c7-b0cc-2bbefb6cbe73 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
127452025-03-01T01:27:20.457ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = fed21359-e54f-4a63-a321-a5f75364dfaa roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
127462025-03-01T01:27:20.458ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = fed21359-e54f-4a63-a321-a5f75364dfaa resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
127472025-03-01T01:27:20.459ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2217 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = fed21359-e54f-4a63-a321-a5f75364dfaa response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
127482025-03-01T01:27:21.479ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 9fe8d60d-3d8a-4c94-9354-700643aeb8c9 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
127492025-03-01T01:27:21.480ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 9fe8d60d-3d8a-4c94-9354-700643aeb8c9 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
127502025-03-01T01:27:21.482ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2510 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 9fe8d60d-3d8a-4c94-9354-700643aeb8c9 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
127512025-03-01T01:27:22.501ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 3bd1084a-05be-480d-8d9e-03fa46e10cae roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
127522025-03-01T01:27:22.501ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 3bd1084a-05be-480d-8d9e-03fa46e10cae resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
127532025-03-01T01:27:22.502ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1947 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 3bd1084a-05be-480d-8d9e-03fa46e10cae response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
127542025-03-01T01:27:23.214ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 26 reason = Timeout
127552025-03-01T01:27:23.214ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
127562025-03-01T01:27:23.214ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 26 reason = Timeout
127572025-03-01T01:27:23.214ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
127582025-03-01T01:27:23.214ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 76 reason = Timeout
127592025-03-01T01:27:23.214ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
127602025-03-01T01:27:23.214ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 26 reason = Timeout
127612025-03-01T01:27:23.214ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
127622025-03-01T01:27:23.214ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 26 reason = Timeout
127632025-03-01T01:27:23.214ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 26 reason = Timeout
127642025-03-01T01:27:23.214ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
127652025-03-01T01:27:23.214ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
127662025-03-01T01:27:23.214ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 26 reason = Timeout
127672025-03-01T01:27:23.214ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
127682025-03-01T01:27:23.214ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 26 reason = Timeout
127692025-03-01T01:27:23.214ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
127702025-03-01T01:27:23.214ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 26 reason = Timeout
127712025-03-01T01:27:23.214ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
127722025-03-01T01:27:23.214ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 26 reason = Timeout
127732025-03-01T01:27:23.214ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
127742025-03-01T01:27:23.214ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 26 reason = Timeout
127752025-03-01T01:27:23.214ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
127762025-03-01T01:27:23.214ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
127772025-03-01T01:27:23.214ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 26 reason = Timeout
127782025-03-01T01:27:23.214ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 26 reason = Timeout
127792025-03-01T01:27:23.214ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
127802025-03-01T01:27:23.214ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 27 reason = Timeout
127812025-03-01T01:27:23.214ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
127822025-03-01T01:27:23.214ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 27 reason = Timeout
127832025-03-01T01:27:23.214ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
127842025-03-01T01:27:23.214ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
127852025-03-01T01:27:23.214ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 26 reason = Timeout
127862025-03-01T01:27:23.214ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
127872025-03-01T01:27:23.214ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 76 reason = Timeout
127882025-03-01T01:27:23.214ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
127892025-03-01T01:27:23.214ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 28 reason = Timeout
127902025-03-01T01:27:23.214ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
127912025-03-01T01:27:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
127922025-03-01T01:27:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
127932025-03-01T01:27:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
127942025-03-01T01:27:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
127952025-03-01T01:27:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
127962025-03-01T01:27:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
127972025-03-01T01:27:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
127982025-03-01T01:27:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
127992025-03-01T01:27:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
128002025-03-01T01:27:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
128012025-03-01T01:27:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
128022025-03-01T01:27:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
128032025-03-01T01:27:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
128042025-03-01T01:27:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
128052025-03-01T01:27:23.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
128062025-03-01T01:27:23.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
128072025-03-01T01:27:23.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
128082025-03-01T01:27:23.216ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
128092025-03-01T01:27:23.217ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.096333ms iteration = 26 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
128102025-03-01T01:27:23.218ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1653, tv_nsec: 906229655 } })
128112025-03-01T01:27:23.218ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1154
128122025-03-01T01:27:23.218ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
128132025-03-01T01:27:23.218ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
128142025-03-01T01:27:23.218ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
128152025-03-01T01:27:23.218ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
128162025-03-01T01:27:23.218ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
128172025-03-01T01:27:23.219ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1653, tv_nsec: 907985490 } })
128182025-03-01T01:27:23.220ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1154
128192025-03-01T01:27:23.220ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
128202025-03-01T01:27:23.220ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
128212025-03-01T01:27:23.221ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 7.172306ms iteration = 26 status = {"errors":[],"finish_invoked_ok":[]}
128222025-03-01T01:27:23.221ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
128232025-03-01T01:27:23.223ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
128242025-03-01T01:27:23.223ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
128252025-03-01T01:27:23.223ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
128262025-03-01T01:27:23.223ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
128272025-03-01T01:27:23.223ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
128282025-03-01T01:27:23.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
128292025-03-01T01:27:23.224ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
128302025-03-01T01:27:23.224ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
128312025-03-01T01:27:23.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
128322025-03-01T01:27:23.224ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
128332025-03-01T01:27:23.226ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 11.886482ms iteration = 26 status = {"errors":[],"garbage_collect_requested":[]}
128342025-03-01T01:27:23.226ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
128352025-03-01T01:27:23.226ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
128362025-03-01T01:27:23.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
128372025-03-01T01:27:23.228ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
128382025-03-01T01:27:23.229ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
128392025-03-01T01:27:23.229ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 15.20486ms iteration = 76 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
128402025-03-01T01:27:23.230ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
128412025-03-01T01:27:23.230ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
128422025-03-01T01:27:23.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
128432025-03-01T01:27:23.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
128442025-03-01T01:27:23.230ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
128452025-03-01T01:27:23.230ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
128462025-03-01T01:27:23.231ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
128472025-03-01T01:27:23.231ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
128482025-03-01T01:27:23.231ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
128492025-03-01T01:27:23.231ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
128502025-03-01T01:27:23.231ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
128512025-03-01T01:27:23.231ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
128522025-03-01T01:27:23.235ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
128532025-03-01T01:27:23.240ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
128542025-03-01T01:27:23.240ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7, lookup_type: ById(8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7) } result = Ok(())
128552025-03-01T01:27:23.240ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
128562025-03-01T01:27:23.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
128572025-03-01T01:27:23.242ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
128582025-03-01T01:27:23.242ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
128592025-03-01T01:27:23.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
128602025-03-01T01:27:23.253ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 39.168567ms iteration = 28 status = {"physical_disks_added":0}
128612025-03-01T01:27:23.255ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
128622025-03-01T01:27:23.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
128632025-03-01T01:27:23.259ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
128642025-03-01T01:27:23.259ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 original_time_created = 2025-03-01 01:14:50.436545 UTC target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 time_created = 2025-03-01 01:14:50.436545 UTC
128652025-03-01T01:27:23.259ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 44.819603ms iteration = 76 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7","time_created":"2025-03-01T01:14:50.436545Z"}
128662025-03-01T01:27:23.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
128672025-03-01T01:27:23.263ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
128682025-03-01T01:27:23.263ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
128692025-03-01T01:27:23.264ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
128702025-03-01T01:27:23.265ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
128712025-03-01T01:27:23.265ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 51.434117ms iteration = 26 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
128722025-03-01T01:27:23.265ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
128732025-03-01T01:27:23.266ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
128742025-03-01T01:27:23.266ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
128752025-03-01T01:27:23.266ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
128762025-03-01T01:27:23.266ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7a90e876-2697-4b36-ba1f-757c609aa0b3", "content-length": "26", "date": "Sat, 01 Mar 2025 01:27:23 GMT"} })
128772025-03-01T01:27:23.266ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
128782025-03-01T01:27:23.267ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
128792025-03-01T01:27:23.267ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
128802025-03-01T01:27:23.267ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
128812025-03-01T01:27:23.267ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
128822025-03-01T01:27:23.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
128832025-03-01T01:27:23.268ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
128842025-03-01T01:27:23.268ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
128852025-03-01T01:27:23.268ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e099f90d-4057-4228-8bbe-5268c89ee917", "content-length": "26", "date": "Sat, 01 Mar 2025 01:27:23 GMT"} })
128862025-03-01T01:27:23.268ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
128872025-03-01T01:27:23.269ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
128882025-03-01T01:27:23.269ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
128892025-03-01T01:27:23.269ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
128902025-03-01T01:27:23.270ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
128912025-03-01T01:27:23.270ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1653, tv_nsec: 958810695 } })
128922025-03-01T01:27:23.270ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 3471264f-127e-4a25-bc10-2e8249e8d70a, lookup_type: ById(3471264f-127e-4a25-bc10-2e8249e8d70a) } result = Ok(())
128932025-03-01T01:27:23.270ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
128942025-03-01T01:27:23.270ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
128952025-03-01T01:27:23.271ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1154 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66
128962025-03-01T01:27:23.271ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
128972025-03-01T01:27:23.272ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
128982025-03-01T01:27:23.272ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
128992025-03-01T01:27:23.272ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
129002025-03-01T01:27:23.272ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
129012025-03-01T01:27:23.272ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
129022025-03-01T01:27:23.272ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
129032025-03-01T01:27:23.272ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 58.384859ms iteration = 26 status = 0
129042025-03-01T01:27:23.275ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
129052025-03-01T01:27:23.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
129062025-03-01T01:27:23.291ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
129072025-03-01T01:27:23.292ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
129082025-03-01T01:27:23.296ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 81.98946ms iteration = 26 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
129092025-03-01T01:27:23.296ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
129102025-03-01T01:27:23.296ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
129112025-03-01T01:27:23.309ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 95.247951ms iteration = 26 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
129122025-03-01T01:27:23.313ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
129132025-03-01T01:27:23.315ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
129142025-03-01T01:27:23.315ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
129152025-03-01T01:27:23.315ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
129162025-03-01T01:27:23.315ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
129172025-03-01T01:27:23.315ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 101.678882ms iteration = 26 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
129182025-03-01T01:27:23.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
129192025-03-01T01:27:23.317ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
129202025-03-01T01:27:23.317ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 103.733724ms iteration = 26 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
129212025-03-01T01:27:23.327ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 113.453741ms iteration = 26 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
129222025-03-01T01:27:23.336ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
129232025-03-01T01:27:23.336ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
129242025-03-01T01:27:23.338ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
129252025-03-01T01:27:23.341ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
129262025-03-01T01:27:23.341ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
129272025-03-01T01:27:23.341ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
129282025-03-01T01:27:23.343ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
129292025-03-01T01:27:23.345ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
129302025-03-01T01:27:23.346ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
129312025-03-01T01:27:23.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
129322025-03-01T01:27:23.376ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
129332025-03-01T01:27:23.376ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "95744b03-be73-4b8c-88b4-5890ffcd6f72", "content-length": "2", "date": "Sat, 01 Mar 2025 01:27:22 GMT"} })
129342025-03-01T01:27:23.380ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
129352025-03-01T01:27:23.380ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
129362025-03-01T01:27:23.383ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1162 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 zone_address = fd00:1122:3344:101::2
129372025-03-01T01:27:23.383ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
129382025-03-01T01:27:23.383ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "63f73e7c-7978-4f64-a740-5eebb5bb6e16", "content-length": "26", "date": "Sat, 01 Mar 2025 01:27:23 GMT"} })
129392025-03-01T01:27:23.383ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1167 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
129402025-03-01T01:27:23.384ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66
129412025-03-01T01:27:23.385ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 171.82508ms iteration = 26 status = null
129422025-03-01T01:27:23.437ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 223.536993ms iteration = 26 status = {}
129432025-03-01T01:27:23.439ZINFOnexus (BackgroundTasks): VPC route manager sled 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
129442025-03-01T01:27:23.439ZDEBGnexus (BackgroundTasks): client request SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
129452025-03-01T01:27:23.461ZDEBGnexus (BackgroundTasks): client request SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
129462025-03-01T01:27:23.474ZDEBGnexus (BackgroundTasks): client response SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "e73f661f-c583-4031-b85f-3d5d375d5205", "content-length": "691", "date": "Sat, 01 Mar 2025 01:27:23 GMT"} })
129472025-03-01T01:27:23.474ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
129482025-03-01T01:27:23.474ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
129492025-03-01T01:27:23.474ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
129502025-03-01T01:27:23.474ZDEBGnexus (BackgroundTasks): client response SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "59ea33a8-9d1a-4567-bceb-ddd81e42561b", "content-length": "372", "date": "Sat, 01 Mar 2025 01:27:23 GMT"} })
129512025-03-01T01:27:23.474ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
129522025-03-01T01:27:23.475ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
129532025-03-01T01:27:23.476ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 261.787922ms iteration = 27 status = {}
129542025-03-01T01:27:23.494ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
129552025-03-01T01:27:23.494ZDEBGnexus (BackgroundTasks): client request SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
129562025-03-01T01:27:23.494ZDEBGnexus (BackgroundTasks): client response SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "38cf400c-5cd2-4417-8029-f6a819768d78", "date": "Sat, 01 Mar 2025 01:27:23 GMT"} })
129572025-03-01T01:27:23.494ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
129582025-03-01T01:27:23.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
129592025-03-01T01:27:23.499ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
129602025-03-01T01:27:23.500ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
129612025-03-01T01:27:23.503ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
129622025-03-01T01:27:23.503ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
129632025-03-01T01:27:23.507ZINFOnexus (BackgroundTasks): VPC route manager sled 3471264f-127e-4a25-bc10-2e8249e8d70a push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
129642025-03-01T01:27:23.507ZDEBGnexus (BackgroundTasks): client request SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
129652025-03-01T01:27:23.507ZDEBGnexus (BackgroundTasks): client response SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "d8d96090-30f8-4824-b11a-f5fa1b429b94", "date": "Sat, 01 Mar 2025 01:27:23 GMT"} })
129662025-03-01T01:27:23.509ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 295.117202ms iteration = 27 status = {}
129672025-03-01T01:27:23.523ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
129682025-03-01T01:27:23.523ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 44dafe70-0c33-47a5-b7a5-c95dfe8122ab roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
129692025-03-01T01:27:23.524ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
129702025-03-01T01:27:23.524ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 44dafe70-0c33-47a5-b7a5-c95dfe8122ab resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
129712025-03-01T01:27:23.526ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2316 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 44dafe70-0c33-47a5-b7a5-c95dfe8122ab response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
129722025-03-01T01:27:23.527ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 7f9c3c14-58c5-473f-8692-6376be44401e, rack_id: 4854cb88-dfba-4609-8f9d-72aac08cef66, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(cb10d0c6-a704-4231-b148-4f9ae21a03f8) } rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 switch_location = Switch0
129732025-03-01T01:27:23.527ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
129742025-03-01T01:27:23.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
129752025-03-01T01:27:23.537ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
129762025-03-01T01:27:23.537ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "8818c5e1-8b4f-4954-a0a8-3d997cbf0e72", "content-length": "134", "date": "Sat, 01 Mar 2025 01:27:22 GMT"} })
129772025-03-01T01:27:23.537ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
129782025-03-01T01:27:23.537ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = cb10d0c6-a704-4231-b148-4f9ae21a03f8
129792025-03-01T01:27:23.537ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
129802025-03-01T01:27:23.537ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
129812025-03-01T01:27:23.537ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
129822025-03-01T01:27:23.537ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
129832025-03-01T01:27:23.537ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
129842025-03-01T01:27:23.537ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
129852025-03-01T01:27:23.538ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
129862025-03-01T01:27:23.538ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
129872025-03-01T01:27:23.538ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66
129882025-03-01T01:27:23.538ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
129892025-03-01T01:27:23.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
129902025-03-01T01:27:23.540ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
129912025-03-01T01:27:23.540ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "2afde8dc-ac5c-4b98-9de5-92ce464e906c", "content-length": "2", "date": "Sat, 01 Mar 2025 01:27:22 GMT"} })
129922025-03-01T01:27:23.540ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
129932025-03-01T01:27:23.540ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "c1410d96-8202-4a4f-9f1e-553933ab4b04", "content-length": "52", "date": "Sat, 01 Mar 2025 01:27:22 GMT"} })
129942025-03-01T01:27:23.540ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 switch_location = Switch0
129952025-03-01T01:27:23.540ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
129962025-03-01T01:27:23.642ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "cf3adfc2-bd8e-4230-bb82-a0e6d04a2b96", "date": "Sat, 01 Mar 2025 01:27:23 GMT"} })
129972025-03-01T01:27:23.642ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 switch = Switch0
129982025-03-01T01:27:23.642ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
129992025-03-01T01:27:23.643ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "780467a6-be1e-48cd-ba4e-c37482a2dfa1", "content-length": "682", "date": "Sat, 01 Mar 2025 01:27:23 GMT"} })
130002025-03-01T01:27:23.643ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
130012025-03-01T01:27:23.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
130022025-03-01T01:27:23.646ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
130032025-03-01T01:27:23.647ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
130042025-03-01T01:27:23.649ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
130052025-03-01T01:27:23.649ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
130062025-03-01T01:27:23.651ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
130072025-03-01T01:27:23.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
130082025-03-01T01:27:23.659ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 444.967854ms iteration = 26 status = {}
130092025-03-01T01:27:24.645ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 22b20f40-d0e4-4f22-92de-1aea2436b6bb roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
130102025-03-01T01:27:24.645ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 22b20f40-d0e4-4f22-92de-1aea2436b6bb resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
130112025-03-01T01:27:24.647ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2200 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 22b20f40-d0e4-4f22-92de-1aea2436b6bb response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
130122025-03-01T01:27:25.665ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = d18ae3a5-2444-4d9c-93a2-a3b4f29ce3af roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
130132025-03-01T01:27:25.666ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = d18ae3a5-2444-4d9c-93a2-a3b4f29ce3af resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
130142025-03-01T01:27:25.668ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2391 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = d18ae3a5-2444-4d9c-93a2-a3b4f29ce3af response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
130152025-03-01T01:27:26.688ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = b85d6758-5bee-4d75-a8a9-567b14582683 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
130162025-03-01T01:27:26.689ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = b85d6758-5bee-4d75-a8a9-567b14582683 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
130172025-03-01T01:27:26.690ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1991 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = b85d6758-5bee-4d75-a8a9-567b14582683 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
130182025-03-01T01:27:27.414ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 457 local_addr = [fd00:1122:3344:101::c]:34357 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = 5f6c387d-bb15-4614-8e62-a1d653d72800 response_code = 200 uri = /67b03f4e-4cbd-4843-9cd9-647f610abcfc
130192025-03-01T01:27:27.709ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 8568363c-afb5-4fd2-966b-83cf9533a595 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
130202025-03-01T01:27:27.710ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 8568363c-afb5-4fd2-966b-83cf9533a595 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
130212025-03-01T01:27:27.712ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2794 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 8568363c-afb5-4fd2-966b-83cf9533a595 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
130222025-03-01T01:27:28.730ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 240c5479-c625-421d-bb3c-51a308c56ca3 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
130232025-03-01T01:27:28.730ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 240c5479-c625-421d-bb3c-51a308c56ca3 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
130242025-03-01T01:27:28.732ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2421 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 240c5479-c625-421d-bb3c-51a308c56ca3 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
130252025-03-01T01:27:29.751ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 9a670731-491e-44ff-8e37-03e6cea6fa5d roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
130262025-03-01T01:27:29.752ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 9a670731-491e-44ff-8e37-03e6cea6fa5d resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
130272025-03-01T01:27:29.754ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2283 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 9a670731-491e-44ff-8e37-03e6cea6fa5d response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
130282025-03-01T01:27:30.773ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = b539a309-273a-4f52-b852-96fa0de78037 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
130292025-03-01T01:27:30.774ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = b539a309-273a-4f52-b852-96fa0de78037 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
130302025-03-01T01:27:30.776ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2899 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = b539a309-273a-4f52-b852-96fa0de78037 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
130312025-03-01T01:27:31.796ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 53979919-2cc2-4a2b-ad2f-813ec61b7526 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
130322025-03-01T01:27:31.796ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 53979919-2cc2-4a2b-ad2f-813ec61b7526 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
130332025-03-01T01:27:31.798ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2142 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 53979919-2cc2-4a2b-ad2f-813ec61b7526 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
130342025-03-01T01:27:32.818ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 0d661ed6-d1ef-47f6-a7c2-b6d41bc5b9ba roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
130352025-03-01T01:27:32.819ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 0d661ed6-d1ef-47f6-a7c2-b6d41bc5b9ba resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
130362025-03-01T01:27:32.821ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2386 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 0d661ed6-d1ef-47f6-a7c2-b6d41bc5b9ba response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
130372025-03-01T01:27:33.214ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 77 reason = Timeout
130382025-03-01T01:27:33.214ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 77 reason = Timeout
130392025-03-01T01:27:33.214ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
130402025-03-01T01:27:33.214ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
130412025-03-01T01:27:33.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
130422025-03-01T01:27:33.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
130432025-03-01T01:27:33.216ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
130442025-03-01T01:27:33.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
130452025-03-01T01:27:33.217ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
130462025-03-01T01:27:33.217ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.629643ms iteration = 77 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
130472025-03-01T01:27:33.219ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
130482025-03-01T01:27:33.219ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
130492025-03-01T01:27:33.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
130502025-03-01T01:27:33.222ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
130512025-03-01T01:27:33.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
130522025-03-01T01:27:33.224ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
130532025-03-01T01:27:33.226ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7, lookup_type: ById(8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7) } result = Ok(())
130542025-03-01T01:27:33.226ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
130552025-03-01T01:27:33.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
130562025-03-01T01:27:33.236ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 original_time_created = 2025-03-01 01:14:50.436545 UTC target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 time_created = 2025-03-01 01:14:50.436545 UTC
130572025-03-01T01:27:33.236ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.125511ms iteration = 77 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7","time_created":"2025-03-01T01:14:50.436545Z"}
130582025-03-01T01:27:33.838ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 340a51fe-a98f-47ff-9df2-39477165ce81 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
130592025-03-01T01:27:33.839ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 340a51fe-a98f-47ff-9df2-39477165ce81 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
130602025-03-01T01:27:33.840ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2307 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 340a51fe-a98f-47ff-9df2-39477165ce81 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
130612025-03-01T01:27:34.860ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = ef147d65-39fc-48af-b88c-02774b09adfb roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
130622025-03-01T01:27:34.860ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = ef147d65-39fc-48af-b88c-02774b09adfb resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
130632025-03-01T01:27:34.862ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2261 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = ef147d65-39fc-48af-b88c-02774b09adfb response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
130642025-03-01T01:27:35.883ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = bbbcc94e-f995-453a-b7c9-603629a9c41f roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
130652025-03-01T01:27:35.883ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = bbbcc94e-f995-453a-b7c9-603629a9c41f resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
130662025-03-01T01:27:35.885ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1963 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = bbbcc94e-f995-453a-b7c9-603629a9c41f response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
130672025-03-01T01:27:36.906ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 0e123b0b-0c94-451c-946e-77999d81a336 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
130682025-03-01T01:27:36.906ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 0e123b0b-0c94-451c-946e-77999d81a336 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
130692025-03-01T01:27:36.908ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2346 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 0e123b0b-0c94-451c-946e-77999d81a336 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
130702025-03-01T01:27:37.413ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 395 local_addr = [fd00:1122:3344:101::c]:34357 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = 38f55198-31e7-466f-b342-9fb81b1200f2 response_code = 200 uri = /67b03f4e-4cbd-4843-9cd9-647f610abcfc
130712025-03-01T01:27:37.928ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = dd459d8b-5d3d-4d73-9005-9305428317d6 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
130722025-03-01T01:27:37.929ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = dd459d8b-5d3d-4d73-9005-9305428317d6 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
130732025-03-01T01:27:37.930ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2263 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = dd459d8b-5d3d-4d73-9005-9305428317d6 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
130742025-03-01T01:27:38.950ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 1fc052dd-8a06-47fb-8a4c-17b9396a1249 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
130752025-03-01T01:27:38.950ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 1fc052dd-8a06-47fb-8a4c-17b9396a1249 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
130762025-03-01T01:27:38.953ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2581 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 1fc052dd-8a06-47fb-8a4c-17b9396a1249 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
130772025-03-01T01:27:39.973ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c82b76cf-d700-406b-9332-e9f3fbbfc2dc roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
130782025-03-01T01:27:39.973ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c82b76cf-d700-406b-9332-e9f3fbbfc2dc resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
130792025-03-01T01:27:39.975ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2384 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c82b76cf-d700-406b-9332-e9f3fbbfc2dc response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
130802025-03-01T01:27:40.995ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 78e7ed66-9464-4c68-b4e2-d5457624a184 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
130812025-03-01T01:27:40.995ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 78e7ed66-9464-4c68-b4e2-d5457624a184 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
130822025-03-01T01:27:40.997ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1941 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 78e7ed66-9464-4c68-b4e2-d5457624a184 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
130832025-03-01T01:27:42.017ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = aa946a6d-9326-410f-a093-537e755d8c5a roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
130842025-03-01T01:27:42.018ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = aa946a6d-9326-410f-a093-537e755d8c5a resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
130852025-03-01T01:27:42.020ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2589 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = aa946a6d-9326-410f-a093-537e755d8c5a response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
130862025-03-01T01:27:43.041ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 77b056da-b506-44a3-8c87-762c36be3dfe roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
130872025-03-01T01:27:43.041ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 77b056da-b506-44a3-8c87-762c36be3dfe resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
130882025-03-01T01:27:43.043ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2292 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 77b056da-b506-44a3-8c87-762c36be3dfe response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
130892025-03-01T01:27:43.213ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 78 reason = Timeout
130902025-03-01T01:27:43.213ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 78 reason = Timeout
130912025-03-01T01:27:43.213ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
130922025-03-01T01:27:43.213ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
130932025-03-01T01:27:43.213ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
130942025-03-01T01:27:43.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
130952025-03-01T01:27:43.216ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
130962025-03-01T01:27:43.218ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
130972025-03-01T01:27:43.218ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
130982025-03-01T01:27:43.218ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
130992025-03-01T01:27:43.220ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
131002025-03-01T01:27:43.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
131012025-03-01T01:27:43.222ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
131022025-03-01T01:27:43.224ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7, lookup_type: ById(8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7) } result = Ok(())
131032025-03-01T01:27:43.224ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
131042025-03-01T01:27:43.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
131052025-03-01T01:27:43.234ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 original_time_created = 2025-03-01 01:14:50.436545 UTC target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 time_created = 2025-03-01 01:14:50.436545 UTC
131062025-03-01T01:27:43.234ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.814434ms iteration = 78 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7","time_created":"2025-03-01T01:14:50.436545Z"}
131072025-03-01T01:27:43.242ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
131082025-03-01T01:27:43.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
131092025-03-01T01:27:43.271ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 58.008071ms iteration = 78 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
131102025-03-01T01:27:44.064ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c2f08003-5e69-49b6-bf1a-f108d5564f83 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
131112025-03-01T01:27:44.064ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c2f08003-5e69-49b6-bf1a-f108d5564f83 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
131122025-03-01T01:27:44.066ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2193 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c2f08003-5e69-49b6-bf1a-f108d5564f83 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
131132025-03-01T01:27:45.086ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 092e7e1b-b985-4099-9dbe-bd3b9a727aa3 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
131142025-03-01T01:27:45.087ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 092e7e1b-b985-4099-9dbe-bd3b9a727aa3 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
131152025-03-01T01:27:45.089ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2386 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 092e7e1b-b985-4099-9dbe-bd3b9a727aa3 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
131162025-03-01T01:27:46.109ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 3e9f0d90-1e8b-43a0-bc16-e9b20fef66f0 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
131172025-03-01T01:27:46.109ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 3e9f0d90-1e8b-43a0-bc16-e9b20fef66f0 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
131182025-03-01T01:27:46.111ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2690 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 3e9f0d90-1e8b-43a0-bc16-e9b20fef66f0 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
131192025-03-01T01:27:47.131ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 6fae7ecc-e9c0-4e2f-831a-18244402a4c1 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
131202025-03-01T01:27:47.131ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 6fae7ecc-e9c0-4e2f-831a-18244402a4c1 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
131212025-03-01T01:27:47.133ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2722 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 6fae7ecc-e9c0-4e2f-831a-18244402a4c1 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
131222025-03-01T01:27:47.414ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 448 local_addr = [fd00:1122:3344:101::c]:34357 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = 026fb735-01bc-4a0e-a81b-6d074a20072f response_code = 200 uri = /67b03f4e-4cbd-4843-9cd9-647f610abcfc
131232025-03-01T01:27:48.152ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 392d7439-d2cf-44c1-bec4-e3c322f222fb roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
131242025-03-01T01:27:48.153ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 392d7439-d2cf-44c1-bec4-e3c322f222fb resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
131252025-03-01T01:27:48.155ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2822 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 392d7439-d2cf-44c1-bec4-e3c322f222fb response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
131262025-03-01T01:27:49.175ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = df0809b5-0019-4eb3-9e8b-db469f99fedc roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
131272025-03-01T01:27:49.176ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = df0809b5-0019-4eb3-9e8b-db469f99fedc resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
131282025-03-01T01:27:49.178ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2561 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = df0809b5-0019-4eb3-9e8b-db469f99fedc response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
131292025-03-01T01:27:50.199ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = ad1f92fa-3202-4c7e-b0f8-9ecd3f610293 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
131302025-03-01T01:27:50.200ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = ad1f92fa-3202-4c7e-b0f8-9ecd3f610293 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
131312025-03-01T01:27:50.201ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2106 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = ad1f92fa-3202-4c7e-b0f8-9ecd3f610293 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
131322025-03-01T01:27:51.222ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 19994b0a-7c30-46ee-8e60-67b9340ebf78 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
131332025-03-01T01:27:51.223ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 19994b0a-7c30-46ee-8e60-67b9340ebf78 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
131342025-03-01T01:27:51.225ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2639 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 19994b0a-7c30-46ee-8e60-67b9340ebf78 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
131352025-03-01T01:27:52.244ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = ea1326bc-a788-4953-bdd7-f836bdc0dc4f roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
131362025-03-01T01:27:52.245ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = ea1326bc-a788-4953-bdd7-f836bdc0dc4f resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
131372025-03-01T01:27:52.246ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2194 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = ea1326bc-a788-4953-bdd7-f836bdc0dc4f response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
131382025-03-01T01:27:52.406ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38629 req_id = ab2fe1c9-3174-4b2e-8dba-65ff768ef84f roles = RoleSet { roles: {} } uri = /metrics/collectors/d77aa5d6-e6f9-4845-b1d4-57f91a3621e6/producers?sort_by=id_ascending
131392025-03-01T01:27:52.407ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38629 req_id = ab2fe1c9-3174-4b2e-8dba-65ff768ef84f resource = Database result = Ok(()) uri = /metrics/collectors/d77aa5d6-e6f9-4845-b1d4-57f91a3621e6/producers?sort_by=id_ascending
131402025-03-01T01:27:52.409ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2808 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38629 req_id = ab2fe1c9-3174-4b2e-8dba-65ff768ef84f response_code = 200 uri = /metrics/collectors/d77aa5d6-e6f9-4845-b1d4-57f91a3621e6/producers?sort_by=id_ascending
131412025-03-01T01:27:52.409ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38629 req_id = 3b8f6f01-3dc2-473d-826d-92ff825954c1 roles = RoleSet { roles: {} } uri = /metrics/collectors/d77aa5d6-e6f9-4845-b1d4-57f91a3621e6/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYmI0ODUwMS0zYzRlLTRkNDQtODgyMy1mOTc1ZTg2OTFmZmYifX0%3D
131422025-03-01T01:27:52.409ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38629 req_id = 3b8f6f01-3dc2-473d-826d-92ff825954c1 resource = Database result = Ok(()) uri = /metrics/collectors/d77aa5d6-e6f9-4845-b1d4-57f91a3621e6/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYmI0ODUwMS0zYzRlLTRkNDQtODgyMy1mOTc1ZTg2OTFmZmYifX0%3D
131432025-03-01T01:27:52.411ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2246 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38629 req_id = 3b8f6f01-3dc2-473d-826d-92ff825954c1 response_code = 200 uri = /metrics/collectors/d77aa5d6-e6f9-4845-b1d4-57f91a3621e6/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYmI0ODUwMS0zYzRlLTRkNDQtODgyMy1mOTc1ZTg2OTFmZmYifX0%3D
131442025-03-01T01:27:53.214ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 16 reason = Timeout
131452025-03-01T01:27:53.214ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 27 reason = Timeout
131462025-03-01T01:27:53.214ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
131472025-03-01T01:27:53.214ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 15 reason = Timeout
131482025-03-01T01:27:53.214ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7
131492025-03-01T01:27:53.214ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 19.85\u{b5}s iteration = 15 status = {"enabled":false,"target_id":"8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7"}
131502025-03-01T01:27:53.214ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 14 reason = Timeout
131512025-03-01T01:27:53.214ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 14 reason = Timeout
131522025-03-01T01:27:53.214ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
131532025-03-01T01:27:53.214ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
131542025-03-01T01:27:53.214ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 14 reason = Timeout
131552025-03-01T01:27:53.214ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
131562025-03-01T01:27:53.214ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
131572025-03-01T01:27:53.214ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 27 reason = Timeout
131582025-03-01T01:27:53.214ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
131592025-03-01T01:27:53.214ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
131602025-03-01T01:27:53.214ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 27 reason = Timeout
131612025-03-01T01:27:53.214ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
131622025-03-01T01:27:53.214ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 27 reason = Timeout
131632025-03-01T01:27:53.214ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
131642025-03-01T01:27:53.214ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 14 reason = Timeout
131652025-03-01T01:27:53.214ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 27 reason = Timeout
131662025-03-01T01:27:53.214ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
131672025-03-01T01:27:53.214ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 28 reason = Timeout
131682025-03-01T01:27:53.214ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
131692025-03-01T01:27:53.214ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 27 reason = Timeout
131702025-03-01T01:27:53.214ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
131712025-03-01T01:27:53.214ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
131722025-03-01T01:27:53.214ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 27 reason = Timeout
131732025-03-01T01:27:53.214ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 16 reason = Timeout
131742025-03-01T01:27:53.214ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
131752025-03-01T01:27:53.214ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 27 reason = Timeout
131762025-03-01T01:27:53.214ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
131772025-03-01T01:27:53.214ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
131782025-03-01T01:27:53.214ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 79 reason = Timeout
131792025-03-01T01:27:53.214ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 79 reason = Timeout
131802025-03-01T01:27:53.214ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
131812025-03-01T01:27:53.214ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 14 reason = Timeout
131822025-03-01T01:27:53.214ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
131832025-03-01T01:27:53.214ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
131842025-03-01T01:27:53.214ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 27 reason = Timeout
131852025-03-01T01:27:53.214ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
131862025-03-01T01:27:53.214ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
131872025-03-01T01:27:53.214ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 28 reason = Timeout
131882025-03-01T01:27:53.214ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
131892025-03-01T01:27:53.214ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 27 reason = Timeout
131902025-03-01T01:27:53.214ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 27 reason = Timeout
131912025-03-01T01:27:53.214ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
131922025-03-01T01:27:53.214ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 29 reason = Timeout
131932025-03-01T01:27:53.214ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 14 reason = Timeout
131942025-03-01T01:27:53.214ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
131952025-03-01T01:27:53.214ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
131962025-03-01T01:27:53.214ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 14 reason = Timeout
131972025-03-01T01:27:53.214ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
131982025-03-01T01:27:53.214ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 27 reason = Timeout
131992025-03-01T01:27:53.214ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
132002025-03-01T01:27:53.214ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 14 reason = Timeout
132012025-03-01T01:27:53.214ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-03-01 01:17:53.214431737 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
132022025-03-01T01:27:53.214ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
132032025-03-01T01:27:53.214ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 14 reason = Timeout
132042025-03-01T01:27:53.214ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 14 reason = Timeout
132052025-03-01T01:27:53.214ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
132062025-03-01T01:27:53.214ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 27 reason = Timeout
132072025-03-01T01:27:53.214ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
132082025-03-01T01:27:53.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
132092025-03-01T01:27:53.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
132102025-03-01T01:27:53.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
132112025-03-01T01:27:53.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
132122025-03-01T01:27:53.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
132132025-03-01T01:27:53.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
132142025-03-01T01:27:53.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
132152025-03-01T01:27:53.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
132162025-03-01T01:27:53.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
132172025-03-01T01:27:53.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
132182025-03-01T01:27:53.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
132192025-03-01T01:27:53.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
132202025-03-01T01:27:53.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
132212025-03-01T01:27:53.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
132222025-03-01T01:27:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
132232025-03-01T01:27:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
132242025-03-01T01:27:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
132252025-03-01T01:27:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
132262025-03-01T01:27:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
132272025-03-01T01:27:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
132282025-03-01T01:27:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
132292025-03-01T01:27:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
132302025-03-01T01:27:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
132312025-03-01T01:27:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
132322025-03-01T01:27:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
132332025-03-01T01:27:53.215ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2e37f4af-57dc-468e-80e3-cf2aea2ffdc8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5f6eb3bd-0126-40e0-98ef-ee33df084158.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("5f6eb3bd-0126-40e0-98ef-ee33df084158.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1683, tv_nsec: 903352836 } })
132342025-03-01T01:27:53.215ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("3a9b8294-d9f3-4130-a669-e74c6f1f65a0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("450e8d93-9ed3-4721-9fe9-42521f60bc93.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a4f72c78-99c6-478d-b490-f7d8793d4173.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("a4f72c78-99c6-478d-b490-f7d8793d4173.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1683, tv_nsec: 903377716 } })
132352025-03-01T01:27:53.215ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
132362025-03-01T01:27:53.215ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.444889ms iteration = 14 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
132372025-03-01T01:27:53.215ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
132382025-03-01T01:27:53.215ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.276157ms iteration = 14 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
132392025-03-01T01:27:53.216ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
132402025-03-01T01:27:53.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
132412025-03-01T01:27:53.217ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
132422025-03-01T01:27:53.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
132432025-03-01T01:27:53.217ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1683, tv_nsec: 905769305 } })
132442025-03-01T01:27:53.217ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1154
132452025-03-01T01:27:53.219ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
132462025-03-01T01:27:53.219ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 5.159385ms iteration = 27 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
132472025-03-01T01:27:53.220ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 5.863099ms iteration = 27 status = {"errors":[],"finish_invoked_ok":[]}
132482025-03-01T01:27:53.221ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
132492025-03-01T01:27:53.221ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
132502025-03-01T01:27:53.221ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
132512025-03-01T01:27:53.221ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
132522025-03-01T01:27:53.221ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
132532025-03-01T01:27:53.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
132542025-03-01T01:27:53.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
132552025-03-01T01:27:53.223ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
132562025-03-01T01:27:53.223ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
132572025-03-01T01:27:53.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
132582025-03-01T01:27:53.225ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
132592025-03-01T01:27:53.225ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
132602025-03-01T01:27:53.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
132612025-03-01T01:27:53.227ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 13.155878ms iteration = 14 status = {"errors":[],"found_port_ok":[]}
132622025-03-01T01:27:53.227ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
132632025-03-01T01:27:53.229ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
132642025-03-01T01:27:53.229ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
132652025-03-01T01:27:53.229ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
132662025-03-01T01:27:53.229ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
132672025-03-01T01:27:53.229ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
132682025-03-01T01:27:53.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
132692025-03-01T01:27:53.231ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
132702025-03-01T01:27:53.231ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
132712025-03-01T01:27:53.231ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
132722025-03-01T01:27:53.232ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
132732025-03-01T01:27:53.232ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
132742025-03-01T01:27:53.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
132752025-03-01T01:27:53.232ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
132762025-03-01T01:27:53.232ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
132772025-03-01T01:27:53.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
132782025-03-01T01:27:53.234ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
132792025-03-01T01:27:53.235ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-03-01 01:17:53.214431737 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
132802025-03-01T01:27:53.235ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 20.974247ms iteration = 14 status = {"expiration":"2025-03-01T01:17:53.214431737Z","pruned":[]}
132812025-03-01T01:27:53.235ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1683, tv_nsec: 924049578 } })
132822025-03-01T01:27:53.236ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1154
132832025-03-01T01:27:53.237ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
132842025-03-01T01:27:53.237ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
132852025-03-01T01:27:53.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
132862025-03-01T01:27:53.240ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
132872025-03-01T01:27:53.241ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 26.883418ms iteration = 27 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
132882025-03-01T01:27:53.241ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
132892025-03-01T01:27:53.241ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
132902025-03-01T01:27:53.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
132912025-03-01T01:27:53.242ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
132922025-03-01T01:27:53.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
132932025-03-01T01:27:53.243ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
132942025-03-01T01:27:53.243ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
132952025-03-01T01:27:53.243ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
132962025-03-01T01:27:53.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
132972025-03-01T01:27:53.243ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
132982025-03-01T01:27:53.243ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
132992025-03-01T01:27:53.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
133002025-03-01T01:27:53.245ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
133012025-03-01T01:27:53.248ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
133022025-03-01T01:27:53.248ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
133032025-03-01T01:27:53.248ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 33.754628ms iteration = 14 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
133042025-03-01T01:27:53.254ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
133052025-03-01T01:27:53.254ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
133062025-03-01T01:27:53.254ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
133072025-03-01T01:27:53.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
133082025-03-01T01:27:53.259ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7, lookup_type: ById(8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7) } result = Ok(())
133092025-03-01T01:27:53.259ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
133102025-03-01T01:27:53.260ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
133112025-03-01T01:27:53.260ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
133122025-03-01T01:27:53.260ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
133132025-03-01T01:27:53.260ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
133142025-03-01T01:27:53.263ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
133152025-03-01T01:27:53.265ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
133162025-03-01T01:27:53.265ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
133172025-03-01T01:27:53.265ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
133182025-03-01T01:27:53.265ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = b00682c4-3717-44e6-bfdd-128cfa0ca83d roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
133192025-03-01T01:27:53.266ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = b00682c4-3717-44e6-bfdd-128cfa0ca83d resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
133202025-03-01T01:27:53.266ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
133212025-03-01T01:27:53.267ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
133222025-03-01T01:27:53.267ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
133232025-03-01T01:27:53.267ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
133242025-03-01T01:27:53.269ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
133252025-03-01T01:27:53.269ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
133262025-03-01T01:27:53.270ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 4316 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = b00682c4-3717-44e6-bfdd-128cfa0ca83d response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
133272025-03-01T01:27:53.277ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
133282025-03-01T01:27:53.277ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
133292025-03-01T01:27:53.277ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
133302025-03-01T01:27:53.278ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 original_time_created = 2025-03-01 01:14:50.436545 UTC target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 time_created = 2025-03-01 01:14:50.436545 UTC
133312025-03-01T01:27:53.278ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 64.491904ms iteration = 79 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7","time_created":"2025-03-01T01:14:50.436545Z"}
133322025-03-01T01:27:53.279ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 65.328ms iteration = 79 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
133332025-03-01T01:27:53.279ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
133342025-03-01T01:27:53.280ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
133352025-03-01T01:27:53.280ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
133362025-03-01T01:27:53.280ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
133372025-03-01T01:27:53.283ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 68.76866ms iteration = 27 status = {"errors":[],"garbage_collect_requested":[]}
133382025-03-01T01:27:53.284ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
133392025-03-01T01:27:53.284ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
133402025-03-01T01:27:53.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
133412025-03-01T01:27:53.286ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
133422025-03-01T01:27:53.287ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1683, tv_nsec: 975402733 } })
133432025-03-01T01:27:53.287ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
133442025-03-01T01:27:53.287ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1154 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66
133452025-03-01T01:27:53.288ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
133462025-03-01T01:27:53.289ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
133472025-03-01T01:27:53.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
133482025-03-01T01:27:53.291ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
133492025-03-01T01:27:53.293ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
133502025-03-01T01:27:53.293ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
133512025-03-01T01:27:53.293ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
133522025-03-01T01:27:53.293ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
133532025-03-01T01:27:53.293ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
133542025-03-01T01:27:53.293ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
133552025-03-01T01:27:53.294ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
133562025-03-01T01:27:53.294ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
133572025-03-01T01:27:53.294ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 79.705884ms iteration = 14 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
133582025-03-01T01:27:53.295ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
133592025-03-01T01:27:53.295ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
133602025-03-01T01:27:53.295ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
133612025-03-01T01:27:53.295ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
133622025-03-01T01:27:53.297ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
133632025-03-01T01:27:53.297ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 83.079752ms iteration = 27 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
133642025-03-01T01:27:53.300ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
133652025-03-01T01:27:53.300ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
133662025-03-01T01:27:53.300ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
133672025-03-01T01:27:53.303ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
133682025-03-01T01:27:53.303ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 0a9e4b5c-53a1-4f0a-8849-98a8b1852af3 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
133692025-03-01T01:27:53.303ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
133702025-03-01T01:27:53.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
133712025-03-01T01:27:53.305ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
133722025-03-01T01:27:53.305ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
133732025-03-01T01:27:53.305ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
133742025-03-01T01:27:53.305ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
133752025-03-01T01:27:53.305ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
133762025-03-01T01:27:53.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
133772025-03-01T01:27:53.307ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
133782025-03-01T01:27:53.307ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 93.178098ms iteration = 27 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
133792025-03-01T01:27:53.308ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 94.581486ms iteration = 27 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
133802025-03-01T01:27:53.309ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
133812025-03-01T01:27:53.309ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
133822025-03-01T01:27:53.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
133832025-03-01T01:27:53.314ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
133842025-03-01T01:27:53.314ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
133852025-03-01T01:27:53.314ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 100.222302ms iteration = 27 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
133862025-03-01T01:27:53.317ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
133872025-03-01T01:27:53.319ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
133882025-03-01T01:27:53.319ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
133892025-03-01T01:27:53.319ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 0a9e4b5c-53a1-4f0a-8849-98a8b1852af3 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
133902025-03-01T01:27:53.319ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
133912025-03-01T01:27:53.319ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-03-01 01:14:53.460216 UTC dns_group = internal generation = 1
133922025-03-01T01:27:53.319ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 105.922747ms iteration = 14 status = {"generation":1}
133932025-03-01T01:27:53.321ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
133942025-03-01T01:27:53.321ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
133952025-03-01T01:27:53.321ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
133962025-03-01T01:27:53.322ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
133972025-03-01T01:27:53.322ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
133982025-03-01T01:27:53.322ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
133992025-03-01T01:27:53.325ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
134002025-03-01T01:27:53.325ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = cce65e3e-6c86-4cdd-98ad-9a38c98082e8 dns_zone_name = oxide.test found_so_far = 0 version = 2
134012025-03-01T01:27:53.325ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
134022025-03-01T01:27:53.325ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
134032025-03-01T01:27:53.325ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
134042025-03-01T01:27:53.325ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
134052025-03-01T01:27:53.325ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
134062025-03-01T01:27:53.327ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 113.119065ms iteration = 27 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
134072025-03-01T01:27:53.327ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
134082025-03-01T01:27:53.327ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
134092025-03-01T01:27:53.328ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
134102025-03-01T01:27:53.328ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
134112025-03-01T01:27:53.328ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
134122025-03-01T01:27:53.330ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
134132025-03-01T01:27:53.330ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 115.916531ms iteration = 29 status = {"physical_disks_added":0}
134142025-03-01T01:27:53.330ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
134152025-03-01T01:27:53.331ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
134162025-03-01T01:27:53.331ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
134172025-03-01T01:27:53.331ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
134182025-03-01T01:27:53.333ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 3471264f-127e-4a25-bc10-2e8249e8d70a, lookup_type: ById(3471264f-127e-4a25-bc10-2e8249e8d70a) } result = Ok(())
134192025-03-01T01:27:53.333ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
134202025-03-01T01:27:53.333ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
134212025-03-01T01:27:53.333ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = cce65e3e-6c86-4cdd-98ad-9a38c98082e8 dns_zone_name = oxide.test found_so_far = 1 version = 2
134222025-03-01T01:27:53.333ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
134232025-03-01T01:27:53.333ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-03-01 01:14:54.679503 UTC dns_group = external generation = 2
134242025-03-01T01:27:53.333ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 119.757959ms iteration = 14 status = {"generation":2}
134252025-03-01T01:27:53.335ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 121.145488ms iteration = 27 status = 0
134262025-03-01T01:27:53.338ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
134272025-03-01T01:27:53.338ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
134282025-03-01T01:27:53.339ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "90c3c84c-3aab-4284-a366-526588354021", "content-length": "26", "date": "Sat, 01 Mar 2025 01:27:53 GMT"} })
134292025-03-01T01:27:53.339ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
134302025-03-01T01:27:53.341ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
134312025-03-01T01:27:53.343ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
134322025-03-01T01:27:53.369ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
134332025-03-01T01:27:53.369ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
134342025-03-01T01:27:53.381ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-03-01T01:14:49.537343Z, time_modified: 2025-03-01T01:14:49.537343Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 1682a303-6254-452b-b4cf-160ed9dc3fc9, db_silo: Silo { identity: SiloIdentity { id: 1682a303-6254-452b-b4cf-160ed9dc3fc9, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-03-01T01:14:54.631650Z, time_modified: 2025-03-01T01:14:54.631650Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "851c0b739689cfb98a2e401e6047fa98e9fcc283d9fc3f660bd69842a9c06be9" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 1682a303-6254-452b-b4cf-160ed9dc3fc9, db_silo: Silo { identity: SiloIdentity { id: 1682a303-6254-452b-b4cf-160ed9dc3fc9, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-03-01T01:14:54.631650Z, time_modified: 2025-03-01T01:14:54.631650Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "851c0b739689cfb98a2e401e6047fa98e9fcc283d9fc3f660bd69842a9c06be9" }] }) }
134352025-03-01T01:27:53.381ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 167.36503ms iteration = 14 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"1682a303-6254-452b-b4cf-160ed9dc3fc9","tls_certs":["851c0b739689cfb98a2e401e6047fa98e9fcc283d9fc3f660bd69842a9c06be9"]}},"default_endpoint":{"silo_id":"1682a303-6254-452b-b4cf-160ed9dc3fc9","tls_certs":["851c0b739689cfb98a2e401e6047fa98e9fcc283d9fc3f660bd69842a9c06be9"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
134362025-03-01T01:27:53.388ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
134372025-03-01T01:27:53.389ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
134382025-03-01T01:27:53.396ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
134392025-03-01T01:27:53.396ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
134402025-03-01T01:27:53.397ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9797e79b-de15-40de-a9b3-cfe1ed8d996e", "content-length": "26", "date": "Sat, 01 Mar 2025 01:27:53 GMT"} })
134412025-03-01T01:27:53.397ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
134422025-03-01T01:27:53.399ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
134432025-03-01T01:27:53.449ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1162 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 zone_address = fd00:1122:3344:101::2
134442025-03-01T01:27:53.449ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
134452025-03-01T01:27:53.449ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "aae4525d-6749-4d52-8b7b-233e8ced5db6", "content-length": "26", "date": "Sat, 01 Mar 2025 01:27:53 GMT"} })
134462025-03-01T01:27:53.450ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1167 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
134472025-03-01T01:27:53.451ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66
134482025-03-01T01:27:53.454ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
134492025-03-01T01:27:53.455ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 240.499159ms iteration = 14 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
134502025-03-01T01:27:53.508ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
134512025-03-01T01:27:53.509ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "270836d8-5081-4039-8333-e53445a739bc", "date": "Sat, 01 Mar 2025 01:27:53 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
134522025-03-01T01:27:53.509ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
134532025-03-01T01:27:53.510ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "c0f162e3-e791-400b-8386-36960bfac6e4", "date": "Sat, 01 Mar 2025 01:27:53 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
134542025-03-01T01:27:53.510ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
134552025-03-01T01:27:53.512ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
134562025-03-01T01:27:53.512ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 298.586823ms iteration = 16 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
134572025-03-01T01:27:53.532ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 318.013389ms iteration = 27 status = {}
134582025-03-01T01:27:53.538ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
134592025-03-01T01:27:53.539ZINFOnexus (BackgroundTasks): VPC route manager sled 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
134602025-03-01T01:27:53.539ZDEBGnexus (BackgroundTasks): client request SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
134612025-03-01T01:27:53.541ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
134622025-03-01T01:27:53.543ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
134632025-03-01T01:27:53.543ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
134642025-03-01T01:27:53.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
134652025-03-01T01:27:53.545ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
134662025-03-01T01:27:53.547ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
134672025-03-01T01:27:53.547ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
134682025-03-01T01:27:53.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
134692025-03-01T01:27:53.555ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
134702025-03-01T01:27:53.556ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "9715d0c8-0522-4909-b533-e7f69c12dbb6", "content-length": "2", "date": "Sat, 01 Mar 2025 01:27:53 GMT"} })
134712025-03-01T01:27:53.559ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
134722025-03-01T01:27:53.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
134732025-03-01T01:27:53.562ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 347.725663ms iteration = 27 status = null
134742025-03-01T01:27:53.620ZDEBGnexus (BackgroundTasks): client response SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "0107d9da-12cd-4329-88a0-138736150b5c", "content-length": "372", "date": "Sat, 01 Mar 2025 01:27:53 GMT"} })
134752025-03-01T01:27:53.620ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
134762025-03-01T01:27:53.621ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
134772025-03-01T01:27:53.643ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
134782025-03-01T01:27:53.644ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "7167dbd9-d1e7-4593-bfe0-14acd77da8c6", "date": "Sat, 01 Mar 2025 01:27:53 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
134792025-03-01T01:27:53.644ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
134802025-03-01T01:27:53.645ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
134812025-03-01T01:27:53.645ZDEBGnexus (BackgroundTasks): client request SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
134822025-03-01T01:27:53.645ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "d8c737ca-00b8-4c7f-a8b6-4cdd4660f4fd", "date": "Sat, 01 Mar 2025 01:27:53 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
134832025-03-01T01:27:53.645ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
134842025-03-01T01:27:53.645ZDEBGnexus (BackgroundTasks): client response SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "fabbdb0c-7701-43f6-a45f-e9808ee0cada", "date": "Sat, 01 Mar 2025 01:27:53 GMT"} })
134852025-03-01T01:27:53.645ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
134862025-03-01T01:27:53.646ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
134872025-03-01T01:27:53.647ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "bdd0fbaa-2b4c-4647-91ea-dc48918d7b6a", "date": "Sat, 01 Mar 2025 01:27:53 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
134882025-03-01T01:27:53.647ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
134892025-03-01T01:27:53.648ZDEBGnexus (BackgroundTasks): client request SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
134902025-03-01T01:27:53.649ZDEBGnexus (BackgroundTasks): client response SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "fd0f8056-0c40-4a59-9c97-5f1f7e97e4b6", "content-length": "691", "date": "Sat, 01 Mar 2025 01:27:53 GMT"} })
134912025-03-01T01:27:53.649ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
134922025-03-01T01:27:53.649ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
134932025-03-01T01:27:53.649ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
134942025-03-01T01:27:53.649ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
134952025-03-01T01:27:53.649ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
134962025-03-01T01:27:53.649ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
134972025-03-01T01:27:53.649ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 435.639574ms iteration = 16 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
134982025-03-01T01:27:53.651ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 436.90421ms iteration = 28 status = {}
134992025-03-01T01:27:53.653ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
135002025-03-01T01:27:53.653ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
135012025-03-01T01:27:53.657ZINFOnexus (BackgroundTasks): VPC route manager sled 3471264f-127e-4a25-bc10-2e8249e8d70a push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
135022025-03-01T01:27:53.657ZDEBGnexus (BackgroundTasks): client request SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
135032025-03-01T01:27:53.657ZDEBGnexus (BackgroundTasks): client response SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "d44b9eef-13c9-4f28-a172-5b759fb6b8e4", "date": "Sat, 01 Mar 2025 01:27:53 GMT"} })
135042025-03-01T01:27:53.660ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 445.920814ms iteration = 28 status = {}
135052025-03-01T01:27:53.702ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
135062025-03-01T01:27:53.702ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
135072025-03-01T01:27:53.705ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 7f9c3c14-58c5-473f-8692-6376be44401e, rack_id: 4854cb88-dfba-4609-8f9d-72aac08cef66, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(cb10d0c6-a704-4231-b148-4f9ae21a03f8) } rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 switch_location = Switch0
135082025-03-01T01:27:53.705ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
135092025-03-01T01:27:53.705ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
135102025-03-01T01:27:53.718ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
135112025-03-01T01:27:53.718ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "9afc13e1-3f1c-4436-8adb-cf6f74dff771", "content-length": "134", "date": "Sat, 01 Mar 2025 01:27:53 GMT"} })
135122025-03-01T01:27:53.718ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
135132025-03-01T01:27:53.718ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = cb10d0c6-a704-4231-b148-4f9ae21a03f8
135142025-03-01T01:27:53.719ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
135152025-03-01T01:27:53.719ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
135162025-03-01T01:27:53.719ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
135172025-03-01T01:27:53.719ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
135182025-03-01T01:27:53.719ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
135192025-03-01T01:27:53.719ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
135202025-03-01T01:27:53.719ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
135212025-03-01T01:27:53.719ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
135222025-03-01T01:27:53.719ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66
135232025-03-01T01:27:53.719ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
135242025-03-01T01:27:53.720ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
135252025-03-01T01:27:53.722ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
135262025-03-01T01:27:53.722ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "0ca40606-9276-4941-be56-3b62ce0a8726", "content-length": "2", "date": "Sat, 01 Mar 2025 01:27:53 GMT"} })
135272025-03-01T01:27:53.722ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
135282025-03-01T01:27:53.722ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "07c6f1e2-ffc0-4bca-a24b-720465f379f9", "content-length": "52", "date": "Sat, 01 Mar 2025 01:27:53 GMT"} })
135292025-03-01T01:27:53.722ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 switch_location = Switch0
135302025-03-01T01:27:53.722ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
135312025-03-01T01:27:53.823ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "fdef5318-acfd-4e84-8f0e-0a4a2fa501d4", "date": "Sat, 01 Mar 2025 01:27:53 GMT"} })
135322025-03-01T01:27:53.823ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 switch = Switch0
135332025-03-01T01:27:53.823ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
135342025-03-01T01:27:53.824ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "4de79fe7-5a92-48c9-a7ed-e7d65084a85e", "content-length": "682", "date": "Sat, 01 Mar 2025 01:27:53 GMT"} })
135352025-03-01T01:27:53.824ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
135362025-03-01T01:27:53.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
135372025-03-01T01:27:53.828ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
135382025-03-01T01:27:53.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
135392025-03-01T01:27:53.831ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
135402025-03-01T01:27:53.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
135412025-03-01T01:27:53.832ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
135422025-03-01T01:27:53.833ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
135432025-03-01T01:27:53.840ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 626.40847ms iteration = 27 status = {}
135442025-03-01T01:27:54.297ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = fab3461b-a1f8-4544-8081-91434fc9c1be roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
135452025-03-01T01:27:54.298ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = fab3461b-a1f8-4544-8081-91434fc9c1be resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
135462025-03-01T01:27:54.299ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2219 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = fab3461b-a1f8-4544-8081-91434fc9c1be response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
135472025-03-01T01:27:55.322ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 5e485495-ee37-43eb-a226-4e4b1b3273ce roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
135482025-03-01T01:27:55.322ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 5e485495-ee37-43eb-a226-4e4b1b3273ce resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
135492025-03-01T01:27:55.324ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2006 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 5e485495-ee37-43eb-a226-4e4b1b3273ce response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
135502025-03-01T01:27:56.344ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 78c28509-6eb1-42e6-8c6e-9e76ae78200b roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
135512025-03-01T01:27:56.344ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 78c28509-6eb1-42e6-8c6e-9e76ae78200b resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
135522025-03-01T01:27:56.346ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2137 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 78c28509-6eb1-42e6-8c6e-9e76ae78200b response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
135532025-03-01T01:27:57.365ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 53dd7bf7-efcf-4ed2-8f70-b1c66fe78ba4 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
135542025-03-01T01:27:57.366ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 53dd7bf7-efcf-4ed2-8f70-b1c66fe78ba4 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
135552025-03-01T01:27:57.368ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2603 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 53dd7bf7-efcf-4ed2-8f70-b1c66fe78ba4 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
135562025-03-01T01:27:57.414ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 434 local_addr = [fd00:1122:3344:101::c]:34357 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = 1d4f20de-369e-4ab4-a64d-abfac91a1551 response_code = 200 uri = /67b03f4e-4cbd-4843-9cd9-647f610abcfc
135572025-03-01T01:27:58.389ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 46a24846-b31d-43de-8d47-2e6b6ededc4f roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
135582025-03-01T01:27:58.389ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 46a24846-b31d-43de-8d47-2e6b6ededc4f resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
135592025-03-01T01:27:58.391ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2208 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 46a24846-b31d-43de-8d47-2e6b6ededc4f response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
135602025-03-01T01:27:59.410ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c699f7ad-43fb-4c85-9bed-5c398b8a0882 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
135612025-03-01T01:27:59.410ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c699f7ad-43fb-4c85-9bed-5c398b8a0882 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
135622025-03-01T01:27:59.412ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2499 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c699f7ad-43fb-4c85-9bed-5c398b8a0882 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
135632025-03-01T01:28:00.431ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 3a3f8e7f-57c4-4fef-83fc-196afc85f8f3 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
135642025-03-01T01:28:00.432ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 3a3f8e7f-57c4-4fef-83fc-196afc85f8f3 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
135652025-03-01T01:28:00.433ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1922 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 3a3f8e7f-57c4-4fef-83fc-196afc85f8f3 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
135662025-03-01T01:28:01.452ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = bbb491c7-9e7f-42a1-aa1a-d96aca27b8bd roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
135672025-03-01T01:28:01.453ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = bbb491c7-9e7f-42a1-aa1a-d96aca27b8bd resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
135682025-03-01T01:28:01.455ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2471 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = bbb491c7-9e7f-42a1-aa1a-d96aca27b8bd response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
135692025-03-01T01:28:02.474ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = cc620eac-c36f-40f5-ba5a-3f688e7e24b8 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
135702025-03-01T01:28:02.474ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = cc620eac-c36f-40f5-ba5a-3f688e7e24b8 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
135712025-03-01T01:28:02.476ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2127 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = cc620eac-c36f-40f5-ba5a-3f688e7e24b8 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
135722025-03-01T01:28:03.214ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 80 reason = Timeout
135732025-03-01T01:28:03.214ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 80 reason = Timeout
135742025-03-01T01:28:03.214ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
135752025-03-01T01:28:03.214ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
135762025-03-01T01:28:03.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
135772025-03-01T01:28:03.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
135782025-03-01T01:28:03.216ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
135792025-03-01T01:28:03.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
135802025-03-01T01:28:03.217ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
135812025-03-01T01:28:03.218ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.40449ms iteration = 80 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
135822025-03-01T01:28:03.219ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
135832025-03-01T01:28:03.219ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
135842025-03-01T01:28:03.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
135852025-03-01T01:28:03.221ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
135862025-03-01T01:28:03.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
135872025-03-01T01:28:03.223ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
135882025-03-01T01:28:03.226ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7, lookup_type: ById(8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7) } result = Ok(())
135892025-03-01T01:28:03.226ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
135902025-03-01T01:28:03.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
135912025-03-01T01:28:03.234ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 original_time_created = 2025-03-01 01:14:50.436545 UTC target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 time_created = 2025-03-01 01:14:50.436545 UTC
135922025-03-01T01:28:03.234ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.772374ms iteration = 80 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7","time_created":"2025-03-01T01:14:50.436545Z"}
135932025-03-01T01:28:03.495ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = cee17181-0ed3-48d1-9315-8708318b77df roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
135942025-03-01T01:28:03.495ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = cee17181-0ed3-48d1-9315-8708318b77df resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
135952025-03-01T01:28:03.498ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2691 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = cee17181-0ed3-48d1-9315-8708318b77df response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
135962025-03-01T01:28:04.518ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 6cf801c5-e11e-406a-8f7e-abaa84ce9a65 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
135972025-03-01T01:28:04.518ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 6cf801c5-e11e-406a-8f7e-abaa84ce9a65 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
135982025-03-01T01:28:04.520ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1970 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 6cf801c5-e11e-406a-8f7e-abaa84ce9a65 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
135992025-03-01T01:28:05.540ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 8933d626-ddb8-403d-94e3-307de416b6f6 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
136002025-03-01T01:28:05.540ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 8933d626-ddb8-403d-94e3-307de416b6f6 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
136012025-03-01T01:28:05.542ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2175 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 8933d626-ddb8-403d-94e3-307de416b6f6 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
136022025-03-01T01:28:06.562ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 4bca4f8a-0cfc-4508-8ae4-7f943450a044 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
136032025-03-01T01:28:06.563ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 4bca4f8a-0cfc-4508-8ae4-7f943450a044 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
136042025-03-01T01:28:06.564ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2334 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 4bca4f8a-0cfc-4508-8ae4-7f943450a044 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
136052025-03-01T01:28:07.414ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 426 local_addr = [fd00:1122:3344:101::c]:34357 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = e3d39ac5-c0a7-4767-9fc7-b5b50e3dc3c3 response_code = 200 uri = /67b03f4e-4cbd-4843-9cd9-647f610abcfc
136062025-03-01T01:28:07.585ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 034e1c8d-962a-49d9-8a67-cfbb3097d205 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
136072025-03-01T01:28:07.585ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 034e1c8d-962a-49d9-8a67-cfbb3097d205 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
136082025-03-01T01:28:07.587ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2628 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 034e1c8d-962a-49d9-8a67-cfbb3097d205 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
136092025-03-01T01:28:08.606ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = a727b2b5-08f5-49f3-8c96-25f466d28613 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
136102025-03-01T01:28:08.607ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = a727b2b5-08f5-49f3-8c96-25f466d28613 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
136112025-03-01T01:28:08.609ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2355 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = a727b2b5-08f5-49f3-8c96-25f466d28613 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
136122025-03-01T01:28:09.628ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = a69dc985-3f93-46e6-85b4-3a732504e23a roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
136132025-03-01T01:28:09.629ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = a69dc985-3f93-46e6-85b4-3a732504e23a resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
136142025-03-01T01:28:09.630ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2175 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = a69dc985-3f93-46e6-85b4-3a732504e23a response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
136152025-03-01T01:28:10.650ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = ab6b7150-9860-4a00-9592-60ef3890ac60 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
136162025-03-01T01:28:10.650ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = ab6b7150-9860-4a00-9592-60ef3890ac60 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
136172025-03-01T01:28:10.652ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2478 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = ab6b7150-9860-4a00-9592-60ef3890ac60 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
136182025-03-01T01:28:11.671ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = de57e3f6-701f-47fb-9e59-71fe7b1c7ed5 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
136192025-03-01T01:28:11.672ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = de57e3f6-701f-47fb-9e59-71fe7b1c7ed5 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
136202025-03-01T01:28:11.674ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2578 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = de57e3f6-701f-47fb-9e59-71fe7b1c7ed5 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
136212025-03-01T01:28:12.695ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = bedceb72-c0f2-4afe-b5d7-b39e2ca4aed5 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
136222025-03-01T01:28:12.695ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = bedceb72-c0f2-4afe-b5d7-b39e2ca4aed5 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
136232025-03-01T01:28:12.697ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2674 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = bedceb72-c0f2-4afe-b5d7-b39e2ca4aed5 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
136242025-03-01T01:28:13.213ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 81 reason = Timeout
136252025-03-01T01:28:13.213ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 81 reason = Timeout
136262025-03-01T01:28:13.213ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
136272025-03-01T01:28:13.213ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
136282025-03-01T01:28:13.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
136292025-03-01T01:28:13.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
136302025-03-01T01:28:13.216ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
136312025-03-01T01:28:13.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
136322025-03-01T01:28:13.217ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
136332025-03-01T01:28:13.218ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.553552ms iteration = 81 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
136342025-03-01T01:28:13.219ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
136352025-03-01T01:28:13.219ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
136362025-03-01T01:28:13.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
136372025-03-01T01:28:13.222ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
136382025-03-01T01:28:13.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
136392025-03-01T01:28:13.223ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
136402025-03-01T01:28:13.226ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7, lookup_type: ById(8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7) } result = Ok(())
136412025-03-01T01:28:13.226ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
136422025-03-01T01:28:13.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
136432025-03-01T01:28:13.237ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 original_time_created = 2025-03-01 01:14:50.436545 UTC target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 time_created = 2025-03-01 01:14:50.436545 UTC
136442025-03-01T01:28:13.237ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.003929ms iteration = 81 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7","time_created":"2025-03-01T01:14:50.436545Z"}
136452025-03-01T01:28:13.717ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 146ca051-a7b3-47a2-8a62-89d0fdb98714 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
136462025-03-01T01:28:13.718ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 146ca051-a7b3-47a2-8a62-89d0fdb98714 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
136472025-03-01T01:28:13.719ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1991 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 146ca051-a7b3-47a2-8a62-89d0fdb98714 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
136482025-03-01T01:28:14.740ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 0ea91342-d7bd-4bbe-9300-cc325f90063b roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
136492025-03-01T01:28:14.740ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 0ea91342-d7bd-4bbe-9300-cc325f90063b resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
136502025-03-01T01:28:14.742ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2946 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 0ea91342-d7bd-4bbe-9300-cc325f90063b response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
136512025-03-01T01:28:15.762ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 59e7914b-76fc-4e21-89aa-c7f25dd42532 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
136522025-03-01T01:28:15.763ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 59e7914b-76fc-4e21-89aa-c7f25dd42532 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
136532025-03-01T01:28:15.765ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2527 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 59e7914b-76fc-4e21-89aa-c7f25dd42532 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
136542025-03-01T01:28:16.783ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 51dec6aa-d1e0-49ef-8cb7-22ad689fdb67 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
136552025-03-01T01:28:16.784ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 51dec6aa-d1e0-49ef-8cb7-22ad689fdb67 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
136562025-03-01T01:28:16.786ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2510 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 51dec6aa-d1e0-49ef-8cb7-22ad689fdb67 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
136572025-03-01T01:28:17.414ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 386 local_addr = [fd00:1122:3344:101::c]:34357 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = 88059da7-70fe-46b0-84b1-c55ddef611e3 response_code = 200 uri = /67b03f4e-4cbd-4843-9cd9-647f610abcfc
136582025-03-01T01:28:17.806ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 4a177869-0595-4bc7-8635-d17bb0ea740f roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
136592025-03-01T01:28:17.806ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 4a177869-0595-4bc7-8635-d17bb0ea740f resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
136602025-03-01T01:28:17.809ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2507 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 4a177869-0595-4bc7-8635-d17bb0ea740f response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
136612025-03-01T01:28:18.827ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = d861b491-ecff-4f76-9dbb-09092138cc62 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
136622025-03-01T01:28:18.828ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = d861b491-ecff-4f76-9dbb-09092138cc62 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
136632025-03-01T01:28:18.830ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2518 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = d861b491-ecff-4f76-9dbb-09092138cc62 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
136642025-03-01T01:28:19.850ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = fbff2e95-0914-4820-90d7-9ebda4a77e89 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
136652025-03-01T01:28:19.850ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = fbff2e95-0914-4820-90d7-9ebda4a77e89 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
136662025-03-01T01:28:19.852ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2418 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = fbff2e95-0914-4820-90d7-9ebda4a77e89 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
136672025-03-01T01:28:20.874ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 81be15cb-8418-42d1-881e-d18c88a82554 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
136682025-03-01T01:28:20.875ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 81be15cb-8418-42d1-881e-d18c88a82554 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
136692025-03-01T01:28:20.876ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2305 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 81be15cb-8418-42d1-881e-d18c88a82554 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
136702025-03-01T01:28:21.896ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 87299846-d825-4301-896a-c5fe8c05d6d2 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
136712025-03-01T01:28:21.896ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 87299846-d825-4301-896a-c5fe8c05d6d2 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
136722025-03-01T01:28:21.898ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2360 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 87299846-d825-4301-896a-c5fe8c05d6d2 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
136732025-03-01T01:28:22.918ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = fc0aa61c-84f9-4d5a-810d-418a9b9a7bdf roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
136742025-03-01T01:28:22.918ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = fc0aa61c-84f9-4d5a-810d-418a9b9a7bdf resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
136752025-03-01T01:28:22.920ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2194 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = fc0aa61c-84f9-4d5a-810d-418a9b9a7bdf response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
136762025-03-01T01:28:23.213ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 28 reason = Timeout
136772025-03-01T01:28:23.213ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
136782025-03-01T01:28:23.213ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 28 reason = Timeout
136792025-03-01T01:28:23.213ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
136802025-03-01T01:28:23.213ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 82 reason = Timeout
136812025-03-01T01:28:23.213ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 28 reason = Timeout
136822025-03-01T01:28:23.213ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
136832025-03-01T01:28:23.213ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
136842025-03-01T01:28:23.213ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 28 reason = Timeout
136852025-03-01T01:28:23.213ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
136862025-03-01T01:28:23.213ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 28 reason = Timeout
136872025-03-01T01:28:23.213ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
136882025-03-01T01:28:23.213ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 30 reason = Timeout
136892025-03-01T01:28:23.213ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
136902025-03-01T01:28:23.213ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 29 reason = Timeout
136912025-03-01T01:28:23.213ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
136922025-03-01T01:28:23.213ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 28 reason = Timeout
136932025-03-01T01:28:23.213ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 28 reason = Timeout
136942025-03-01T01:28:23.213ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
136952025-03-01T01:28:23.213ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
136962025-03-01T01:28:23.213ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 28 reason = Timeout
136972025-03-01T01:28:23.213ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
136982025-03-01T01:28:23.213ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 28 reason = Timeout
136992025-03-01T01:28:23.213ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
137002025-03-01T01:28:23.213ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 82 reason = Timeout
137012025-03-01T01:28:23.213ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 28 reason = Timeout
137022025-03-01T01:28:23.213ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
137032025-03-01T01:28:23.213ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
137042025-03-01T01:28:23.213ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 28 reason = Timeout
137052025-03-01T01:28:23.213ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
137062025-03-01T01:28:23.213ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
137072025-03-01T01:28:23.213ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 28 reason = Timeout
137082025-03-01T01:28:23.213ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 28 reason = Timeout
137092025-03-01T01:28:23.213ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 29 reason = Timeout
137102025-03-01T01:28:23.213ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
137112025-03-01T01:28:23.213ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
137122025-03-01T01:28:23.213ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
137132025-03-01T01:28:23.213ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
137142025-03-01T01:28:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
137152025-03-01T01:28:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
137162025-03-01T01:28:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
137172025-03-01T01:28:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
137182025-03-01T01:28:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
137192025-03-01T01:28:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
137202025-03-01T01:28:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
137212025-03-01T01:28:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
137222025-03-01T01:28:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
137232025-03-01T01:28:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
137242025-03-01T01:28:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
137252025-03-01T01:28:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
137262025-03-01T01:28:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
137272025-03-01T01:28:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
137282025-03-01T01:28:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
137292025-03-01T01:28:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
137302025-03-01T01:28:23.216ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
137312025-03-01T01:28:23.216ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1713, tv_nsec: 904975929 } })
137322025-03-01T01:28:23.216ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.251126ms iteration = 28 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
137332025-03-01T01:28:23.217ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1154
137342025-03-01T01:28:23.217ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
137352025-03-01T01:28:23.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
137362025-03-01T01:28:23.218ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
137372025-03-01T01:28:23.218ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
137382025-03-01T01:28:23.218ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
137392025-03-01T01:28:23.218ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
137402025-03-01T01:28:23.218ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
137412025-03-01T01:28:23.218ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
137422025-03-01T01:28:23.220ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
137432025-03-01T01:28:23.220ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
137442025-03-01T01:28:23.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
137452025-03-01T01:28:23.220ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 6.702717ms iteration = 28 status = {"errors":[],"garbage_collect_requested":[]}
137462025-03-01T01:28:23.220ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
137472025-03-01T01:28:23.220ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
137482025-03-01T01:28:23.222ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1713, tv_nsec: 910501402 } })
137492025-03-01T01:28:23.222ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
137502025-03-01T01:28:23.222ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
137512025-03-01T01:28:23.222ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1154
137522025-03-01T01:28:23.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
137532025-03-01T01:28:23.222ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
137542025-03-01T01:28:23.222ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
137552025-03-01T01:28:23.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
137562025-03-01T01:28:23.224ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
137572025-03-01T01:28:23.224ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 10.733079ms iteration = 28 status = {"errors":[],"finish_invoked_ok":[]}
137582025-03-01T01:28:23.224ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
137592025-03-01T01:28:23.225ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
137602025-03-01T01:28:23.226ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 12.619577ms iteration = 82 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
137612025-03-01T01:28:23.226ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
137622025-03-01T01:28:23.227ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
137632025-03-01T01:28:23.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
137642025-03-01T01:28:23.227ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
137652025-03-01T01:28:23.227ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
137662025-03-01T01:28:23.227ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
137672025-03-01T01:28:23.227ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
137682025-03-01T01:28:23.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
137692025-03-01T01:28:23.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
137702025-03-01T01:28:23.227ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
137712025-03-01T01:28:23.227ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
137722025-03-01T01:28:23.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
137732025-03-01T01:28:23.228ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
137742025-03-01T01:28:23.228ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
137752025-03-01T01:28:23.228ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
137762025-03-01T01:28:23.229ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
137772025-03-01T01:28:23.229ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
137782025-03-01T01:28:23.230ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
137792025-03-01T01:28:23.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
137802025-03-01T01:28:23.230ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 17.17802ms iteration = 28 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
137812025-03-01T01:28:23.230ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
137822025-03-01T01:28:23.231ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
137832025-03-01T01:28:23.231ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1713, tv_nsec: 919373132 } })
137842025-03-01T01:28:23.231ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1154 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66
137852025-03-01T01:28:23.231ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
137862025-03-01T01:28:23.231ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
137872025-03-01T01:28:23.231ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
137882025-03-01T01:28:23.232ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
137892025-03-01T01:28:23.232ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
137902025-03-01T01:28:23.232ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
137912025-03-01T01:28:23.232ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
137922025-03-01T01:28:23.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
137932025-03-01T01:28:23.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
137942025-03-01T01:28:23.232ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
137952025-03-01T01:28:23.233ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
137962025-03-01T01:28:23.233ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 19.658961ms iteration = 28 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
137972025-03-01T01:28:23.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
137982025-03-01T01:28:23.233ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
137992025-03-01T01:28:23.234ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
138002025-03-01T01:28:23.234ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
138012025-03-01T01:28:23.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
138022025-03-01T01:28:23.236ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
138032025-03-01T01:28:23.236ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
138042025-03-01T01:28:23.236ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
138052025-03-01T01:28:23.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
138062025-03-01T01:28:23.237ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
138072025-03-01T01:28:23.239ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
138082025-03-01T01:28:23.239ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
138092025-03-01T01:28:23.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
138102025-03-01T01:28:23.240ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7, lookup_type: ById(8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7) } result = Ok(())
138112025-03-01T01:28:23.240ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
138122025-03-01T01:28:23.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
138132025-03-01T01:28:23.244ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
138142025-03-01T01:28:23.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
138152025-03-01T01:28:23.245ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
138162025-03-01T01:28:23.247ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
138172025-03-01T01:28:23.247ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
138182025-03-01T01:28:23.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
138192025-03-01T01:28:23.252ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
138202025-03-01T01:28:23.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
138212025-03-01T01:28:23.253ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 original_time_created = 2025-03-01 01:14:50.436545 UTC target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 time_created = 2025-03-01 01:14:50.436545 UTC
138222025-03-01T01:28:23.253ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 39.629317ms iteration = 82 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7","time_created":"2025-03-01T01:14:50.436545Z"}
138232025-03-01T01:28:23.258ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
138242025-03-01T01:28:23.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
138252025-03-01T01:28:23.260ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 46.573289ms iteration = 28 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
138262025-03-01T01:28:23.267ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
138272025-03-01T01:28:23.267ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
138282025-03-01T01:28:23.267ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 53.347336ms iteration = 28 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
138292025-03-01T01:28:23.271ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
138302025-03-01T01:28:23.271ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 58.134524ms iteration = 28 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
138312025-03-01T01:28:23.276ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 63.032904ms iteration = 30 status = {"physical_disks_added":0}
138322025-03-01T01:28:23.336ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
138332025-03-01T01:28:23.336ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
138342025-03-01T01:28:23.337ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6f7af70b-9cc5-4a60-a12a-e25bce940ef8", "content-length": "26", "date": "Sat, 01 Mar 2025 01:28:23 GMT"} })
138352025-03-01T01:28:23.337ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
138362025-03-01T01:28:23.338ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
138372025-03-01T01:28:23.369ZINFOnexus (BackgroundTasks): VPC route manager sled 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
138382025-03-01T01:28:23.369ZDEBGnexus (BackgroundTasks): client request SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
138392025-03-01T01:28:23.371ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
138402025-03-01T01:28:23.372ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 158.716664ms iteration = 28 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
138412025-03-01T01:28:23.373ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
138422025-03-01T01:28:23.373ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
138432025-03-01T01:28:23.373ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
138442025-03-01T01:28:23.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
138452025-03-01T01:28:23.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
138462025-03-01T01:28:23.375ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
138472025-03-01T01:28:23.377ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 3471264f-127e-4a25-bc10-2e8249e8d70a, lookup_type: ById(3471264f-127e-4a25-bc10-2e8249e8d70a) } result = Ok(())
138482025-03-01T01:28:23.377ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
138492025-03-01T01:28:23.377ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
138502025-03-01T01:28:23.379ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 165.91892ms iteration = 28 status = 0
138512025-03-01T01:28:23.416ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
138522025-03-01T01:28:23.416ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
138532025-03-01T01:28:23.416ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a4c77647-69bd-42bb-a143-d21fe3c4730e", "content-length": "26", "date": "Sat, 01 Mar 2025 01:28:23 GMT"} })
138542025-03-01T01:28:23.416ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
138552025-03-01T01:28:23.418ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
138562025-03-01T01:28:23.436ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1162 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 zone_address = fd00:1122:3344:101::2
138572025-03-01T01:28:23.436ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
138582025-03-01T01:28:23.436ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "11800370-1191-4f29-806c-8e3736fd3886", "content-length": "26", "date": "Sat, 01 Mar 2025 01:28:23 GMT"} })
138592025-03-01T01:28:23.436ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1167 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
138602025-03-01T01:28:23.438ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66
138612025-03-01T01:28:23.445ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
138622025-03-01T01:28:23.445ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "7f3a23a6-b8ac-4693-81fc-08cfb1be09c1", "content-length": "2", "date": "Sat, 01 Mar 2025 01:28:22 GMT"} })
138632025-03-01T01:28:23.446ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
138642025-03-01T01:28:23.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
138652025-03-01T01:28:23.447ZDEBGnexus (BackgroundTasks): client response SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "25cdef60-f657-4cf2-9e60-98db40cca66a", "content-length": "372", "date": "Sat, 01 Mar 2025 01:28:23 GMT"} })
138662025-03-01T01:28:23.447ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
138672025-03-01T01:28:23.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
138682025-03-01T01:28:23.452ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 238.901256ms iteration = 28 status = null
138692025-03-01T01:28:23.463ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
138702025-03-01T01:28:23.463ZDEBGnexus (BackgroundTasks): client request SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
138712025-03-01T01:28:23.463ZDEBGnexus (BackgroundTasks): client response SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "19e30668-19a8-4aba-85b4-4d393888613e", "date": "Sat, 01 Mar 2025 01:28:23 GMT"} })
138722025-03-01T01:28:23.463ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
138732025-03-01T01:28:23.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
138742025-03-01T01:28:23.466ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
138752025-03-01T01:28:23.466ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
138762025-03-01T01:28:23.478ZDEBGnexus (BackgroundTasks): client request SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
138772025-03-01T01:28:23.478ZDEBGnexus (BackgroundTasks): client response SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "4ed4a3fa-2875-4ec0-96b7-643b52917f19", "content-length": "691", "date": "Sat, 01 Mar 2025 01:28:23 GMT"} })
138782025-03-01T01:28:23.478ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
138792025-03-01T01:28:23.478ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
138802025-03-01T01:28:23.478ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
138812025-03-01T01:28:23.480ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 266.438968ms iteration = 29 status = {}
138822025-03-01T01:28:23.481ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
138832025-03-01T01:28:23.481ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
138842025-03-01T01:28:23.484ZINFOnexus (BackgroundTasks): VPC route manager sled 3471264f-127e-4a25-bc10-2e8249e8d70a push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
138852025-03-01T01:28:23.484ZDEBGnexus (BackgroundTasks): client request SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
138862025-03-01T01:28:23.484ZDEBGnexus (BackgroundTasks): client response SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "22a61f6b-09e9-4a89-8c2b-e2c1140b2aa0", "date": "Sat, 01 Mar 2025 01:28:23 GMT"} })
138872025-03-01T01:28:23.486ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 272.839278ms iteration = 29 status = {}
138882025-03-01T01:28:23.499ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 286.490936ms iteration = 28 status = {}
138892025-03-01T01:28:23.569ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
138902025-03-01T01:28:23.569ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
138912025-03-01T01:28:23.571ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 7f9c3c14-58c5-473f-8692-6376be44401e, rack_id: 4854cb88-dfba-4609-8f9d-72aac08cef66, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(cb10d0c6-a704-4231-b148-4f9ae21a03f8) } rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 switch_location = Switch0
138922025-03-01T01:28:23.571ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
138932025-03-01T01:28:23.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
138942025-03-01T01:28:23.579ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
138952025-03-01T01:28:23.580ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "6a36ab9f-7f49-4c61-ae5a-61e20365648d", "content-length": "134", "date": "Sat, 01 Mar 2025 01:28:22 GMT"} })
138962025-03-01T01:28:23.580ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
138972025-03-01T01:28:23.580ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = cb10d0c6-a704-4231-b148-4f9ae21a03f8
138982025-03-01T01:28:23.580ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
138992025-03-01T01:28:23.580ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
139002025-03-01T01:28:23.580ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
139012025-03-01T01:28:23.580ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
139022025-03-01T01:28:23.580ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
139032025-03-01T01:28:23.580ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
139042025-03-01T01:28:23.580ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
139052025-03-01T01:28:23.580ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
139062025-03-01T01:28:23.580ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66
139072025-03-01T01:28:23.580ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
139082025-03-01T01:28:23.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
139092025-03-01T01:28:23.582ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
139102025-03-01T01:28:23.582ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "d047c34b-e7f9-4d7a-bf52-4e97131f2060", "content-length": "2", "date": "Sat, 01 Mar 2025 01:28:22 GMT"} })
139112025-03-01T01:28:23.582ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
139122025-03-01T01:28:23.582ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "dac87625-8086-45bb-baa6-56935bf86469", "content-length": "52", "date": "Sat, 01 Mar 2025 01:28:22 GMT"} })
139132025-03-01T01:28:23.582ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 switch_location = Switch0
139142025-03-01T01:28:23.582ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
139152025-03-01T01:28:23.686ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "bdfb92ef-c6fd-4729-94bd-d75ddc65819f", "date": "Sat, 01 Mar 2025 01:28:23 GMT"} })
139162025-03-01T01:28:23.686ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 switch = Switch0
139172025-03-01T01:28:23.686ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
139182025-03-01T01:28:23.686ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "32c61da6-0ee1-44d1-a1dc-be1e8d091e25", "content-length": "682", "date": "Sat, 01 Mar 2025 01:28:23 GMT"} })
139192025-03-01T01:28:23.686ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
139202025-03-01T01:28:23.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
139212025-03-01T01:28:23.690ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
139222025-03-01T01:28:23.690ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
139232025-03-01T01:28:23.693ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
139242025-03-01T01:28:23.693ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
139252025-03-01T01:28:23.695ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
139262025-03-01T01:28:23.695ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
139272025-03-01T01:28:23.702ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 489.255716ms iteration = 28 status = {}
139282025-03-01T01:28:23.940ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = bef210bb-d2a5-4362-b256-a00f22a8b58c roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
139292025-03-01T01:28:23.941ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = bef210bb-d2a5-4362-b256-a00f22a8b58c resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
139302025-03-01T01:28:23.942ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2154 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = bef210bb-d2a5-4362-b256-a00f22a8b58c response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
139312025-03-01T01:28:24.134ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
139322025-03-01T01:28:24.134ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
139332025-03-01T01:28:24.164ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
139342025-03-01T01:28:24.165ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:58471
139352025-03-01T01:28:24.165ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:58471 req_id = 43124375-1991-4dfa-b132-ed39f8a34c8c roles = RoleSet { roles: {} } uri = /metrics/producers
139362025-03-01T01:28:24.165ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:58471 req_id = 43124375-1991-4dfa-b132-ed39f8a34c8c resource = Database result = Ok(()) uri = /metrics/producers
139372025-03-01T01:28:24.203ZINFOnexus: assigned collector to new producer collector_id = d77aa5d6-e6f9-4845-b1d4-57f91a3621e6 file = nexus/src/app/oximeter.rs:76 producer_id = 67b03f4e-4cbd-4843-9cd9-647f610abcfc
139382025-03-01T01:28:24.203ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 38562 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:58471 req_id = 43124375-1991-4dfa-b132-ed39f8a34c8c response_code = 201 uri = /metrics/producers
139392025-03-01T01:28:24.203ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "43124375-1991-4dfa-b132-ed39f8a34c8c", "content-length": "41", "date": "Sat, 01 Mar 2025 01:28:24 GMT"} })
139402025-03-01T01:28:24.205ZDEBGnexus (producer-registration-task): registered with nexus successfully
139412025-03-01T01:28:24.205ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
139422025-03-01T01:28:24.961ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 8b541269-943d-4111-894a-8745aea1daeb roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
139432025-03-01T01:28:24.961ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 8b541269-943d-4111-894a-8745aea1daeb resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
139442025-03-01T01:28:24.963ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2325 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 8b541269-943d-4111-894a-8745aea1daeb response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
139452025-03-01T01:28:25.982ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = ac882f1d-07bb-4717-bef1-39d452cfd049 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
139462025-03-01T01:28:25.982ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = ac882f1d-07bb-4717-bef1-39d452cfd049 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
139472025-03-01T01:28:25.984ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2306 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = ac882f1d-07bb-4717-bef1-39d452cfd049 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
139482025-03-01T01:28:27.003ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 5a2d9ca7-2567-4d93-894d-6caf322b3ceb roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
139492025-03-01T01:28:27.004ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 5a2d9ca7-2567-4d93-894d-6caf322b3ceb resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
139502025-03-01T01:28:27.006ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2482 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 5a2d9ca7-2567-4d93-894d-6caf322b3ceb response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
139512025-03-01T01:28:27.414ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 449 local_addr = [fd00:1122:3344:101::c]:34357 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = d18ee8d9-e26e-4731-9ab3-5c852413f9ae response_code = 200 uri = /67b03f4e-4cbd-4843-9cd9-647f610abcfc
139522025-03-01T01:28:28.026ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 8756a933-4992-4eef-935f-9709a85aad75 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
139532025-03-01T01:28:28.027ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 8756a933-4992-4eef-935f-9709a85aad75 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
139542025-03-01T01:28:28.029ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2541 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 8756a933-4992-4eef-935f-9709a85aad75 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
139552025-03-01T01:28:29.049ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 2fb3f8b5-ce8e-4fdf-b3c9-efbb08c8e171 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
139562025-03-01T01:28:29.049ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 2fb3f8b5-ce8e-4fdf-b3c9-efbb08c8e171 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
139572025-03-01T01:28:29.051ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1962 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 2fb3f8b5-ce8e-4fdf-b3c9-efbb08c8e171 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
139582025-03-01T01:28:30.070ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 0f839a2d-b872-459c-922a-3e38cd780cea roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
139592025-03-01T01:28:30.070ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 0f839a2d-b872-459c-922a-3e38cd780cea resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
139602025-03-01T01:28:30.072ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2434 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 0f839a2d-b872-459c-922a-3e38cd780cea response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
139612025-03-01T01:28:31.092ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = b06630ba-6606-4468-af34-1089012f85fb roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
139622025-03-01T01:28:31.092ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = b06630ba-6606-4468-af34-1089012f85fb resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
139632025-03-01T01:28:31.094ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2311 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = b06630ba-6606-4468-af34-1089012f85fb response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
139642025-03-01T01:28:32.112ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 4d0236a0-c493-4dc6-93a7-80b423f81695 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
139652025-03-01T01:28:32.113ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 4d0236a0-c493-4dc6-93a7-80b423f81695 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
139662025-03-01T01:28:32.114ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2222 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 4d0236a0-c493-4dc6-93a7-80b423f81695 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
139672025-03-01T01:28:33.134ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 882bc022-c95c-47cb-bbf3-a15615f73c1b roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
139682025-03-01T01:28:33.135ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 882bc022-c95c-47cb-bbf3-a15615f73c1b resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
139692025-03-01T01:28:33.137ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2546 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 882bc022-c95c-47cb-bbf3-a15615f73c1b response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
139702025-03-01T01:28:33.214ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 83 reason = Timeout
139712025-03-01T01:28:33.214ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 83 reason = Timeout
139722025-03-01T01:28:33.214ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
139732025-03-01T01:28:33.214ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
139742025-03-01T01:28:33.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
139752025-03-01T01:28:33.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
139762025-03-01T01:28:33.216ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
139772025-03-01T01:28:33.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
139782025-03-01T01:28:33.217ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
139792025-03-01T01:28:33.218ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.717795ms iteration = 83 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
139802025-03-01T01:28:33.219ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
139812025-03-01T01:28:33.219ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
139822025-03-01T01:28:33.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
139832025-03-01T01:28:33.221ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
139842025-03-01T01:28:33.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
139852025-03-01T01:28:33.223ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
139862025-03-01T01:28:33.225ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7, lookup_type: ById(8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7) } result = Ok(())
139872025-03-01T01:28:33.225ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
139882025-03-01T01:28:33.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
139892025-03-01T01:28:33.234ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 original_time_created = 2025-03-01 01:14:50.436545 UTC target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 time_created = 2025-03-01 01:14:50.436545 UTC
139902025-03-01T01:28:33.234ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.712332ms iteration = 83 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7","time_created":"2025-03-01T01:14:50.436545Z"}
139912025-03-01T01:28:34.158ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 669d36a8-6dd5-49b0-8a5d-53888bcb2e22 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
139922025-03-01T01:28:34.158ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 669d36a8-6dd5-49b0-8a5d-53888bcb2e22 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
139932025-03-01T01:28:34.161ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2812 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 669d36a8-6dd5-49b0-8a5d-53888bcb2e22 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
139942025-03-01T01:28:35.179ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = e29ae7e9-bf99-4a15-9b1a-c856337fe3db roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
139952025-03-01T01:28:35.180ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = e29ae7e9-bf99-4a15-9b1a-c856337fe3db resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
139962025-03-01T01:28:35.182ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2532 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = e29ae7e9-bf99-4a15-9b1a-c856337fe3db response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
139972025-03-01T01:28:36.202ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = a502e9dc-4bed-4ce7-a52f-23dae47974a5 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
139982025-03-01T01:28:36.202ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = a502e9dc-4bed-4ce7-a52f-23dae47974a5 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
139992025-03-01T01:28:36.204ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2111 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = a502e9dc-4bed-4ce7-a52f-23dae47974a5 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
140002025-03-01T01:28:37.225ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 2040bbfe-997d-4309-abeb-c913f2e03ace roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
140012025-03-01T01:28:37.225ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 2040bbfe-997d-4309-abeb-c913f2e03ace resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
140022025-03-01T01:28:37.227ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2551 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 2040bbfe-997d-4309-abeb-c913f2e03ace response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
140032025-03-01T01:28:37.413ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 370 local_addr = [fd00:1122:3344:101::c]:34357 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = e342a5b4-9c2b-485d-a16f-909ac7356f99 response_code = 200 uri = /67b03f4e-4cbd-4843-9cd9-647f610abcfc
140042025-03-01T01:28:38.248ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 31bce382-dccb-45d9-b3ca-2b5413491fd5 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
140052025-03-01T01:28:38.249ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 31bce382-dccb-45d9-b3ca-2b5413491fd5 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
140062025-03-01T01:28:38.250ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2389 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 31bce382-dccb-45d9-b3ca-2b5413491fd5 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
140072025-03-01T01:28:39.269ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 41ab256a-f113-4ee5-86fa-50e60baf7bf2 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
140082025-03-01T01:28:39.270ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 41ab256a-f113-4ee5-86fa-50e60baf7bf2 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
140092025-03-01T01:28:39.272ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2599 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 41ab256a-f113-4ee5-86fa-50e60baf7bf2 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
140102025-03-01T01:28:40.291ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 38c17787-2991-4b4d-a47e-52722d15fd88 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
140112025-03-01T01:28:40.292ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 38c17787-2991-4b4d-a47e-52722d15fd88 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
140122025-03-01T01:28:40.294ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2419 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 38c17787-2991-4b4d-a47e-52722d15fd88 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
140132025-03-01T01:28:41.313ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 607280b9-2d38-4266-9b4a-74649dffb9d3 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
140142025-03-01T01:28:41.313ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 607280b9-2d38-4266-9b4a-74649dffb9d3 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
140152025-03-01T01:28:41.315ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2306 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 607280b9-2d38-4266-9b4a-74649dffb9d3 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
140162025-03-01T01:28:42.335ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 7e9ef29b-1dfe-4dd9-93a7-d94267524362 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
140172025-03-01T01:28:42.335ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 7e9ef29b-1dfe-4dd9-93a7-d94267524362 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
140182025-03-01T01:28:42.337ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2429 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 7e9ef29b-1dfe-4dd9-93a7-d94267524362 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
140192025-03-01T01:28:43.213ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 84 reason = Timeout
140202025-03-01T01:28:43.213ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
140212025-03-01T01:28:43.213ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 84 reason = Timeout
140222025-03-01T01:28:43.213ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
140232025-03-01T01:28:43.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
140242025-03-01T01:28:43.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
140252025-03-01T01:28:43.216ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
140262025-03-01T01:28:43.216ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
140272025-03-01T01:28:43.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
140282025-03-01T01:28:43.218ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.90379ms iteration = 84 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
140292025-03-01T01:28:43.218ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
140302025-03-01T01:28:43.218ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
140312025-03-01T01:28:43.218ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
140322025-03-01T01:28:43.220ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
140332025-03-01T01:28:43.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
140342025-03-01T01:28:43.222ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
140352025-03-01T01:28:43.224ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7, lookup_type: ById(8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7) } result = Ok(())
140362025-03-01T01:28:43.224ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
140372025-03-01T01:28:43.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
140382025-03-01T01:28:43.234ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 original_time_created = 2025-03-01 01:14:50.436545 UTC target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 time_created = 2025-03-01 01:14:50.436545 UTC
140392025-03-01T01:28:43.234ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.875815ms iteration = 84 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7","time_created":"2025-03-01T01:14:50.436545Z"}
140402025-03-01T01:28:43.356ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = bae491e1-01db-47aa-b8d6-9c3ee449fe5c roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
140412025-03-01T01:28:43.356ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = bae491e1-01db-47aa-b8d6-9c3ee449fe5c resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
140422025-03-01T01:28:43.358ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2210 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = bae491e1-01db-47aa-b8d6-9c3ee449fe5c response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
140432025-03-01T01:28:44.379ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 04adea34-9c52-440a-803e-9f586837d0ea roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
140442025-03-01T01:28:44.379ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 04adea34-9c52-440a-803e-9f586837d0ea resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
140452025-03-01T01:28:44.381ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2450 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 04adea34-9c52-440a-803e-9f586837d0ea response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
140462025-03-01T01:28:45.400ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = b13f1476-73fb-437f-acba-38eb7e52970c roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
140472025-03-01T01:28:45.401ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = b13f1476-73fb-437f-acba-38eb7e52970c resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
140482025-03-01T01:28:45.403ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2588 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = b13f1476-73fb-437f-acba-38eb7e52970c response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
140492025-03-01T01:28:46.421ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 50c56bfa-e672-4776-8d6c-e83b19a3a299 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
140502025-03-01T01:28:46.422ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 50c56bfa-e672-4776-8d6c-e83b19a3a299 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
140512025-03-01T01:28:46.424ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2762 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 50c56bfa-e672-4776-8d6c-e83b19a3a299 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
140522025-03-01T01:28:47.414ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 369 local_addr = [fd00:1122:3344:101::c]:34357 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = ed83d6ee-4703-47e7-8943-2cabb0f26cfa response_code = 200 uri = /67b03f4e-4cbd-4843-9cd9-647f610abcfc
140532025-03-01T01:28:47.443ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 073294d1-3f9e-4612-9a8f-9bb7e9d6cb8f roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
140542025-03-01T01:28:47.444ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 073294d1-3f9e-4612-9a8f-9bb7e9d6cb8f resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
140552025-03-01T01:28:47.445ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1977 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 073294d1-3f9e-4612-9a8f-9bb7e9d6cb8f response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
140562025-03-01T01:28:48.466ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 96de9d4e-a7ae-4b5e-9f55-42fbfa301fbb roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
140572025-03-01T01:28:48.466ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 96de9d4e-a7ae-4b5e-9f55-42fbfa301fbb resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
140582025-03-01T01:28:48.469ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2638 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 96de9d4e-a7ae-4b5e-9f55-42fbfa301fbb response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
140592025-03-01T01:28:49.489ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 0177b542-2919-40db-82a1-4e29718f0ae5 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
140602025-03-01T01:28:49.489ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 0177b542-2919-40db-82a1-4e29718f0ae5 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
140612025-03-01T01:28:49.491ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2472 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 0177b542-2919-40db-82a1-4e29718f0ae5 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
140622025-03-01T01:28:50.510ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 0c03bdca-597b-4d61-86e7-087c70287d88 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
140632025-03-01T01:28:50.511ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 0c03bdca-597b-4d61-86e7-087c70287d88 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
140642025-03-01T01:28:50.513ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2704 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 0c03bdca-597b-4d61-86e7-087c70287d88 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
140652025-03-01T01:28:51.532ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 90cf26dd-9b68-4ff7-bacb-f489e99172ce roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
140662025-03-01T01:28:51.533ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 90cf26dd-9b68-4ff7-bacb-f489e99172ce resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
140672025-03-01T01:28:51.535ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2415 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 90cf26dd-9b68-4ff7-bacb-f489e99172ce response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
140682025-03-01T01:28:52.554ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = e50dc091-7fdc-40a0-9d61-b5d841fb6435 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
140692025-03-01T01:28:52.554ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = e50dc091-7fdc-40a0-9d61-b5d841fb6435 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
140702025-03-01T01:28:52.555ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1780 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = e50dc091-7fdc-40a0-9d61-b5d841fb6435 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
140712025-03-01T01:28:53.213ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 85 reason = Timeout
140722025-03-01T01:28:53.213ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 17 reason = Timeout
140732025-03-01T01:28:53.213ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
140742025-03-01T01:28:53.213ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 17 reason = Timeout
140752025-03-01T01:28:53.213ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 15 reason = Timeout
140762025-03-01T01:28:53.213ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 29 reason = Timeout
140772025-03-01T01:28:53.213ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
140782025-03-01T01:28:53.213ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
140792025-03-01T01:28:53.213ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 15 reason = Timeout
140802025-03-01T01:28:53.213ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 29 reason = Timeout
140812025-03-01T01:28:53.213ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 15 reason = Timeout
140822025-03-01T01:28:53.213ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
140832025-03-01T01:28:53.213ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
140842025-03-01T01:28:53.213ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
140852025-03-01T01:28:53.213ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 29 reason = Timeout
140862025-03-01T01:28:53.213ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 29 reason = Timeout
140872025-03-01T01:28:53.213ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
140882025-03-01T01:28:53.213ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
140892025-03-01T01:28:53.213ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 85 reason = Timeout
140902025-03-01T01:28:53.213ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
140912025-03-01T01:28:53.213ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 15 reason = Timeout
140922025-03-01T01:28:53.213ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
140932025-03-01T01:28:53.213ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 29 reason = Timeout
140942025-03-01T01:28:53.213ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
140952025-03-01T01:28:53.213ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 31 reason = Timeout
140962025-03-01T01:28:53.213ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 15 reason = Timeout
140972025-03-01T01:28:53.213ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
140982025-03-01T01:28:53.213ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
140992025-03-01T01:28:53.213ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 30 reason = Timeout
141002025-03-01T01:28:53.213ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
141012025-03-01T01:28:53.213ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 29 reason = Timeout
141022025-03-01T01:28:53.213ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
141032025-03-01T01:28:53.213ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 16 reason = Timeout
141042025-03-01T01:28:53.213ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7
141052025-03-01T01:28:53.213ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 11.63\u{b5}s iteration = 16 status = {"enabled":false,"target_id":"8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7"}
141062025-03-01T01:28:53.213ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 15 reason = Timeout
141072025-03-01T01:28:53.213ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 15 reason = Timeout
141082025-03-01T01:28:53.213ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
141092025-03-01T01:28:53.213ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
141102025-03-01T01:28:53.213ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
141112025-03-01T01:28:53.213ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 15 reason = Timeout
141122025-03-01T01:28:53.213ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
141132025-03-01T01:28:53.213ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
141142025-03-01T01:28:53.213ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 29 reason = Timeout
141152025-03-01T01:28:53.213ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
141162025-03-01T01:28:53.213ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 29 reason = Timeout
141172025-03-01T01:28:53.213ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
141182025-03-01T01:28:53.213ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 30 reason = Timeout
141192025-03-01T01:28:53.214ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
141202025-03-01T01:28:53.214ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
141212025-03-01T01:28:53.214ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 29 reason = Timeout
141222025-03-01T01:28:53.214ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
141232025-03-01T01:28:53.214ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 29 reason = Timeout
141242025-03-01T01:28:53.214ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
141252025-03-01T01:28:53.214ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 15 reason = Timeout
141262025-03-01T01:28:53.214ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 29 reason = Timeout
141272025-03-01T01:28:53.214ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
141282025-03-01T01:28:53.214ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
141292025-03-01T01:28:53.214ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 29 reason = Timeout
141302025-03-01T01:28:53.214ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 29 reason = Timeout
141312025-03-01T01:28:53.214ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
141322025-03-01T01:28:53.214ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 15 reason = Timeout
141332025-03-01T01:28:53.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
141342025-03-01T01:28:53.214ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-03-01 01:18:53.213912658 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
141352025-03-01T01:28:53.214ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
141362025-03-01T01:28:53.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
141372025-03-01T01:28:53.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
141382025-03-01T01:28:53.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
141392025-03-01T01:28:53.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
141402025-03-01T01:28:53.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
141412025-03-01T01:28:53.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
141422025-03-01T01:28:53.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
141432025-03-01T01:28:53.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
141442025-03-01T01:28:53.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
141452025-03-01T01:28:53.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
141462025-03-01T01:28:53.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
141472025-03-01T01:28:53.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
141482025-03-01T01:28:53.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
141492025-03-01T01:28:53.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
141502025-03-01T01:28:53.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
141512025-03-01T01:28:53.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
141522025-03-01T01:28:53.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
141532025-03-01T01:28:53.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
141542025-03-01T01:28:53.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
141552025-03-01T01:28:53.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
141562025-03-01T01:28:53.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
141572025-03-01T01:28:53.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
141582025-03-01T01:28:53.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
141592025-03-01T01:28:53.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
141602025-03-01T01:28:53.214ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2e37f4af-57dc-468e-80e3-cf2aea2ffdc8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5f6eb3bd-0126-40e0-98ef-ee33df084158.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("5f6eb3bd-0126-40e0-98ef-ee33df084158.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1743, tv_nsec: 902818625 } })
141612025-03-01T01:28:53.214ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("3a9b8294-d9f3-4130-a669-e74c6f1f65a0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("450e8d93-9ed3-4721-9fe9-42521f60bc93.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a4f72c78-99c6-478d-b490-f7d8793d4173.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("a4f72c78-99c6-478d-b490-f7d8793d4173.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1743, tv_nsec: 902820035 } })
141622025-03-01T01:28:53.215ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
141632025-03-01T01:28:53.215ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.522602ms iteration = 15 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
141642025-03-01T01:28:53.215ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
141652025-03-01T01:28:53.215ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.286946ms iteration = 15 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
141662025-03-01T01:28:53.216ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
141672025-03-01T01:28:53.217ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
141682025-03-01T01:28:53.217ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.297827ms iteration = 29 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
141692025-03-01T01:28:53.217ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
141702025-03-01T01:28:53.218ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1743, tv_nsec: 907145253 } })
141712025-03-01T01:28:53.218ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1743, tv_nsec: 907275156 } })
141722025-03-01T01:28:53.219ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1154
141732025-03-01T01:28:53.219ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1154
141742025-03-01T01:28:53.219ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
141752025-03-01T01:28:53.219ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
141762025-03-01T01:28:53.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
141772025-03-01T01:28:53.220ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
141782025-03-01T01:28:53.220ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
141792025-03-01T01:28:53.220ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
141802025-03-01T01:28:53.220ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
141812025-03-01T01:28:53.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
141822025-03-01T01:28:53.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
141832025-03-01T01:28:53.221ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 8.36416ms iteration = 15 status = {"errors":[],"found_port_ok":[]}
141842025-03-01T01:28:53.222ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
141852025-03-01T01:28:53.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
141862025-03-01T01:28:53.222ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
141872025-03-01T01:28:53.223ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
141882025-03-01T01:28:53.223ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
141892025-03-01T01:28:53.223ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
141902025-03-01T01:28:53.224ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 10.3607ms iteration = 15 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
141912025-03-01T01:28:53.224ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
141922025-03-01T01:28:53.225ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
141932025-03-01T01:28:53.225ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
141942025-03-01T01:28:53.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
141952025-03-01T01:28:53.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
141962025-03-01T01:28:53.226ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
141972025-03-01T01:28:53.226ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
141982025-03-01T01:28:53.226ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
141992025-03-01T01:28:53.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
142002025-03-01T01:28:53.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
142012025-03-01T01:28:53.227ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
142022025-03-01T01:28:53.227ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
142032025-03-01T01:28:53.228ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
142042025-03-01T01:28:53.229ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
142052025-03-01T01:28:53.231ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
142062025-03-01T01:28:53.231ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
142072025-03-01T01:28:53.231ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
142082025-03-01T01:28:53.231ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
142092025-03-01T01:28:53.231ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
142102025-03-01T01:28:53.231ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
142112025-03-01T01:28:53.232ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
142122025-03-01T01:28:53.234ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
142132025-03-01T01:28:53.235ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
142142025-03-01T01:28:53.235ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
142152025-03-01T01:28:53.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
142162025-03-01T01:28:53.237ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
142172025-03-01T01:28:53.237ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
142182025-03-01T01:28:53.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
142192025-03-01T01:28:53.241ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 28.223125ms iteration = 85 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
142202025-03-01T01:28:53.243ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
142212025-03-01T01:28:53.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
142222025-03-01T01:28:53.243ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
142232025-03-01T01:28:53.244ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
142242025-03-01T01:28:53.244ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-03-01 01:18:53.213912658 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
142252025-03-01T01:28:53.244ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 30.969981ms iteration = 15 status = {"expiration":"2025-03-01T01:18:53.213912658Z","pruned":[]}
142262025-03-01T01:28:53.245ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
142272025-03-01T01:28:53.246ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1743, tv_nsec: 934421199 } })
142282025-03-01T01:28:53.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
142292025-03-01T01:28:53.246ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1154 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66
142302025-03-01T01:28:53.246ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
142312025-03-01T01:28:53.247ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
142322025-03-01T01:28:53.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
142332025-03-01T01:28:53.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
142342025-03-01T01:28:53.247ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
142352025-03-01T01:28:53.248ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
142362025-03-01T01:28:53.248ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
142372025-03-01T01:28:53.248ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
142382025-03-01T01:28:53.248ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
142392025-03-01T01:28:53.248ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
142402025-03-01T01:28:53.249ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
142412025-03-01T01:28:53.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
142422025-03-01T01:28:53.250ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
142432025-03-01T01:28:53.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
142442025-03-01T01:28:53.251ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
142452025-03-01T01:28:53.251ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
142462025-03-01T01:28:53.251ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
142472025-03-01T01:28:53.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
142482025-03-01T01:28:53.251ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
142492025-03-01T01:28:53.252ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
142502025-03-01T01:28:53.256ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
142512025-03-01T01:28:53.256ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
142522025-03-01T01:28:53.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
142532025-03-01T01:28:53.256ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
142542025-03-01T01:28:53.256ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
142552025-03-01T01:28:53.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
142562025-03-01T01:28:53.257ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7, lookup_type: ById(8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7) } result = Ok(())
142572025-03-01T01:28:53.257ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
142582025-03-01T01:28:53.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
142592025-03-01T01:28:53.261ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
142602025-03-01T01:28:53.261ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
142612025-03-01T01:28:53.262ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
142622025-03-01T01:28:53.263ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
142632025-03-01T01:28:53.264ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
142642025-03-01T01:28:53.265ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
142652025-03-01T01:28:53.265ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
142662025-03-01T01:28:53.266ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
142672025-03-01T01:28:53.267ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
142682025-03-01T01:28:53.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
142692025-03-01T01:28:53.268ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
142702025-03-01T01:28:53.269ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
142712025-03-01T01:28:53.269ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
142722025-03-01T01:28:53.270ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
142732025-03-01T01:28:53.271ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
142742025-03-01T01:28:53.271ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
142752025-03-01T01:28:53.271ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
142762025-03-01T01:28:53.272ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
142772025-03-01T01:28:53.272ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 58.823458ms iteration = 29 status = {"errors":[],"garbage_collect_requested":[]}
142782025-03-01T01:28:53.273ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
142792025-03-01T01:28:53.274ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
142802025-03-01T01:28:53.277ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
142812025-03-01T01:28:53.277ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
142822025-03-01T01:28:53.277ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
142832025-03-01T01:28:53.277ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 63.050904ms iteration = 29 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
142842025-03-01T01:28:53.278ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
142852025-03-01T01:28:53.278ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
142862025-03-01T01:28:53.278ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
142872025-03-01T01:28:53.293ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
142882025-03-01T01:28:53.293ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
142892025-03-01T01:28:53.293ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
142902025-03-01T01:28:53.293ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
142912025-03-01T01:28:53.294ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 original_time_created = 2025-03-01 01:14:50.436545 UTC target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 time_created = 2025-03-01 01:14:50.436545 UTC
142922025-03-01T01:28:53.294ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 81.160884ms iteration = 85 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7","time_created":"2025-03-01T01:14:50.436545Z"}
142932025-03-01T01:28:53.298ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
142942025-03-01T01:28:53.298ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
142952025-03-01T01:28:53.298ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 84.859409ms iteration = 15 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
142962025-03-01T01:28:53.299ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
142972025-03-01T01:28:53.299ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
142982025-03-01T01:28:53.299ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-03-01T01:14:49.537343Z, time_modified: 2025-03-01T01:14:49.537343Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 1682a303-6254-452b-b4cf-160ed9dc3fc9, db_silo: Silo { identity: SiloIdentity { id: 1682a303-6254-452b-b4cf-160ed9dc3fc9, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-03-01T01:14:54.631650Z, time_modified: 2025-03-01T01:14:54.631650Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "851c0b739689cfb98a2e401e6047fa98e9fcc283d9fc3f660bd69842a9c06be9" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 1682a303-6254-452b-b4cf-160ed9dc3fc9, db_silo: Silo { identity: SiloIdentity { id: 1682a303-6254-452b-b4cf-160ed9dc3fc9, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-03-01T01:14:54.631650Z, time_modified: 2025-03-01T01:14:54.631650Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "851c0b739689cfb98a2e401e6047fa98e9fcc283d9fc3f660bd69842a9c06be9" }] }) }
142992025-03-01T01:28:53.299ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 86.146205ms iteration = 15 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"1682a303-6254-452b-b4cf-160ed9dc3fc9","tls_certs":["851c0b739689cfb98a2e401e6047fa98e9fcc283d9fc3f660bd69842a9c06be9"]}},"default_endpoint":{"silo_id":"1682a303-6254-452b-b4cf-160ed9dc3fc9","tls_certs":["851c0b739689cfb98a2e401e6047fa98e9fcc283d9fc3f660bd69842a9c06be9"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
143002025-03-01T01:28:53.300ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
143012025-03-01T01:28:53.300ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
143022025-03-01T01:28:53.301ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
143032025-03-01T01:28:53.301ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
143042025-03-01T01:28:53.301ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
143052025-03-01T01:28:53.301ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 87.906791ms iteration = 29 status = {"errors":[],"finish_invoked_ok":[]}
143062025-03-01T01:28:53.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
143072025-03-01T01:28:53.302ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
143082025-03-01T01:28:53.302ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
143092025-03-01T01:28:53.302ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
143102025-03-01T01:28:53.302ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
143112025-03-01T01:28:53.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
143122025-03-01T01:28:53.303ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
143132025-03-01T01:28:53.303ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 89.729238ms iteration = 29 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
143142025-03-01T01:28:53.303ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
143152025-03-01T01:28:53.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
143162025-03-01T01:28:53.316ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
143172025-03-01T01:28:53.316ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = cce65e3e-6c86-4cdd-98ad-9a38c98082e8 dns_zone_name = oxide.test found_so_far = 0 version = 2
143182025-03-01T01:28:53.316ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
143192025-03-01T01:28:53.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
143202025-03-01T01:28:53.319ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 106.149813ms iteration = 29 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
143212025-03-01T01:28:53.342ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
143222025-03-01T01:28:53.359ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
143232025-03-01T01:28:53.359ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 145.426402ms iteration = 15 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
143242025-03-01T01:28:53.408ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 194.440331ms iteration = 31 status = {"physical_disks_added":0}
143252025-03-01T01:28:53.408ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
143262025-03-01T01:28:53.448ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
143272025-03-01T01:28:53.448ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
143282025-03-01T01:28:53.448ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a999cbf1-f955-4ffe-a7fc-0730a3dd4b41", "content-length": "26", "date": "Sat, 01 Mar 2025 01:28:53 GMT"} })
143292025-03-01T01:28:53.448ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
143302025-03-01T01:28:53.449ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
143312025-03-01T01:28:53.449ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
143322025-03-01T01:28:53.449ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ee7597fd-ecfe-46af-95a7-151f71b3a891", "content-length": "26", "date": "Sat, 01 Mar 2025 01:28:53 GMT"} })
143332025-03-01T01:28:53.449ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
143342025-03-01T01:28:53.453ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
143352025-03-01T01:28:53.455ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
143362025-03-01T01:28:53.466ZINFOnexus (BackgroundTasks): VPC route manager sled 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
143372025-03-01T01:28:53.466ZDEBGnexus (BackgroundTasks): client request SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
143382025-03-01T01:28:53.466ZDEBGnexus (BackgroundTasks): client response SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "733e154a-305c-416c-8902-46f38893c952", "content-length": "372", "date": "Sat, 01 Mar 2025 01:28:53 GMT"} })
143392025-03-01T01:28:53.466ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
143402025-03-01T01:28:53.466ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
143412025-03-01T01:28:53.534ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
143422025-03-01T01:28:53.534ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "9090adc0-23d1-4695-9fab-bcdb6bc41a4c", "date": "Sat, 01 Mar 2025 01:28:53 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
143432025-03-01T01:28:53.534ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
143442025-03-01T01:28:53.536ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "4f42c3a3-1d6f-4ab8-af6d-bced26e3b304", "date": "Sat, 01 Mar 2025 01:28:53 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
143452025-03-01T01:28:53.536ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
143462025-03-01T01:28:53.536ZDEBGnexus (BackgroundTasks): client request SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
143472025-03-01T01:28:53.537ZDEBGnexus (BackgroundTasks): client response SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "434e5dd3-0e52-4443-930d-7550b2e2b041", "content-length": "691", "date": "Sat, 01 Mar 2025 01:28:53 GMT"} })
143482025-03-01T01:28:53.537ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
143492025-03-01T01:28:53.537ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
143502025-03-01T01:28:53.537ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
143512025-03-01T01:28:53.538ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
143522025-03-01T01:28:53.538ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 324.732365ms iteration = 17 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
143532025-03-01T01:28:53.539ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 325.45301ms iteration = 30 status = {}
143542025-03-01T01:28:53.539ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
143552025-03-01T01:28:53.540ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
143562025-03-01T01:28:53.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
143572025-03-01T01:28:53.541ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
143582025-03-01T01:28:53.541ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
143592025-03-01T01:28:53.541ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
143602025-03-01T01:28:53.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
143612025-03-01T01:28:53.542ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
143622025-03-01T01:28:53.545ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
143632025-03-01T01:28:53.545ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
143642025-03-01T01:28:53.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
143652025-03-01T01:28:53.547ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 3471264f-127e-4a25-bc10-2e8249e8d70a, lookup_type: ById(3471264f-127e-4a25-bc10-2e8249e8d70a) } result = Ok(())
143662025-03-01T01:28:53.547ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
143672025-03-01T01:28:53.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
143682025-03-01T01:28:53.549ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 335.884442ms iteration = 29 status = 0
143692025-03-01T01:28:53.570ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
143702025-03-01T01:28:53.570ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
143712025-03-01T01:28:53.570ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
143722025-03-01T01:28:53.571ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 357.132885ms iteration = 29 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
143732025-03-01T01:28:53.575ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
143742025-03-01T01:28:53.575ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
143752025-03-01T01:28:53.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
143762025-03-01T01:28:53.575ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = cc8b89a8-8cf8-4181-a275-8944e947710c roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
143772025-03-01T01:28:53.576ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = cc8b89a8-8cf8-4181-a275-8944e947710c resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
143782025-03-01T01:28:53.578ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2381 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = cc8b89a8-8cf8-4181-a275-8944e947710c response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
143792025-03-01T01:28:53.578ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = cce65e3e-6c86-4cdd-98ad-9a38c98082e8 dns_zone_name = oxide.test found_so_far = 1 version = 2
143802025-03-01T01:28:53.578ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
143812025-03-01T01:28:53.578ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-03-01 01:14:54.679503 UTC dns_group = external generation = 2
143822025-03-01T01:28:53.578ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 364.732219ms iteration = 15 status = {"generation":2}
143832025-03-01T01:28:53.578ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
143842025-03-01T01:28:53.578ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 0a9e4b5c-53a1-4f0a-8849-98a8b1852af3 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
143852025-03-01T01:28:53.578ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
143862025-03-01T01:28:53.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
143872025-03-01T01:28:53.580ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
143882025-03-01T01:28:53.582ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 369.15674ms iteration = 29 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
143892025-03-01T01:28:53.584ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
143902025-03-01T01:28:53.584ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 371.110679ms iteration = 29 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
143912025-03-01T01:28:53.585ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
143922025-03-01T01:28:53.585ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
143932025-03-01T01:28:53.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
143942025-03-01T01:28:53.587ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 0a9e4b5c-53a1-4f0a-8849-98a8b1852af3 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
143952025-03-01T01:28:53.587ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
143962025-03-01T01:28:53.587ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-03-01 01:14:53.460216 UTC dns_group = internal generation = 1
143972025-03-01T01:28:53.587ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 374.175282ms iteration = 15 status = {"generation":1}
143982025-03-01T01:28:53.604ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
143992025-03-01T01:28:53.604ZDEBGnexus (BackgroundTasks): client request SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
144002025-03-01T01:28:53.604ZDEBGnexus (BackgroundTasks): client response SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "f435a1e1-ee21-4409-97a9-f3fe3c03f7f2", "date": "Sat, 01 Mar 2025 01:28:53 GMT"} })
144012025-03-01T01:28:53.604ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
144022025-03-01T01:28:53.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
144032025-03-01T01:28:53.607ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
144042025-03-01T01:28:53.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
144052025-03-01T01:28:53.609ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
144062025-03-01T01:28:53.610ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
144072025-03-01T01:28:53.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
144082025-03-01T01:28:53.613ZINFOnexus (BackgroundTasks): VPC route manager sled 3471264f-127e-4a25-bc10-2e8249e8d70a push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
144092025-03-01T01:28:53.613ZDEBGnexus (BackgroundTasks): client request SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
144102025-03-01T01:28:53.614ZDEBGnexus (BackgroundTasks): client response SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "7ce54642-1901-49b7-8b94-765fce978c95", "date": "Sat, 01 Mar 2025 01:28:53 GMT"} })
144112025-03-01T01:28:53.615ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 401.928207ms iteration = 30 status = {}
144122025-03-01T01:28:53.650ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1162 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 zone_address = fd00:1122:3344:101::2
144132025-03-01T01:28:53.650ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
144142025-03-01T01:28:53.651ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "488fbc00-f044-4218-ae4c-c2dca61fbbe6", "content-length": "26", "date": "Sat, 01 Mar 2025 01:28:53 GMT"} })
144152025-03-01T01:28:53.651ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1167 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
144162025-03-01T01:28:53.653ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66
144172025-03-01T01:28:53.744ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 531.284732ms iteration = 29 status = {}
144182025-03-01T01:28:53.747ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
144192025-03-01T01:28:53.747ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "8dbc9656-5b84-4500-93f5-cc153e743bbf", "date": "Sat, 01 Mar 2025 01:28:53 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
144202025-03-01T01:28:53.747ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
144212025-03-01T01:28:53.750ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "2bd355e0-5a0c-4810-abe5-c916c2da13fe", "date": "Sat, 01 Mar 2025 01:28:53 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
144222025-03-01T01:28:53.750ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
144232025-03-01T01:28:53.751ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
144242025-03-01T01:28:53.751ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "4dd067c8-264c-4f80-8b93-c0aaf5fd3ca2", "date": "Sat, 01 Mar 2025 01:28:53 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
144252025-03-01T01:28:53.751ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
144262025-03-01T01:28:53.751ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "060b6463-35e6-40c4-a7fe-2c29fb93c4f4", "content-length": "2", "date": "Sat, 01 Mar 2025 01:28:53 GMT"} })
144272025-03-01T01:28:53.753ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
144282025-03-01T01:28:53.753ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 539.840967ms iteration = 17 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
144292025-03-01T01:28:53.753ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
144302025-03-01T01:28:53.753ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
144312025-03-01T01:28:53.755ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 542.127043ms iteration = 29 status = null
144322025-03-01T01:28:53.819ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
144332025-03-01T01:28:53.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
144342025-03-01T01:28:53.821ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 7f9c3c14-58c5-473f-8692-6376be44401e, rack_id: 4854cb88-dfba-4609-8f9d-72aac08cef66, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(cb10d0c6-a704-4231-b148-4f9ae21a03f8) } rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 switch_location = Switch0
144352025-03-01T01:28:53.821ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
144362025-03-01T01:28:53.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
144372025-03-01T01:28:53.830ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
144382025-03-01T01:28:53.831ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "e14f8dd3-07bf-49be-b1e4-48a77433fbc8", "content-length": "134", "date": "Sat, 01 Mar 2025 01:28:53 GMT"} })
144392025-03-01T01:28:53.831ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
144402025-03-01T01:28:53.831ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = cb10d0c6-a704-4231-b148-4f9ae21a03f8
144412025-03-01T01:28:53.831ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
144422025-03-01T01:28:53.831ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
144432025-03-01T01:28:53.831ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
144442025-03-01T01:28:53.831ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
144452025-03-01T01:28:53.831ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
144462025-03-01T01:28:53.831ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
144472025-03-01T01:28:53.831ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
144482025-03-01T01:28:53.831ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
144492025-03-01T01:28:53.831ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66
144502025-03-01T01:28:53.831ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
144512025-03-01T01:28:53.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
144522025-03-01T01:28:53.834ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
144532025-03-01T01:28:53.834ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "33879c78-8a36-44f0-aa9c-c4d5d81a7999", "content-length": "2", "date": "Sat, 01 Mar 2025 01:28:53 GMT"} })
144542025-03-01T01:28:53.834ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
144552025-03-01T01:28:53.834ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "80dc2ffa-9901-4025-976b-3031ba55a114", "content-length": "52", "date": "Sat, 01 Mar 2025 01:28:53 GMT"} })
144562025-03-01T01:28:53.834ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 switch_location = Switch0
144572025-03-01T01:28:53.834ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
144582025-03-01T01:28:53.930ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "3f5daa25-94c1-4a47-909e-4e2430d8eb56", "date": "Sat, 01 Mar 2025 01:28:53 GMT"} })
144592025-03-01T01:28:53.930ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 switch = Switch0
144602025-03-01T01:28:53.930ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
144612025-03-01T01:28:53.934ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "e9557622-9e42-4102-849f-b7b697a46ad1", "content-length": "682", "date": "Sat, 01 Mar 2025 01:28:53 GMT"} })
144622025-03-01T01:28:53.934ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
144632025-03-01T01:28:53.935ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
144642025-03-01T01:28:53.939ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
144652025-03-01T01:28:53.939ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
144662025-03-01T01:28:53.942ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
144672025-03-01T01:28:53.942ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
144682025-03-01T01:28:53.944ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
144692025-03-01T01:28:53.945ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
144702025-03-01T01:28:53.952ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 739.161707ms iteration = 29 status = {}
144712025-03-01T01:28:54.601ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = e2fcc83d-ebf9-4471-ba0a-c14894c12a1e roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
144722025-03-01T01:28:54.601ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = e2fcc83d-ebf9-4471-ba0a-c14894c12a1e resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
144732025-03-01T01:28:54.603ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2136 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = e2fcc83d-ebf9-4471-ba0a-c14894c12a1e response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
144742025-03-01T01:28:55.621ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = e09b76fd-b165-46f4-950c-5a8aa4363c3a roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
144752025-03-01T01:28:55.622ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = e09b76fd-b165-46f4-950c-5a8aa4363c3a resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
144762025-03-01T01:28:55.624ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2663 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = e09b76fd-b165-46f4-950c-5a8aa4363c3a response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
144772025-03-01T01:28:56.644ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 6002add9-603d-4dbb-b97e-811a68642702 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
144782025-03-01T01:28:56.644ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 6002add9-603d-4dbb-b97e-811a68642702 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
144792025-03-01T01:28:56.646ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2298 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 6002add9-603d-4dbb-b97e-811a68642702 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
144802025-03-01T01:28:57.414ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 433 local_addr = [fd00:1122:3344:101::c]:34357 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = c0eba51d-562a-4bc6-bcca-ba3cc2986a83 response_code = 200 uri = /67b03f4e-4cbd-4843-9cd9-647f610abcfc
144812025-03-01T01:28:57.667ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = d33ebad3-86b2-4e12-84e2-1bb6a4438853 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
144822025-03-01T01:28:57.668ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = d33ebad3-86b2-4e12-84e2-1bb6a4438853 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
144832025-03-01T01:28:57.670ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2750 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = d33ebad3-86b2-4e12-84e2-1bb6a4438853 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
144842025-03-01T01:28:58.688ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 3b227b16-ff3e-40bc-838b-8d2ce329945c roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
144852025-03-01T01:28:58.689ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 3b227b16-ff3e-40bc-838b-8d2ce329945c resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
144862025-03-01T01:28:58.692ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3200 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 3b227b16-ff3e-40bc-838b-8d2ce329945c response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
144872025-03-01T01:28:59.712ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 3863610e-89c8-4eb4-b4e7-f76000ffe189 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
144882025-03-01T01:28:59.713ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 3863610e-89c8-4eb4-b4e7-f76000ffe189 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
144892025-03-01T01:28:59.714ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2423 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 3863610e-89c8-4eb4-b4e7-f76000ffe189 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
144902025-03-01T01:29:00.734ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 33cdf7aa-4fdd-472a-906d-4c5df274376e roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
144912025-03-01T01:29:00.734ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 33cdf7aa-4fdd-472a-906d-4c5df274376e resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
144922025-03-01T01:29:00.736ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2828 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 33cdf7aa-4fdd-472a-906d-4c5df274376e response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
144932025-03-01T01:29:01.756ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 4ecab17a-52ae-4103-9f16-ebfa72477da3 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
144942025-03-01T01:29:01.757ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 4ecab17a-52ae-4103-9f16-ebfa72477da3 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
144952025-03-01T01:29:01.758ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1713 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 4ecab17a-52ae-4103-9f16-ebfa72477da3 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
144962025-03-01T01:29:02.777ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 8864dc8c-d2a6-47f7-8839-9b7b20c0dd3c roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
144972025-03-01T01:29:02.778ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 8864dc8c-d2a6-47f7-8839-9b7b20c0dd3c resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
144982025-03-01T01:29:02.780ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2389 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 8864dc8c-d2a6-47f7-8839-9b7b20c0dd3c response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
144992025-03-01T01:29:03.214ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 86 reason = Timeout
145002025-03-01T01:29:03.214ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
145012025-03-01T01:29:03.214ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 86 reason = Timeout
145022025-03-01T01:29:03.214ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
145032025-03-01T01:29:03.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
145042025-03-01T01:29:03.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
145052025-03-01T01:29:03.216ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
145062025-03-01T01:29:03.219ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
145072025-03-01T01:29:03.219ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
145082025-03-01T01:29:03.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
145092025-03-01T01:29:03.220ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
145102025-03-01T01:29:03.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
145112025-03-01T01:29:03.222ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
145122025-03-01T01:29:03.225ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7, lookup_type: ById(8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7) } result = Ok(())
145132025-03-01T01:29:03.225ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
145142025-03-01T01:29:03.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
145152025-03-01T01:29:03.238ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 original_time_created = 2025-03-01 01:14:50.436545 UTC target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 time_created = 2025-03-01 01:14:50.436545 UTC
145162025-03-01T01:29:03.238ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.300225ms iteration = 86 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7","time_created":"2025-03-01T01:14:50.436545Z"}
145172025-03-01T01:29:03.244ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
145182025-03-01T01:29:03.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
145192025-03-01T01:29:03.273ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 58.92864ms iteration = 86 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
145202025-03-01T01:29:03.800ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = d240867c-76f1-464f-a4c4-ef59c2bc35f0 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
145212025-03-01T01:29:03.801ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = d240867c-76f1-464f-a4c4-ef59c2bc35f0 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
145222025-03-01T01:29:03.803ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2572 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = d240867c-76f1-464f-a4c4-ef59c2bc35f0 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
145232025-03-01T01:29:04.821ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 990ab403-4a48-460e-91f3-3cb9b4a7d72f roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
145242025-03-01T01:29:04.822ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 990ab403-4a48-460e-91f3-3cb9b4a7d72f resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
145252025-03-01T01:29:04.824ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2248 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 990ab403-4a48-460e-91f3-3cb9b4a7d72f response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
145262025-03-01T01:29:05.841ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = e66ab13f-40a6-424a-ae6f-d223ce8b4087 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
145272025-03-01T01:29:05.842ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = e66ab13f-40a6-424a-ae6f-d223ce8b4087 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
145282025-03-01T01:29:05.844ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2304 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = e66ab13f-40a6-424a-ae6f-d223ce8b4087 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
145292025-03-01T01:29:06.864ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = fb666dac-59f7-4232-94d4-3b786d7c7bfb roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
145302025-03-01T01:29:06.865ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = fb666dac-59f7-4232-94d4-3b786d7c7bfb resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
145312025-03-01T01:29:06.867ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2617 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = fb666dac-59f7-4232-94d4-3b786d7c7bfb response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
145322025-03-01T01:29:07.414ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 380 local_addr = [fd00:1122:3344:101::c]:34357 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = 0962d230-1f95-430d-a1e7-66ccd2c85371 response_code = 200 uri = /67b03f4e-4cbd-4843-9cd9-647f610abcfc
145332025-03-01T01:29:07.886ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 32c6471c-0ff0-4cec-8e99-2b13b54c41d3 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
145342025-03-01T01:29:07.886ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 32c6471c-0ff0-4cec-8e99-2b13b54c41d3 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
145352025-03-01T01:29:07.888ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2695 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 32c6471c-0ff0-4cec-8e99-2b13b54c41d3 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
145362025-03-01T01:29:08.909ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 89300bf4-345b-4e34-acb4-963028485875 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
145372025-03-01T01:29:08.909ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 89300bf4-345b-4e34-acb4-963028485875 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
145382025-03-01T01:29:08.912ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2981 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 89300bf4-345b-4e34-acb4-963028485875 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
145392025-03-01T01:29:09.932ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 295422d6-149c-481c-aa1b-9a6e093cbe9d roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
145402025-03-01T01:29:09.932ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 295422d6-149c-481c-aa1b-9a6e093cbe9d resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
145412025-03-01T01:29:09.934ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2358 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 295422d6-149c-481c-aa1b-9a6e093cbe9d response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
145422025-03-01T01:29:10.953ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 5229ab0e-e0fa-41fc-aafa-576882a9775d roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
145432025-03-01T01:29:10.953ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 5229ab0e-e0fa-41fc-aafa-576882a9775d resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
145442025-03-01T01:29:10.955ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1910 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 5229ab0e-e0fa-41fc-aafa-576882a9775d response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
145452025-03-01T01:29:11.973ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 022ee5c2-28eb-4313-b60f-8d41d51a9166 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
145462025-03-01T01:29:11.974ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 022ee5c2-28eb-4313-b60f-8d41d51a9166 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
145472025-03-01T01:29:11.976ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2389 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 022ee5c2-28eb-4313-b60f-8d41d51a9166 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
145482025-03-01T01:29:12.995ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 3c279a0f-3b25-4c7e-8dfd-8dda5945f34d roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
145492025-03-01T01:29:12.995ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 3c279a0f-3b25-4c7e-8dfd-8dda5945f34d resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
145502025-03-01T01:29:12.997ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2279 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 3c279a0f-3b25-4c7e-8dfd-8dda5945f34d response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
145512025-03-01T01:29:13.213ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 87 reason = Timeout
145522025-03-01T01:29:13.213ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 87 reason = Timeout
145532025-03-01T01:29:13.213ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
145542025-03-01T01:29:13.213ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
145552025-03-01T01:29:13.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
145562025-03-01T01:29:13.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
145572025-03-01T01:29:13.216ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
145582025-03-01T01:29:13.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
145592025-03-01T01:29:13.216ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
145602025-03-01T01:29:13.218ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
145612025-03-01T01:29:13.218ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
145622025-03-01T01:29:13.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
145632025-03-01T01:29:13.221ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
145642025-03-01T01:29:13.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
145652025-03-01T01:29:13.222ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
145662025-03-01T01:29:13.225ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7, lookup_type: ById(8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7) } result = Ok(())
145672025-03-01T01:29:13.225ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
145682025-03-01T01:29:13.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
145692025-03-01T01:29:13.237ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 original_time_created = 2025-03-01 01:14:50.436545 UTC target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 time_created = 2025-03-01 01:14:50.436545 UTC
145702025-03-01T01:29:13.237ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.392187ms iteration = 87 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7","time_created":"2025-03-01T01:14:50.436545Z"}
145712025-03-01T01:29:13.243ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 29.227725ms iteration = 87 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
145722025-03-01T01:29:14.017ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 1a109b10-cae0-4bec-ac71-b44ffa57aeab roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
145732025-03-01T01:29:14.018ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 1a109b10-cae0-4bec-ac71-b44ffa57aeab resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
145742025-03-01T01:29:14.020ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2358 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 1a109b10-cae0-4bec-ac71-b44ffa57aeab response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
145752025-03-01T01:29:15.041ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 46dd334f-3c9c-4db2-a426-786ca04c263e roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
145762025-03-01T01:29:15.041ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 46dd334f-3c9c-4db2-a426-786ca04c263e resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
145772025-03-01T01:29:15.042ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1816 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 46dd334f-3c9c-4db2-a426-786ca04c263e response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
145782025-03-01T01:29:16.062ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = fbb70476-c67c-4c1b-addf-fca18e077f00 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
145792025-03-01T01:29:16.062ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = fbb70476-c67c-4c1b-addf-fca18e077f00 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
145802025-03-01T01:29:16.064ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2503 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = fbb70476-c67c-4c1b-addf-fca18e077f00 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
145812025-03-01T01:29:17.084ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = f6c62532-5e6d-4627-b5d8-8aadf29dd01c roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
145822025-03-01T01:29:17.085ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = f6c62532-5e6d-4627-b5d8-8aadf29dd01c resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
145832025-03-01T01:29:17.087ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2612 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = f6c62532-5e6d-4627-b5d8-8aadf29dd01c response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
145842025-03-01T01:29:17.414ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 449 local_addr = [fd00:1122:3344:101::c]:34357 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = aaa8848a-9c29-4635-8278-c2c32dd6df68 response_code = 200 uri = /67b03f4e-4cbd-4843-9cd9-647f610abcfc
145852025-03-01T01:29:18.107ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 11340e87-ee99-4c44-835a-64ae9e16e290 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
145862025-03-01T01:29:18.107ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 11340e87-ee99-4c44-835a-64ae9e16e290 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
145872025-03-01T01:29:18.109ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2477 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 11340e87-ee99-4c44-835a-64ae9e16e290 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
145882025-03-01T01:29:19.131ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 500c6d7c-1e4f-49e3-857d-777039c1b4cc roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
145892025-03-01T01:29:19.131ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 500c6d7c-1e4f-49e3-857d-777039c1b4cc resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
145902025-03-01T01:29:19.133ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2750 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 500c6d7c-1e4f-49e3-857d-777039c1b4cc response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
145912025-03-01T01:29:20.154ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 057140a1-be6d-4496-ad51-94c60265f956 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
145922025-03-01T01:29:20.154ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 057140a1-be6d-4496-ad51-94c60265f956 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
145932025-03-01T01:29:20.156ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1993 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 057140a1-be6d-4496-ad51-94c60265f956 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
145942025-03-01T01:29:21.176ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 3c44d2c2-b4a4-49a0-ac12-0ac0e1d67925 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
145952025-03-01T01:29:21.177ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 3c44d2c2-b4a4-49a0-ac12-0ac0e1d67925 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
145962025-03-01T01:29:21.179ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2445 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 3c44d2c2-b4a4-49a0-ac12-0ac0e1d67925 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
145972025-03-01T01:29:22.198ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 55f9321e-9d71-4587-9477-5bf860052bab roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
145982025-03-01T01:29:22.199ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 55f9321e-9d71-4587-9477-5bf860052bab resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
145992025-03-01T01:29:22.201ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2308 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 55f9321e-9d71-4587-9477-5bf860052bab response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
146002025-03-01T01:29:22.406ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38629 req_id = 19779425-1f4e-4cd1-a0b5-a12b6606ee71 roles = RoleSet { roles: {} } uri = /metrics/collectors/d77aa5d6-e6f9-4845-b1d4-57f91a3621e6/producers?sort_by=id_ascending
146012025-03-01T01:29:22.407ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38629 req_id = 19779425-1f4e-4cd1-a0b5-a12b6606ee71 resource = Database result = Ok(()) uri = /metrics/collectors/d77aa5d6-e6f9-4845-b1d4-57f91a3621e6/producers?sort_by=id_ascending
146022025-03-01T01:29:22.410ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3340 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38629 req_id = 19779425-1f4e-4cd1-a0b5-a12b6606ee71 response_code = 200 uri = /metrics/collectors/d77aa5d6-e6f9-4845-b1d4-57f91a3621e6/producers?sort_by=id_ascending
146032025-03-01T01:29:22.410ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38629 req_id = 463e9fa1-6104-4318-8063-2ebc0523dad7 roles = RoleSet { roles: {} } uri = /metrics/collectors/d77aa5d6-e6f9-4845-b1d4-57f91a3621e6/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYmI0ODUwMS0zYzRlLTRkNDQtODgyMy1mOTc1ZTg2OTFmZmYifX0%3D
146042025-03-01T01:29:22.410ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38629 req_id = 463e9fa1-6104-4318-8063-2ebc0523dad7 resource = Database result = Ok(()) uri = /metrics/collectors/d77aa5d6-e6f9-4845-b1d4-57f91a3621e6/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYmI0ODUwMS0zYzRlLTRkNDQtODgyMy1mOTc1ZTg2OTFmZmYifX0%3D
146052025-03-01T01:29:22.412ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2525 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38629 req_id = 463e9fa1-6104-4318-8063-2ebc0523dad7 response_code = 200 uri = /metrics/collectors/d77aa5d6-e6f9-4845-b1d4-57f91a3621e6/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYmI0ODUwMS0zYzRlLTRkNDQtODgyMy1mOTc1ZTg2OTFmZmYifX0%3D
146062025-03-01T01:29:23.213ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 30 reason = Timeout
146072025-03-01T01:29:23.213ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 30 reason = Timeout
146082025-03-01T01:29:23.213ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
146092025-03-01T01:29:23.213ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
146102025-03-01T01:29:23.213ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 88 reason = Timeout
146112025-03-01T01:29:23.213ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
146122025-03-01T01:29:23.213ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 30 reason = Timeout
146132025-03-01T01:29:23.213ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
146142025-03-01T01:29:23.213ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 32 reason = Timeout
146152025-03-01T01:29:23.213ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
146162025-03-01T01:29:23.213ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 30 reason = Timeout
146172025-03-01T01:29:23.213ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 30 reason = Timeout
146182025-03-01T01:29:23.214ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
146192025-03-01T01:29:23.214ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 30 reason = Timeout
146202025-03-01T01:29:23.214ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
146212025-03-01T01:29:23.214ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 30 reason = Timeout
146222025-03-01T01:29:23.214ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
146232025-03-01T01:29:23.214ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
146242025-03-01T01:29:23.214ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 31 reason = Timeout
146252025-03-01T01:29:23.214ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 31 reason = Timeout
146262025-03-01T01:29:23.214ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
146272025-03-01T01:29:23.214ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
146282025-03-01T01:29:23.214ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 30 reason = Timeout
146292025-03-01T01:29:23.214ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
146302025-03-01T01:29:23.214ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
146312025-03-01T01:29:23.214ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 88 reason = Timeout
146322025-03-01T01:29:23.214ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 30 reason = Timeout
146332025-03-01T01:29:23.214ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
146342025-03-01T01:29:23.214ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
146352025-03-01T01:29:23.214ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 30 reason = Timeout
146362025-03-01T01:29:23.214ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
146372025-03-01T01:29:23.214ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 30 reason = Timeout
146382025-03-01T01:29:23.214ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
146392025-03-01T01:29:23.214ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 30 reason = Timeout
146402025-03-01T01:29:23.214ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
146412025-03-01T01:29:23.214ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 30 reason = Timeout
146422025-03-01T01:29:23.214ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
146432025-03-01T01:29:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
146442025-03-01T01:29:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
146452025-03-01T01:29:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
146462025-03-01T01:29:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
146472025-03-01T01:29:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
146482025-03-01T01:29:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
146492025-03-01T01:29:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
146502025-03-01T01:29:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
146512025-03-01T01:29:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
146522025-03-01T01:29:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
146532025-03-01T01:29:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
146542025-03-01T01:29:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
146552025-03-01T01:29:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
146562025-03-01T01:29:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
146572025-03-01T01:29:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
146582025-03-01T01:29:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
146592025-03-01T01:29:23.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
146602025-03-01T01:29:23.216ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
146612025-03-01T01:29:23.217ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1773, tv_nsec: 905353766 } })
146622025-03-01T01:29:23.217ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
146632025-03-01T01:29:23.217ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1154
146642025-03-01T01:29:23.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
146652025-03-01T01:29:23.217ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
146662025-03-01T01:29:23.217ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
146672025-03-01T01:29:23.218ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.064683ms iteration = 30 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
146682025-03-01T01:29:23.218ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
146692025-03-01T01:29:23.219ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
146702025-03-01T01:29:23.219ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
146712025-03-01T01:29:23.220ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 0becab1b-8c44-46ba-870b-8132185b9169 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
146722025-03-01T01:29:23.220ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
146732025-03-01T01:29:23.220ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
146742025-03-01T01:29:23.220ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 0becab1b-8c44-46ba-870b-8132185b9169 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
146752025-03-01T01:29:23.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
146762025-03-01T01:29:23.221ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 7.142166ms iteration = 30 status = {"errors":[],"finish_invoked_ok":[]}
146772025-03-01T01:29:23.222ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
146782025-03-01T01:29:23.222ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
146792025-03-01T01:29:23.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
146802025-03-01T01:29:23.222ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
146812025-03-01T01:29:23.222ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
146822025-03-01T01:29:23.223ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
146832025-03-01T01:29:23.223ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
146842025-03-01T01:29:23.223ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
146852025-03-01T01:29:23.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
146862025-03-01T01:29:23.228ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
146872025-03-01T01:29:23.228ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
146882025-03-01T01:29:23.228ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
146892025-03-01T01:29:23.228ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
146902025-03-01T01:29:23.229ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 15.925234ms iteration = 88 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
146912025-03-01T01:29:23.230ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1773, tv_nsec: 918701278 } })
146922025-03-01T01:29:23.230ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1154
146932025-03-01T01:29:23.231ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 10861 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 0becab1b-8c44-46ba-870b-8132185b9169 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
146942025-03-01T01:29:23.232ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
146952025-03-01T01:29:23.233ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
146962025-03-01T01:29:23.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
146972025-03-01T01:29:23.233ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
146982025-03-01T01:29:23.233ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-3471264f-127e-4a25-bc10-2e8249e8d70a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1773, tv_nsec: 921904914 } })
146992025-03-01T01:29:23.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
147002025-03-01T01:29:23.233ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1154 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66
147012025-03-01T01:29:23.234ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
147022025-03-01T01:29:23.234ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
147032025-03-01T01:29:23.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
147042025-03-01T01:29:23.235ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 21.744734ms iteration = 30 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
147052025-03-01T01:29:23.249ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
147062025-03-01T01:29:23.251ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
147072025-03-01T01:29:23.251ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
147082025-03-01T01:29:23.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
147092025-03-01T01:29:23.254ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
147102025-03-01T01:29:23.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
147112025-03-01T01:29:23.257ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
147122025-03-01T01:29:23.258ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
147132025-03-01T01:29:23.258ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
147142025-03-01T01:29:23.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
147152025-03-01T01:29:23.259ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
147162025-03-01T01:29:23.260ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
147172025-03-01T01:29:23.262ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
147182025-03-01T01:29:23.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
147192025-03-01T01:29:23.264ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
147202025-03-01T01:29:23.264ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
147212025-03-01T01:29:23.264ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
147222025-03-01T01:29:23.265ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
147232025-03-01T01:29:23.265ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
147242025-03-01T01:29:23.266ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
147252025-03-01T01:29:23.267ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
147262025-03-01T01:29:23.267ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
147272025-03-01T01:29:23.267ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
147282025-03-01T01:29:23.267ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
147292025-03-01T01:29:23.267ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
147302025-03-01T01:29:23.267ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 53.745725ms iteration = 30 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
147312025-03-01T01:29:23.267ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 3471264f-127e-4a25-bc10-2e8249e8d70a, lookup_type: ById(3471264f-127e-4a25-bc10-2e8249e8d70a) } result = Ok(())
147322025-03-01T01:29:23.267ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
147332025-03-01T01:29:23.267ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 53.877597ms iteration = 30 status = {"errors":[],"garbage_collect_requested":[]}
147342025-03-01T01:29:23.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
147352025-03-01T01:29:23.270ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
147362025-03-01T01:29:23.270ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
147372025-03-01T01:29:23.270ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
147382025-03-01T01:29:23.273ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
147392025-03-01T01:29:23.273ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
147402025-03-01T01:29:23.273ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 59.831329ms iteration = 30 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
147412025-03-01T01:29:23.274ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 60.417871ms iteration = 30 status = 0
147422025-03-01T01:29:23.275ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
147432025-03-01T01:29:23.278ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7, lookup_type: ById(8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7) } result = Ok(())
147442025-03-01T01:29:23.278ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
147452025-03-01T01:29:23.278ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
147462025-03-01T01:29:23.282ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
147472025-03-01T01:29:23.282ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
147482025-03-01T01:29:23.282ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d1db61bd-e1bd-47d5-8456-3c8bf97f0624", "content-length": "26", "date": "Sat, 01 Mar 2025 01:29:23 GMT"} })
147492025-03-01T01:29:23.282ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
147502025-03-01T01:29:23.284ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
147512025-03-01T01:29:23.295ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
147522025-03-01T01:29:23.295ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
147532025-03-01T01:29:23.297ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 original_time_created = 2025-03-01 01:14:50.436545 UTC target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 time_created = 2025-03-01 01:14:50.436545 UTC
147542025-03-01T01:29:23.297ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 83.615663ms iteration = 88 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7","time_created":"2025-03-01T01:14:50.436545Z"}
147552025-03-01T01:29:23.297ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
147562025-03-01T01:29:23.299ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
147572025-03-01T01:29:23.299ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
147582025-03-01T01:29:23.300ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
147592025-03-01T01:29:23.302ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
147602025-03-01T01:29:23.302ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
147612025-03-01T01:29:23.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
147622025-03-01T01:29:23.304ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
147632025-03-01T01:29:23.304ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
147642025-03-01T01:29:23.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
147652025-03-01T01:29:23.308ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
147662025-03-01T01:29:23.308ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
147672025-03-01T01:29:23.308ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 94.540656ms iteration = 30 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
147682025-03-01T01:29:23.319ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1162 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 zone_address = fd00:1122:3344:101::2
147692025-03-01T01:29:23.319ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
147702025-03-01T01:29:23.320ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "89897bf6-d607-4732-a794-6de6f21449fd", "content-length": "26", "date": "Sat, 01 Mar 2025 01:29:23 GMT"} })
147712025-03-01T01:29:23.320ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1167 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
147722025-03-01T01:29:23.322ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66
147732025-03-01T01:29:23.332ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 118.489354ms iteration = 30 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
147742025-03-01T01:29:23.338ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
147752025-03-01T01:29:23.338ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 124.351023ms iteration = 30 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
147762025-03-01T01:29:23.378ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1162 zone_address = fd00:1122:3344:101::2
147772025-03-01T01:29:23.378ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
147782025-03-01T01:29:23.378ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "67afd072-d573-4035-b696-3b58f071e0cc", "content-length": "26", "date": "Sat, 01 Mar 2025 01:29:23 GMT"} })
147792025-03-01T01:29:23.378ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1167 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
147802025-03-01T01:29:23.380ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1199 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
147812025-03-01T01:29:23.386ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
147822025-03-01T01:29:23.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
147832025-03-01T01:29:23.409ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 195.87274ms iteration = 32 status = {"physical_disks_added":0}
147842025-03-01T01:29:23.444ZINFOnexus (BackgroundTasks): VPC route manager sled 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
147852025-03-01T01:29:23.444ZDEBGnexus (BackgroundTasks): client request SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
147862025-03-01T01:29:23.445ZDEBGnexus (BackgroundTasks): client response SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "6f75cfae-034d-4194-96bb-f3c425b34d65", "content-length": "372", "date": "Sat, 01 Mar 2025 01:29:23 GMT"} })
147872025-03-01T01:29:23.445ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
147882025-03-01T01:29:23.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
147892025-03-01T01:29:23.446ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
147902025-03-01T01:29:23.448ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
147912025-03-01T01:29:23.448ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
147922025-03-01T01:29:23.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
147932025-03-01T01:29:23.449ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
147942025-03-01T01:29:23.449ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 235.969126ms iteration = 30 status = {}
147952025-03-01T01:29:23.451ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
147962025-03-01T01:29:23.451ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
147972025-03-01T01:29:23.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
147982025-03-01T01:29:23.476ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
147992025-03-01T01:29:23.476ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "c63e1f7e-8c95-4bfd-be60-65eb431eef5b", "content-length": "2", "date": "Sat, 01 Mar 2025 01:29:22 GMT"} })
148002025-03-01T01:29:23.478ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
148012025-03-01T01:29:23.478ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
148022025-03-01T01:29:23.482ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 268.877287ms iteration = 30 status = null
148032025-03-01T01:29:23.497ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
148042025-03-01T01:29:23.497ZDEBGnexus (BackgroundTasks): client request SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
148052025-03-01T01:29:23.498ZDEBGnexus (BackgroundTasks): client response SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "423f6a2f-7b6c-4722-91d1-a389958c4a38", "date": "Sat, 01 Mar 2025 01:29:23 GMT"} })
148062025-03-01T01:29:23.498ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
148072025-03-01T01:29:23.498ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
148082025-03-01T01:29:23.501ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
148092025-03-01T01:29:23.501ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
148102025-03-01T01:29:23.504ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
148112025-03-01T01:29:23.504ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
148122025-03-01T01:29:23.508ZINFOnexus (BackgroundTasks): VPC route manager sled 3471264f-127e-4a25-bc10-2e8249e8d70a push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
148132025-03-01T01:29:23.508ZDEBGnexus (BackgroundTasks): client request SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
148142025-03-01T01:29:23.508ZDEBGnexus (BackgroundTasks): client response SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "ac96b985-1f03-41ce-a0c9-c5f0e2fc7d74", "date": "Sat, 01 Mar 2025 01:29:23 GMT"} })
148152025-03-01T01:29:23.510ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 296.125433ms iteration = 31 status = {}
148162025-03-01T01:29:23.549ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
148172025-03-01T01:29:23.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
148182025-03-01T01:29:23.565ZDEBGnexus (BackgroundTasks): client request SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
148192025-03-01T01:29:23.565ZDEBGnexus (BackgroundTasks): client response SledAgent = 3471264f-127e-4a25-bc10-2e8249e8d70a background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "ef87c60a-cb16-40dd-a85a-5dc8414e1c73", "content-length": "691", "date": "Sat, 01 Mar 2025 01:29:23 GMT"} })
148202025-03-01T01:29:23.565ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
148212025-03-01T01:29:23.565ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
148222025-03-01T01:29:23.565ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
148232025-03-01T01:29:23.567ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 353.385099ms iteration = 31 status = {}
148242025-03-01T01:29:23.567ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 7f9c3c14-58c5-473f-8692-6376be44401e, rack_id: 4854cb88-dfba-4609-8f9d-72aac08cef66, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(cb10d0c6-a704-4231-b148-4f9ae21a03f8) } rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 switch_location = Switch0
148252025-03-01T01:29:23.567ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
148262025-03-01T01:29:23.567ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
148272025-03-01T01:29:23.576ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
148282025-03-01T01:29:23.576ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "5d9e0398-35e9-4e0e-8148-4db7bd5c12c0", "content-length": "134", "date": "Sat, 01 Mar 2025 01:29:22 GMT"} })
148292025-03-01T01:29:23.576ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
148302025-03-01T01:29:23.576ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = cb10d0c6-a704-4231-b148-4f9ae21a03f8
148312025-03-01T01:29:23.576ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
148322025-03-01T01:29:23.576ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
148332025-03-01T01:29:23.576ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
148342025-03-01T01:29:23.576ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
148352025-03-01T01:29:23.576ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
148362025-03-01T01:29:23.576ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
148372025-03-01T01:29:23.576ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
148382025-03-01T01:29:23.576ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
148392025-03-01T01:29:23.577ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66
148402025-03-01T01:29:23.577ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
148412025-03-01T01:29:23.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
148422025-03-01T01:29:23.579ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
148432025-03-01T01:29:23.579ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "a2a4dc61-3d18-4cdb-9324-2f7493aed221", "content-length": "2", "date": "Sat, 01 Mar 2025 01:29:22 GMT"} })
148442025-03-01T01:29:23.579ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
148452025-03-01T01:29:23.579ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "cc55109f-444a-4c28-9174-6680a72b10fb", "content-length": "52", "date": "Sat, 01 Mar 2025 01:29:22 GMT"} })
148462025-03-01T01:29:23.579ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 switch_location = Switch0
148472025-03-01T01:29:23.579ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
148482025-03-01T01:29:23.681ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "0ad766f9-2aa4-43e6-bbf1-2084b65b67a4", "date": "Sat, 01 Mar 2025 01:29:23 GMT"} })
148492025-03-01T01:29:23.681ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 switch = Switch0
148502025-03-01T01:29:23.681ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
148512025-03-01T01:29:23.681ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 4854cb88-dfba-4609-8f9d-72aac08cef66 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "19c92c2f-95a0-4439-8712-f721b45990bc", "content-length": "682", "date": "Sat, 01 Mar 2025 01:29:23 GMT"} })
148522025-03-01T01:29:23.681ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
148532025-03-01T01:29:23.681ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
148542025-03-01T01:29:23.685ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
148552025-03-01T01:29:23.685ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
148562025-03-01T01:29:23.689ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
148572025-03-01T01:29:23.689ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
148582025-03-01T01:29:23.691ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
148592025-03-01T01:29:23.691ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
148602025-03-01T01:29:23.700ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 485.967929ms iteration = 30 status = {}
148612025-03-01T01:29:24.261ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 1efe7f76-53f7-43f4-8eec-1fa99564b58a roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
148622025-03-01T01:29:24.261ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 1efe7f76-53f7-43f4-8eec-1fa99564b58a resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
148632025-03-01T01:29:24.263ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2167 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 1efe7f76-53f7-43f4-8eec-1fa99564b58a response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
148642025-03-01T01:29:25.283ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 4975edbe-cd35-49cc-a65b-e23b938efaef roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
148652025-03-01T01:29:25.283ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 4975edbe-cd35-49cc-a65b-e23b938efaef resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
148662025-03-01T01:29:25.285ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2520 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 4975edbe-cd35-49cc-a65b-e23b938efaef response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
148672025-03-01T01:29:26.306ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 4664e544-fb9b-464e-8548-aa1ecc273ab9 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
148682025-03-01T01:29:26.306ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 4664e544-fb9b-464e-8548-aa1ecc273ab9 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
148692025-03-01T01:29:26.308ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2209 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 4664e544-fb9b-464e-8548-aa1ecc273ab9 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
148702025-03-01T01:29:27.329ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = cf2a7a5e-7317-4025-9c17-7596b8f44950 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
148712025-03-01T01:29:27.330ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = cf2a7a5e-7317-4025-9c17-7596b8f44950 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
148722025-03-01T01:29:27.332ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2498 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = cf2a7a5e-7317-4025-9c17-7596b8f44950 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
148732025-03-01T01:29:27.414ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 427 local_addr = [fd00:1122:3344:101::c]:34357 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = f1cf2362-a1f2-4c03-886c-b7f7d657cec9 response_code = 200 uri = /67b03f4e-4cbd-4843-9cd9-647f610abcfc
148742025-03-01T01:29:28.350ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 117e9c20-aac3-4b97-bb57-d8bb33a10ed8 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
148752025-03-01T01:29:28.350ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 117e9c20-aac3-4b97-bb57-d8bb33a10ed8 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
148762025-03-01T01:29:28.353ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2828 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 117e9c20-aac3-4b97-bb57-d8bb33a10ed8 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
148772025-03-01T01:29:29.371ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 006f1853-3353-4236-8d76-02bdbab7f949 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
148782025-03-01T01:29:29.372ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 006f1853-3353-4236-8d76-02bdbab7f949 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
148792025-03-01T01:29:29.374ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2358 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 006f1853-3353-4236-8d76-02bdbab7f949 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
148802025-03-01T01:29:30.393ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = da245e95-7ef3-459f-bb8f-52e27bafeb67 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
148812025-03-01T01:29:30.393ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = da245e95-7ef3-459f-bb8f-52e27bafeb67 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
148822025-03-01T01:29:30.395ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2219 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = da245e95-7ef3-459f-bb8f-52e27bafeb67 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
148832025-03-01T01:29:31.413ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = f5f4bad4-20fc-4e31-afea-5e6e38be8c17 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
148842025-03-01T01:29:31.414ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = f5f4bad4-20fc-4e31-afea-5e6e38be8c17 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
148852025-03-01T01:29:31.416ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2361 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = f5f4bad4-20fc-4e31-afea-5e6e38be8c17 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
148862025-03-01T01:29:32.435ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 2ecc952e-0edd-4ceb-beee-452dd82b63a8 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
148872025-03-01T01:29:32.436ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 2ecc952e-0edd-4ceb-beee-452dd82b63a8 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
148882025-03-01T01:29:32.437ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1892 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 2ecc952e-0edd-4ceb-beee-452dd82b63a8 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
148892025-03-01T01:29:33.213ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 89 reason = Timeout
148902025-03-01T01:29:33.213ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 89 reason = Timeout
148912025-03-01T01:29:33.213ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
148922025-03-01T01:29:33.213ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
148932025-03-01T01:29:33.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
148942025-03-01T01:29:33.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
148952025-03-01T01:29:33.216ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
148962025-03-01T01:29:33.216ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
148972025-03-01T01:29:33.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
148982025-03-01T01:29:33.218ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
148992025-03-01T01:29:33.218ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
149002025-03-01T01:29:33.218ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
149012025-03-01T01:29:33.220ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
149022025-03-01T01:29:33.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
149032025-03-01T01:29:33.221ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
149042025-03-01T01:29:33.224ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7, lookup_type: ById(8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7) } result = Ok(())
149052025-03-01T01:29:33.224ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
149062025-03-01T01:29:33.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
149072025-03-01T01:29:33.236ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 original_time_created = 2025-03-01 01:14:50.436545 UTC target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 time_created = 2025-03-01 01:14:50.436545 UTC
149082025-03-01T01:29:33.236ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.748704ms iteration = 89 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7","time_created":"2025-03-01T01:14:50.436545Z"}
149092025-03-01T01:29:33.246ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 32.849479ms iteration = 89 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
149102025-03-01T01:29:33.457ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 5d41270a-2f8c-42a6-926e-1e7fe63034bc roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
149112025-03-01T01:29:33.457ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 5d41270a-2f8c-42a6-926e-1e7fe63034bc resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
149122025-03-01T01:29:33.459ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2322 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 5d41270a-2f8c-42a6-926e-1e7fe63034bc response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
149132025-03-01T01:29:34.479ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = fa4655c8-83d0-4860-84bc-d7d975077e2c roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
149142025-03-01T01:29:34.479ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = fa4655c8-83d0-4860-84bc-d7d975077e2c resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
149152025-03-01T01:29:34.481ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2325 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = fa4655c8-83d0-4860-84bc-d7d975077e2c response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
149162025-03-01T01:29:35.502ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 0fc8f0f7-5145-473a-aefa-fdf9743c4f23 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
149172025-03-01T01:29:35.502ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 0fc8f0f7-5145-473a-aefa-fdf9743c4f23 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
149182025-03-01T01:29:35.504ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2388 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 0fc8f0f7-5145-473a-aefa-fdf9743c4f23 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
149192025-03-01T01:29:36.524ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 924a6db6-68fa-45fd-9156-cdc7c0bdc821 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
149202025-03-01T01:29:36.525ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 924a6db6-68fa-45fd-9156-cdc7c0bdc821 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
149212025-03-01T01:29:36.526ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2523 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 924a6db6-68fa-45fd-9156-cdc7c0bdc821 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
149222025-03-01T01:29:37.414ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 377 local_addr = [fd00:1122:3344:101::c]:34357 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = c36f464f-06a5-49a1-aec9-ff9b90578938 response_code = 200 uri = /67b03f4e-4cbd-4843-9cd9-647f610abcfc
149232025-03-01T01:29:37.547ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 27685862-684f-461f-87e7-40071648dba2 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
149242025-03-01T01:29:37.547ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 27685862-684f-461f-87e7-40071648dba2 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
149252025-03-01T01:29:37.549ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2273 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 27685862-684f-461f-87e7-40071648dba2 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
149262025-03-01T01:29:38.568ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = b714124d-8c7e-4b49-aa2f-f9d8bcdc42de roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
149272025-03-01T01:29:38.569ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = b714124d-8c7e-4b49-aa2f-f9d8bcdc42de resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
149282025-03-01T01:29:38.571ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2372 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = b714124d-8c7e-4b49-aa2f-f9d8bcdc42de response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
149292025-03-01T01:29:39.590ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 21fe9d43-d9b8-4133-b9ba-194ad567fdfc roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
149302025-03-01T01:29:39.591ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 21fe9d43-d9b8-4133-b9ba-194ad567fdfc resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
149312025-03-01T01:29:39.593ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2326 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 21fe9d43-d9b8-4133-b9ba-194ad567fdfc response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
149322025-03-01T01:29:40.612ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 2b5e5e43-fdee-4495-bbde-4245464ca875 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
149332025-03-01T01:29:40.613ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 2b5e5e43-fdee-4495-bbde-4245464ca875 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
149342025-03-01T01:29:40.615ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2268 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 2b5e5e43-fdee-4495-bbde-4245464ca875 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
149352025-03-01T01:29:41.634ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c3e85095-eff1-4220-ab48-1e992f7f9613 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
149362025-03-01T01:29:41.635ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c3e85095-eff1-4220-ab48-1e992f7f9613 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
149372025-03-01T01:29:41.636ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2120 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c3e85095-eff1-4220-ab48-1e992f7f9613 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
149382025-03-01T01:29:42.654ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 893ee4af-8da1-4273-93ba-266df5967291 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
149392025-03-01T01:29:42.655ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 893ee4af-8da1-4273-93ba-266df5967291 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
149402025-03-01T01:29:42.657ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2292 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 893ee4af-8da1-4273-93ba-266df5967291 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
149412025-03-01T01:29:43.214ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 90 reason = Timeout
149422025-03-01T01:29:43.214ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 90 reason = Timeout
149432025-03-01T01:29:43.214ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
149442025-03-01T01:29:43.214ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
149452025-03-01T01:29:43.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
149462025-03-01T01:29:43.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
149472025-03-01T01:29:43.216ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
149482025-03-01T01:29:43.216ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
149492025-03-01T01:29:43.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
149502025-03-01T01:29:43.218ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
149512025-03-01T01:29:43.218ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
149522025-03-01T01:29:43.218ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
149532025-03-01T01:29:43.218ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.722996ms iteration = 90 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
149542025-03-01T01:29:43.220ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
149552025-03-01T01:29:43.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
149562025-03-01T01:29:43.222ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
149572025-03-01T01:29:43.224ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7, lookup_type: ById(8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7) } result = Ok(())
149582025-03-01T01:29:43.224ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
149592025-03-01T01:29:43.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
149602025-03-01T01:29:43.236ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 original_time_created = 2025-03-01 01:14:50.436545 UTC target_id = 8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7 time_created = 2025-03-01 01:14:50.436545 UTC
149612025-03-01T01:29:43.236ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.180212ms iteration = 90 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8669f7f8-8e03-4d4f-81a7-5f2c021b7cb7","time_created":"2025-03-01T01:14:50.436545Z"}
149622025-03-01T01:29:43.677ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = a1590c61-fd4f-4945-81cf-3538be8ffc90 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
149632025-03-01T01:29:43.677ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = a1590c61-fd4f-4945-81cf-3538be8ffc90 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
149642025-03-01T01:29:43.679ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2049 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = a1590c61-fd4f-4945-81cf-3538be8ffc90 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
149652025-03-01T01:29:44.698ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 053fa157-084b-46b3-be5b-3de984b7b0fe roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
149662025-03-01T01:29:44.698ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 053fa157-084b-46b3-be5b-3de984b7b0fe resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
149672025-03-01T01:29:44.700ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2453 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 053fa157-084b-46b3-be5b-3de984b7b0fe response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
149682025-03-01T01:29:45.720ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = b077a0e4-e59d-4e23-bfae-86ed2e1add55 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
149692025-03-01T01:29:45.721ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = b077a0e4-e59d-4e23-bfae-86ed2e1add55 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
149702025-03-01T01:29:45.722ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2196 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = b077a0e4-e59d-4e23-bfae-86ed2e1add55 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
149712025-03-01T01:29:46.742ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 8eb2d1c2-f18f-418d-994e-0807ca549ae7 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
149722025-03-01T01:29:46.743ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 8eb2d1c2-f18f-418d-994e-0807ca549ae7 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
149732025-03-01T01:29:46.744ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2255 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 8eb2d1c2-f18f-418d-994e-0807ca549ae7 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
149742025-03-01T01:29:47.413ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 368 local_addr = [fd00:1122:3344:101::c]:34357 method = GET remote_addr = [fd00:1122:3344:101::d]:45347 req_id = ea18e078-dba9-44f5-831b-25834c8a0d65 response_code = 200 uri = /67b03f4e-4cbd-4843-9cd9-647f610abcfc
149752025-03-01T01:29:47.765ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = bfaf172a-02d3-424d-a56d-2e09de1f8c70 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
149762025-03-01T01:29:47.765ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = bfaf172a-02d3-424d-a56d-2e09de1f8c70 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
149772025-03-01T01:29:47.767ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2142 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = bfaf172a-02d3-424d-a56d-2e09de1f8c70 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
149782025-03-01T01:29:48.787ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = d6d1ac7b-cd0b-4395-a544-32e4823e75a1 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
149792025-03-01T01:29:48.787ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = d6d1ac7b-cd0b-4395-a544-32e4823e75a1 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
149802025-03-01T01:29:48.789ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2473 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = d6d1ac7b-cd0b-4395-a544-32e4823e75a1 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
149812025-03-01T01:29:49.808ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 2df718be-b2e0-4422-a8aa-ff34e8cb0624 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
149822025-03-01T01:29:49.809ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 2df718be-b2e0-4422-a8aa-ff34e8cb0624 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
149832025-03-01T01:29:49.811ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2491 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = 2df718be-b2e0-4422-a8aa-ff34e8cb0624 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
149842025-03-01T01:29:50.830ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c11f206d-c156-4a4b-b269-6fe3829e21bc roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
149852025-03-01T01:29:50.831ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c11f206d-c156-4a4b-b269-6fe3829e21bc resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
149862025-03-01T01:29:50.832ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1920 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = c11f206d-c156-4a4b-b269-6fe3829e21bc response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
149872025-03-01T01:29:51.851ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = e3eb048a-56e2-4dc7-a372-a44d8746fd55 roles = RoleSet { roles: {} } uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
149882025-03-01T01:29:51.851ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = e3eb048a-56e2-4dc7-a372-a44d8746fd55 resource = Database result = Ok(()) uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a
149892025-03-01T01:29:51.853ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2309 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43446 req_id = e3eb048a-56e2-4dc7-a372-a44d8746fd55 response_code = 200 uri = /probes/3471264f-127e-4a25-bc10-2e8249e8d70a