Max level shown:
12024-12-14T01:15:03.461ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1242 local_addr = [fd00:1122:3344:101::a]:59823 method = GET remote_addr = [fd00:1122:3344:101::d]:36065 req_id = fa98049c-5fbe-4769-8366-4ae745a5e8f3 response_code = 200 uri = /ec66f35d-9dc5-46c1-80a1-ebaa91a8212a
22024-12-14T01:15:03.531ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32024-12-14T01:15:03.531ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
42024-12-14T01:15:03.533ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
52024-12-14T01:15:03.533ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
62024-12-14T01:15:03.535ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
72024-12-14T01:15:03.536ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "4c27b5375e7db4012b4e50525f017d0aef13b0d1", lookup_type: ByCompositeId("token = \\"4c27b5375e7db4012b4e50525f017d0aef13b0d1\\"") } result = Ok(())
82024-12-14T01:15:03.536ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
92024-12-14T01:15:03.536ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
102024-12-14T01:15:03.539ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
112024-12-14T01:15:03.539ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
122024-12-14T01:15:03.541ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
132024-12-14T01:15:03.541ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
142024-12-14T01:15:03.543ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
152024-12-14T01:15:03.544ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
162024-12-14T01:15:03.545ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
172024-12-14T01:15:03.547ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 2c668072-a9a1-4a69-928c-e118c99521be, lookup_type: ById(2c668072-a9a1-4a69-928c-e118c99521be) }, key: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, lookup_type: ById(2896dd1a-5f1e-476b-86bb-db6c90fa385e) } result = Ok(())
182024-12-14T01:15:03.547ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
192024-12-14T01:15:03.547ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
202024-12-14T01:15:03.549ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
212024-12-14T01:15:03.551ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "4c27b5375e7db4012b4e50525f017d0aef13b0d1", lookup_type: ByCompositeId("4c27b5375e7db4012b4e50525f017d0aef13b0d1") } result = Ok(())
222024-12-14T01:15:03.551ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
232024-12-14T01:15:03.551ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
242024-12-14T01:15:03.556ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
252024-12-14T01:15:03.557ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
262024-12-14T01:15:03.559ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
272024-12-14T01:15:03.559ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
282024-12-14T01:15:03.561ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
292024-12-14T01:15:03.561ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
302024-12-14T01:15:03.562ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
312024-12-14T01:15:03.563ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
322024-12-14T01:15:03.564ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
332024-12-14T01:15:03.566ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 2c668072-a9a1-4a69-928c-e118c99521be, lookup_type: ById(2c668072-a9a1-4a69-928c-e118c99521be) }, key: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, lookup_type: ById(2896dd1a-5f1e-476b-86bb-db6c90fa385e) } result = Ok(())
342024-12-14T01:15:03.566ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
352024-12-14T01:15:03.566ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
362024-12-14T01:15:03.568ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
372024-12-14T01:15:03.568ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
382024-12-14T01:15:03.570ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
392024-12-14T01:15:03.570ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
402024-12-14T01:15:03.572ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
412024-12-14T01:15:03.573ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 2c668072-a9a1-4a69-928c-e118c99521be, lookup_type: ById(2c668072-a9a1-4a69-928c-e118c99521be) } result = Ok(())
422024-12-14T01:15:03.573ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = 55cc1101-48fd-4384-999f-c1eaa597af8b roles = RoleSet { roles: {} } uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
432024-12-14T01:15:03.574ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = 55cc1101-48fd-4384-999f-c1eaa597af8b resource = Database result = Ok(()) uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
442024-12-14T01:15:03.575ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = 55cc1101-48fd-4384-999f-c1eaa597af8b roles = RoleSet { roles: {} } uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
452024-12-14T01:15:03.576ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = 55cc1101-48fd-4384-999f-c1eaa597af8b resource = Database result = Ok(()) uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
462024-12-14T01:15:03.577ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = 55cc1101-48fd-4384-999f-c1eaa597af8b roles = RoleSet { roles: {} } uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
472024-12-14T01:15:03.577ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = 55cc1101-48fd-4384-999f-c1eaa597af8b resource = Database result = Ok(()) uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
482024-12-14T01:15:03.581ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = 55cc1101-48fd-4384-999f-c1eaa597af8b roles = RoleSet { roles: {} } uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
492024-12-14T01:15:03.581ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = 55cc1101-48fd-4384-999f-c1eaa597af8b resource = Database result = Ok(()) uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
502024-12-14T01:15:03.584ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = 55cc1101-48fd-4384-999f-c1eaa597af8b roles = RoleSet { roles: {} } uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
512024-12-14T01:15:03.584ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = 55cc1101-48fd-4384-999f-c1eaa597af8b resource = Database result = Ok(()) uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
522024-12-14T01:15:03.587ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = 55cc1101-48fd-4384-999f-c1eaa597af8b roles = RoleSet { roles: {} } uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
532024-12-14T01:15:03.588ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = 55cc1101-48fd-4384-999f-c1eaa597af8b resource = Database result = Ok(()) uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
542024-12-14T01:15:03.590ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = 55cc1101-48fd-4384-999f-c1eaa597af8b roles = RoleSet { roles: {} } uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
552024-12-14T01:15:03.590ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = 55cc1101-48fd-4384-999f-c1eaa597af8b resource = Database result = Ok(()) uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
562024-12-14T01:15:03.592ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = 55cc1101-48fd-4384-999f-c1eaa597af8b roles = RoleSet { roles: {(Silo, 2c668072-a9a1-4a69-928c-e118c99521be, "admin")} } uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
572024-12-14T01:15:03.596ZDEBGnexus (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = 55cc1101-48fd-4384-999f-c1eaa597af8b resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 2c668072-a9a1-4a69-928c-e118c99521be, lookup_type: ById(2c668072-a9a1-4a69-928c-e118c99521be) }, key: 776ccd20-a853-4c93-af22-41ffed980f3e, lookup_type: ByName("proj-76656375e39") }, key: d008f4b2-6063-424c-a333-d54d35c8c058, lookup_type: ByName("instance-9b46092bdd0") } result = Ok(()) uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
582024-12-14T01:15:03.596ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = 55cc1101-48fd-4384-999f-c1eaa597af8b roles = RoleSet { roles: {} } uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
592024-12-14T01:15:03.596ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = 55cc1101-48fd-4384-999f-c1eaa597af8b resource = Database result = Ok(()) uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
602024-12-14T01:15:03.600ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = 55cc1101-48fd-4384-999f-c1eaa597af8b roles = RoleSet { roles: {} } uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
612024-12-14T01:15:03.600ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = 55cc1101-48fd-4384-999f-c1eaa597af8b resource = Database result = Ok(()) uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
622024-12-14T01:15:03.603ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = 55cc1101-48fd-4384-999f-c1eaa597af8b roles = RoleSet { roles: {} } uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
632024-12-14T01:15:03.603ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = 55cc1101-48fd-4384-999f-c1eaa597af8b resource = Database result = Ok(()) uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
642024-12-14T01:15:03.606ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = 55cc1101-48fd-4384-999f-c1eaa597af8b roles = RoleSet { roles: {} } uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
652024-12-14T01:15:03.606ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = 55cc1101-48fd-4384-999f-c1eaa597af8b resource = Database result = Ok(()) uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
662024-12-14T01:15:03.610ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = 55cc1101-48fd-4384-999f-c1eaa597af8b roles = RoleSet { roles: {(Silo, 2c668072-a9a1-4a69-928c-e118c99521be, "admin")} } uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
672024-12-14T01:15:03.614ZDEBGnexus (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = 55cc1101-48fd-4384-999f-c1eaa597af8b resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 2c668072-a9a1-4a69-928c-e118c99521be, lookup_type: ById(2c668072-a9a1-4a69-928c-e118c99521be) }, key: 776ccd20-a853-4c93-af22-41ffed980f3e, lookup_type: ByName("proj-76656375e39") }, key: d008f4b2-6063-424c-a333-d54d35c8c058, lookup_type: ByName("instance-9b46092bdd0") } result = Ok(()) uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
682024-12-14T01:15:03.614ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = 55cc1101-48fd-4384-999f-c1eaa597af8b roles = RoleSet { roles: {} } uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
692024-12-14T01:15:03.615ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = 55cc1101-48fd-4384-999f-c1eaa597af8b resource = Database result = Ok(()) uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
702024-12-14T01:15:03.620ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89697 local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = 55cc1101-48fd-4384-999f-c1eaa597af8b response_code = 200 uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
712024-12-14T01:15:07.068ZDEBGnexus (BackgroundTasks): client response SledAgent = 7e423e95-464a-471f-a0d9-4799977f0b0f background_task = instance_watcher result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vmms/b2d035ea-f96d-499b-a259-358e56f0523e/state", status: 200, headers: {"content-type": "application/json", "x-request-id": "2cfc6ff6-276d-4069-85fa-3557fe74746c", "content-length": "131", "date": "Sat, 14 Dec 2024 01:15:07 GMT"} })
722024-12-14T01:15:07.068ZDEBGnexus (BackgroundTasks): client response SledAgent = 7e423e95-464a-471f-a0d9-4799977f0b0f background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "91f40676-d72b-4bca-89a3-774b29263636", "date": "Sat, 14 Dec 2024 01:15:07 GMT"} })
732024-12-14T01:15:07.068ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
742024-12-14T01:15:07.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
752024-12-14T01:15:07.070ZDEBGnexus (BackgroundTasks): updating instance state background_task = instance_watcher instance_id = d008f4b2-6063-424c-a333-d54d35c8c058 sled_id = 7e423e95-464a-471f-a0d9-4799977f0b0f state = SledVmmState { vmm_state: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-12-14T01:14:58.076284620Z }, migration_in: None, migration_out: None } vmm_id = b2d035ea-f96d-499b-a259-358e56f0523e
762024-12-14T01:15:07.072ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
772024-12-14T01:15:07.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
782024-12-14T01:15:07.073ZINFOnexus (BackgroundTasks): received new VMM runtime state from sled agent background_task = instance_watcher file = nexus/src/app/instance.rs:2116 instance_id = d008f4b2-6063-424c-a333-d54d35c8c058 migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = b2d035ea-f96d-499b-a259-358e56f0523e sled_id = 7e423e95-464a-471f-a0d9-4799977f0b0f vmm_id = b2d035ea-f96d-499b-a259-358e56f0523e vmm_state = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-12-14T01:14:58.076284620Z }
792024-12-14T01:15:07.073ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher instance_id = d008f4b2-6063-424c-a333-d54d35c8c058 roles = RoleSet { roles: {} } sled_id = 7e423e95-464a-471f-a0d9-4799977f0b0f vmm_id = b2d035ea-f96d-499b-a259-358e56f0523e
802024-12-14T01:15:07.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher instance_id = d008f4b2-6063-424c-a333-d54d35c8c058 resource = Database result = Ok(()) sled_id = 7e423e95-464a-471f-a0d9-4799977f0b0f vmm_id = b2d035ea-f96d-499b-a259-358e56f0523e
812024-12-14T01:15:07.076ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
822024-12-14T01:15:07.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
832024-12-14T01:15:07.079ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
842024-12-14T01:15:07.079ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
852024-12-14T01:15:07.081ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
862024-12-14T01:15:07.081ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
872024-12-14T01:15:07.084ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
882024-12-14T01:15:07.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
892024-12-14T01:15:07.087ZINFOnexus (BackgroundTasks): VPC route manager sled 7e423e95-464a-471f-a0d9-4799977f0b0f push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
902024-12-14T01:15:07.087ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
912024-12-14T01:15:07.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
922024-12-14T01:15:07.094ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
932024-12-14T01:15:07.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
942024-12-14T01:15:07.095ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
952024-12-14T01:15:07.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
962024-12-14T01:15:07.097ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
972024-12-14T01:15:07.097ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
982024-12-14T01:15:07.099ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
992024-12-14T01:15:07.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1002024-12-14T01:15:07.100ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1012024-12-14T01:15:07.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1022024-12-14T01:15:07.105ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 1 total_failed = 0 total_incomplete = 0 total_instances = 1 update_sagas_queued = 0
1032024-12-14T01:15:07.106ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 6.23278389s iteration = 24 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{"starting":1},"pruned_instances":0,"total_instances":1,"update_sagas_queued":0}
1042024-12-14T01:15:07.127ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1052024-12-14T01:15:07.127ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1062024-12-14T01:15:07.128ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1072024-12-14T01:15:07.132ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 2c668072-a9a1-4a69-928c-e118c99521be, lookup_type: ById(2c668072-a9a1-4a69-928c-e118c99521be) }, key: 776ccd20-a853-4c93-af22-41ffed980f3e, lookup_type: ById(776ccd20-a853-4c93-af22-41ffed980f3e) }, key: 7a393832-8e01-47ce-b5bb-84ec744aa10a, lookup_type: ById(7a393832-8e01-47ce-b5bb-84ec744aa10a) }, key: e31d5738-2b7d-4ad9-b432-e937efa769c3, lookup_type: ById(e31d5738-2b7d-4ad9-b432-e937efa769c3) } result = Ok(())
1082024-12-14T01:15:07.132ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1092024-12-14T01:15:07.132ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1102024-12-14T01:15:07.133ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1112024-12-14T01:15:07.134ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1122024-12-14T01:15:07.135ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1132024-12-14T01:15:07.135ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1142024-12-14T01:15:07.137ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1152024-12-14T01:15:07.140ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 2c668072-a9a1-4a69-928c-e118c99521be, lookup_type: ById(2c668072-a9a1-4a69-928c-e118c99521be) }, key: 776ccd20-a853-4c93-af22-41ffed980f3e, lookup_type: ById(776ccd20-a853-4c93-af22-41ffed980f3e) }, key: 7a393832-8e01-47ce-b5bb-84ec744aa10a, lookup_type: ById(7a393832-8e01-47ce-b5bb-84ec744aa10a) }, key: e31d5738-2b7d-4ad9-b432-e937efa769c3, lookup_type: ById(e31d5738-2b7d-4ad9-b432-e937efa769c3) } result = Ok(())
1162024-12-14T01:15:07.140ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1172024-12-14T01:15:07.141ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1182024-12-14T01:15:07.145ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1192024-12-14T01:15:07.145ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1202024-12-14T01:15:07.146ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1212024-12-14T01:15:07.147ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1222024-12-14T01:15:07.148ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1232024-12-14T01:15:07.148ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1242024-12-14T01:15:07.150ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1252024-12-14T01:15:07.150ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1262024-12-14T01:15:07.152ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1272024-12-14T01:15:07.152ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1282024-12-14T01:15:07.154ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1292024-12-14T01:15:07.154ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1302024-12-14T01:15:07.155ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1312024-12-14T01:15:07.155ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1322024-12-14T01:15:07.156ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1332024-12-14T01:15:07.160ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 2c668072-a9a1-4a69-928c-e118c99521be, lookup_type: ById(2c668072-a9a1-4a69-928c-e118c99521be) }, key: 776ccd20-a853-4c93-af22-41ffed980f3e, lookup_type: ById(776ccd20-a853-4c93-af22-41ffed980f3e) }, key: 7a393832-8e01-47ce-b5bb-84ec744aa10a, lookup_type: ById(7a393832-8e01-47ce-b5bb-84ec744aa10a) }, key: 067dcdd2-984b-4194-bd71-ef32c85fb67b, lookup_type: ByName("default") } result = Ok(())
1342024-12-14T01:15:07.160ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1352024-12-14T01:15:07.160ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1362024-12-14T01:15:07.162ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1372024-12-14T01:15:07.162ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1382024-12-14T01:15:07.163ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1392024-12-14T01:15:07.163ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1402024-12-14T01:15:07.165ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1412024-12-14T01:15:07.165ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1422024-12-14T01:15:07.169ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1432024-12-14T01:15:07.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1442024-12-14T01:15:07.171ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1452024-12-14T01:15:07.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1462024-12-14T01:15:07.172ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1472024-12-14T01:15:07.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1482024-12-14T01:15:07.174ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1492024-12-14T01:15:07.177ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = InternetGateway { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 2c668072-a9a1-4a69-928c-e118c99521be, lookup_type: ById(2c668072-a9a1-4a69-928c-e118c99521be) }, key: 776ccd20-a853-4c93-af22-41ffed980f3e, lookup_type: ById(776ccd20-a853-4c93-af22-41ffed980f3e) }, key: 7a393832-8e01-47ce-b5bb-84ec744aa10a, lookup_type: ById(7a393832-8e01-47ce-b5bb-84ec744aa10a) }, key: 18932050-af06-4b0f-bd31-d6d657d6e3ef, lookup_type: ByName("default") } result = Ok(())
1502024-12-14T01:15:07.177ZDEBGnexus (BackgroundTasks): client request SledAgent = 7e423e95-464a-471f-a0d9-4799977f0b0f background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
1512024-12-14T01:15:07.178ZDEBGnexus (BackgroundTasks): client response SledAgent = 7e423e95-464a-471f-a0d9-4799977f0b0f background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "3e305fc1-9290-4202-9fac-7d2b7874d002", "date": "Sat, 14 Dec 2024 01:15:07 GMT"} })
1522024-12-14T01:15:07.180ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 8.913698102s iteration = 24 status = {}
1532024-12-14T01:15:07.180ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 25 reason = Timeout
1542024-12-14T01:15:07.180ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
1552024-12-14T01:15:07.180ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1562024-12-14T01:15:07.180ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1572024-12-14T01:15:07.181ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1582024-12-14T01:15:07.183ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
1592024-12-14T01:15:07.183ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1602024-12-14T01:15:07.183ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1612024-12-14T01:15:07.184ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1622024-12-14T01:15:07.186ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
1632024-12-14T01:15:07.186ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1642024-12-14T01:15:07.186ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1652024-12-14T01:15:07.219ZINFOnexus (BackgroundTasks): VPC route manager sled 7e423e95-464a-471f-a0d9-4799977f0b0f background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
1662024-12-14T01:15:07.219ZDEBGnexus (BackgroundTasks): client request SledAgent = 7e423e95-464a-471f-a0d9-4799977f0b0f background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
1672024-12-14T01:15:07.219ZDEBGnexus (BackgroundTasks): client response SledAgent = 7e423e95-464a-471f-a0d9-4799977f0b0f background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "5a283c05-da15-42ec-8039-aace688a09bf", "content-length": "583", "date": "Sat, 14 Dec 2024 01:15:07 GMT"} })
1682024-12-14T01:15:07.219ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1692024-12-14T01:15:07.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1702024-12-14T01:15:07.234ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {bdac77ef-64e7-4acf-b95d-9c4d3e7809db: {10.151.1.175: {18932050-af06-4b0f-bd31-d6d657d6e3ef}, 10.151.1.176: {18932050-af06-4b0f-bd31-d6d657d6e3ef}}} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
1712024-12-14T01:15:07.234ZDEBGnexus (BackgroundTasks): client request SledAgent = 7e423e95-464a-471f-a0d9-4799977f0b0f background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
1722024-12-14T01:15:07.234ZDEBGnexus (BackgroundTasks): client response SledAgent = 7e423e95-464a-471f-a0d9-4799977f0b0f background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "7ea581a6-6010-4a90-a270-0a55873439f8", "date": "Sat, 14 Dec 2024 01:15:07 GMT"} })
1732024-12-14T01:15:07.234ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1742024-12-14T01:15:07.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1752024-12-14T01:15:07.236ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1762024-12-14T01:15:07.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1772024-12-14T01:15:07.239ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1782024-12-14T01:15:07.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1792024-12-14T01:15:07.241ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1802024-12-14T01:15:07.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1812024-12-14T01:15:07.243ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1822024-12-14T01:15:07.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1832024-12-14T01:15:07.245ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1842024-12-14T01:15:07.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1852024-12-14T01:15:07.248ZINFOnexus (BackgroundTasks): VPC route manager sled 7e423e95-464a-471f-a0d9-4799977f0b0f push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
1862024-12-14T01:15:07.248ZINFOnexus (BackgroundTasks): VPC route manager sled 7e423e95-464a-471f-a0d9-4799977f0b0f push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
1872024-12-14T01:15:07.248ZDEBGnexus (BackgroundTasks): client request SledAgent = 7e423e95-464a-471f-a0d9-4799977f0b0f background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
1882024-12-14T01:15:07.248ZDEBGnexus (BackgroundTasks): client response SledAgent = 7e423e95-464a-471f-a0d9-4799977f0b0f background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "496da973-6049-4b36-b4ca-69c8fb52dbaa", "date": "Sat, 14 Dec 2024 01:15:07 GMT"} })
1892024-12-14T01:15:07.250ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 70.387517ms iteration = 25 status = {}
1902024-12-14T01:15:08.623ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
1912024-12-14T01:15:08.623ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
1922024-12-14T01:15:08.625ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
1932024-12-14T01:15:08.625ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
1942024-12-14T01:15:08.627ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
1952024-12-14T01:15:08.628ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "4c27b5375e7db4012b4e50525f017d0aef13b0d1", lookup_type: ByCompositeId("token = \\"4c27b5375e7db4012b4e50525f017d0aef13b0d1\\"") } result = Ok(())
1962024-12-14T01:15:08.628ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
1972024-12-14T01:15:08.628ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
1982024-12-14T01:15:08.630ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
1992024-12-14T01:15:08.630ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
2002024-12-14T01:15:08.632ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
2012024-12-14T01:15:08.632ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
2022024-12-14T01:15:08.634ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
2032024-12-14T01:15:08.634ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
2042024-12-14T01:15:08.636ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
2052024-12-14T01:15:08.637ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 2c668072-a9a1-4a69-928c-e118c99521be, lookup_type: ById(2c668072-a9a1-4a69-928c-e118c99521be) }, key: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, lookup_type: ById(2896dd1a-5f1e-476b-86bb-db6c90fa385e) } result = Ok(())
2062024-12-14T01:15:08.637ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
2072024-12-14T01:15:08.637ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
2082024-12-14T01:15:08.638ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
2092024-12-14T01:15:08.640ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "4c27b5375e7db4012b4e50525f017d0aef13b0d1", lookup_type: ByCompositeId("4c27b5375e7db4012b4e50525f017d0aef13b0d1") } result = Ok(())
2102024-12-14T01:15:08.640ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
2112024-12-14T01:15:08.640ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
2122024-12-14T01:15:08.645ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
2132024-12-14T01:15:08.645ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
2142024-12-14T01:15:08.647ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
2152024-12-14T01:15:08.647ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
2162024-12-14T01:15:08.649ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
2172024-12-14T01:15:08.649ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
2182024-12-14T01:15:08.650ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
2192024-12-14T01:15:08.651ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
2202024-12-14T01:15:08.652ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
2212024-12-14T01:15:08.653ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 2c668072-a9a1-4a69-928c-e118c99521be, lookup_type: ById(2c668072-a9a1-4a69-928c-e118c99521be) }, key: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, lookup_type: ById(2896dd1a-5f1e-476b-86bb-db6c90fa385e) } result = Ok(())
2222024-12-14T01:15:08.653ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
2232024-12-14T01:15:08.653ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
2242024-12-14T01:15:08.654ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
2252024-12-14T01:15:08.655ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
2262024-12-14T01:15:08.656ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
2272024-12-14T01:15:08.656ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
2282024-12-14T01:15:08.658ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
2292024-12-14T01:15:08.659ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 2c668072-a9a1-4a69-928c-e118c99521be, lookup_type: ById(2c668072-a9a1-4a69-928c-e118c99521be) } result = Ok(())
2302024-12-14T01:15:08.659ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = 8b2da22a-54d5-40c3-904e-bd2c0fc347be roles = RoleSet { roles: {} } uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
2312024-12-14T01:15:08.659ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = 8b2da22a-54d5-40c3-904e-bd2c0fc347be resource = Database result = Ok(()) uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
2322024-12-14T01:15:08.661ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = 8b2da22a-54d5-40c3-904e-bd2c0fc347be roles = RoleSet { roles: {} } uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
2332024-12-14T01:15:08.661ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = 8b2da22a-54d5-40c3-904e-bd2c0fc347be resource = Database result = Ok(()) uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
2342024-12-14T01:15:08.662ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = 8b2da22a-54d5-40c3-904e-bd2c0fc347be roles = RoleSet { roles: {} } uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
2352024-12-14T01:15:08.662ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = 8b2da22a-54d5-40c3-904e-bd2c0fc347be resource = Database result = Ok(()) uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
2362024-12-14T01:15:08.665ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = 8b2da22a-54d5-40c3-904e-bd2c0fc347be roles = RoleSet { roles: {} } uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
2372024-12-14T01:15:08.665ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = 8b2da22a-54d5-40c3-904e-bd2c0fc347be resource = Database result = Ok(()) uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
2382024-12-14T01:15:08.667ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = 8b2da22a-54d5-40c3-904e-bd2c0fc347be roles = RoleSet { roles: {} } uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
2392024-12-14T01:15:08.668ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = 8b2da22a-54d5-40c3-904e-bd2c0fc347be resource = Database result = Ok(()) uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
2402024-12-14T01:15:08.670ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = 8b2da22a-54d5-40c3-904e-bd2c0fc347be roles = RoleSet { roles: {} } uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
2412024-12-14T01:15:08.670ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = 8b2da22a-54d5-40c3-904e-bd2c0fc347be resource = Database result = Ok(()) uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
2422024-12-14T01:15:08.673ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = 8b2da22a-54d5-40c3-904e-bd2c0fc347be roles = RoleSet { roles: {} } uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
2432024-12-14T01:15:08.673ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = 8b2da22a-54d5-40c3-904e-bd2c0fc347be resource = Database result = Ok(()) uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
2442024-12-14T01:15:08.675ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = 8b2da22a-54d5-40c3-904e-bd2c0fc347be roles = RoleSet { roles: {(Silo, 2c668072-a9a1-4a69-928c-e118c99521be, "admin")} } uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
2452024-12-14T01:15:08.678ZDEBGnexus (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = 8b2da22a-54d5-40c3-904e-bd2c0fc347be resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 2c668072-a9a1-4a69-928c-e118c99521be, lookup_type: ById(2c668072-a9a1-4a69-928c-e118c99521be) }, key: 776ccd20-a853-4c93-af22-41ffed980f3e, lookup_type: ByName("proj-76656375e39") }, key: d008f4b2-6063-424c-a333-d54d35c8c058, lookup_type: ByName("instance-9b46092bdd0") } result = Ok(()) uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
2462024-12-14T01:15:08.678ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = 8b2da22a-54d5-40c3-904e-bd2c0fc347be roles = RoleSet { roles: {} } uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
2472024-12-14T01:15:08.678ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = 8b2da22a-54d5-40c3-904e-bd2c0fc347be resource = Database result = Ok(()) uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
2482024-12-14T01:15:08.681ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = 8b2da22a-54d5-40c3-904e-bd2c0fc347be roles = RoleSet { roles: {} } uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
2492024-12-14T01:15:08.681ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = 8b2da22a-54d5-40c3-904e-bd2c0fc347be resource = Database result = Ok(()) uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
2502024-12-14T01:15:08.683ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = 8b2da22a-54d5-40c3-904e-bd2c0fc347be roles = RoleSet { roles: {} } uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
2512024-12-14T01:15:08.683ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = 8b2da22a-54d5-40c3-904e-bd2c0fc347be resource = Database result = Ok(()) uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
2522024-12-14T01:15:08.686ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = 8b2da22a-54d5-40c3-904e-bd2c0fc347be roles = RoleSet { roles: {} } uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
2532024-12-14T01:15:08.686ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = 8b2da22a-54d5-40c3-904e-bd2c0fc347be resource = Database result = Ok(()) uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
2542024-12-14T01:15:08.688ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = 8b2da22a-54d5-40c3-904e-bd2c0fc347be roles = RoleSet { roles: {(Silo, 2c668072-a9a1-4a69-928c-e118c99521be, "admin")} } uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
2552024-12-14T01:15:08.691ZDEBGnexus (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = 8b2da22a-54d5-40c3-904e-bd2c0fc347be resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 2c668072-a9a1-4a69-928c-e118c99521be, lookup_type: ById(2c668072-a9a1-4a69-928c-e118c99521be) }, key: 776ccd20-a853-4c93-af22-41ffed980f3e, lookup_type: ByName("proj-76656375e39") }, key: d008f4b2-6063-424c-a333-d54d35c8c058, lookup_type: ByName("instance-9b46092bdd0") } result = Ok(()) uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
2562024-12-14T01:15:08.691ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = 8b2da22a-54d5-40c3-904e-bd2c0fc347be roles = RoleSet { roles: {} } uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
2572024-12-14T01:15:08.692ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = 8b2da22a-54d5-40c3-904e-bd2c0fc347be resource = Database result = Ok(()) uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
2582024-12-14T01:15:08.694ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 71031 local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = 8b2da22a-54d5-40c3-904e-bd2c0fc347be response_code = 200 uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
2592024-12-14T01:15:08.697ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
2602024-12-14T01:15:08.697ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
2612024-12-14T01:15:08.699ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
2622024-12-14T01:15:08.699ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
2632024-12-14T01:15:08.700ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
2642024-12-14T01:15:08.701ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "4c27b5375e7db4012b4e50525f017d0aef13b0d1", lookup_type: ByCompositeId("token = \\"4c27b5375e7db4012b4e50525f017d0aef13b0d1\\"") } result = Ok(())
2652024-12-14T01:15:08.701ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
2662024-12-14T01:15:08.702ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
2672024-12-14T01:15:08.703ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
2682024-12-14T01:15:08.703ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
2692024-12-14T01:15:08.705ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
2702024-12-14T01:15:08.705ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
2712024-12-14T01:15:08.706ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
2722024-12-14T01:15:08.706ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
2732024-12-14T01:15:08.707ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
2742024-12-14T01:15:08.709ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 2c668072-a9a1-4a69-928c-e118c99521be, lookup_type: ById(2c668072-a9a1-4a69-928c-e118c99521be) }, key: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, lookup_type: ById(2896dd1a-5f1e-476b-86bb-db6c90fa385e) } result = Ok(())
2752024-12-14T01:15:08.709ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
2762024-12-14T01:15:08.709ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
2772024-12-14T01:15:08.710ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
2782024-12-14T01:15:08.711ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "4c27b5375e7db4012b4e50525f017d0aef13b0d1", lookup_type: ByCompositeId("4c27b5375e7db4012b4e50525f017d0aef13b0d1") } result = Ok(())
2792024-12-14T01:15:08.711ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
2802024-12-14T01:15:08.711ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
2812024-12-14T01:15:08.716ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
2822024-12-14T01:15:08.716ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
2832024-12-14T01:15:08.717ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
2842024-12-14T01:15:08.717ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
2852024-12-14T01:15:08.718ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
2862024-12-14T01:15:08.718ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
2872024-12-14T01:15:08.720ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
2882024-12-14T01:15:08.720ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
2892024-12-14T01:15:08.721ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
2902024-12-14T01:15:08.723ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 2c668072-a9a1-4a69-928c-e118c99521be, lookup_type: ById(2c668072-a9a1-4a69-928c-e118c99521be) }, key: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, lookup_type: ById(2896dd1a-5f1e-476b-86bb-db6c90fa385e) } result = Ok(())
2912024-12-14T01:15:08.723ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
2922024-12-14T01:15:08.723ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
2932024-12-14T01:15:08.724ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
2942024-12-14T01:15:08.724ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
2952024-12-14T01:15:08.725ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
2962024-12-14T01:15:08.726ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
2972024-12-14T01:15:08.727ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
2982024-12-14T01:15:08.728ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 2c668072-a9a1-4a69-928c-e118c99521be, lookup_type: ById(2c668072-a9a1-4a69-928c-e118c99521be) } result = Ok(())
2992024-12-14T01:15:08.728ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = fbb45c3d-3429-4835-881a-2c2412293c08 roles = RoleSet { roles: {} } uri = /v1/instances/instance-9b46092bdd0/serial-console?from_start=0&max_bytes=10485760&project=proj-76656375e39
3002024-12-14T01:15:08.728ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = fbb45c3d-3429-4835-881a-2c2412293c08 resource = Database result = Ok(()) uri = /v1/instances/instance-9b46092bdd0/serial-console?from_start=0&max_bytes=10485760&project=proj-76656375e39
3012024-12-14T01:15:08.729ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = fbb45c3d-3429-4835-881a-2c2412293c08 roles = RoleSet { roles: {} } uri = /v1/instances/instance-9b46092bdd0/serial-console?from_start=0&max_bytes=10485760&project=proj-76656375e39
3022024-12-14T01:15:08.729ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = fbb45c3d-3429-4835-881a-2c2412293c08 resource = Database result = Ok(()) uri = /v1/instances/instance-9b46092bdd0/serial-console?from_start=0&max_bytes=10485760&project=proj-76656375e39
3032024-12-14T01:15:08.730ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = fbb45c3d-3429-4835-881a-2c2412293c08 roles = RoleSet { roles: {} } uri = /v1/instances/instance-9b46092bdd0/serial-console?from_start=0&max_bytes=10485760&project=proj-76656375e39
3042024-12-14T01:15:08.731ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = fbb45c3d-3429-4835-881a-2c2412293c08 resource = Database result = Ok(()) uri = /v1/instances/instance-9b46092bdd0/serial-console?from_start=0&max_bytes=10485760&project=proj-76656375e39
3052024-12-14T01:15:08.733ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = fbb45c3d-3429-4835-881a-2c2412293c08 roles = RoleSet { roles: {} } uri = /v1/instances/instance-9b46092bdd0/serial-console?from_start=0&max_bytes=10485760&project=proj-76656375e39
3062024-12-14T01:15:08.734ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = fbb45c3d-3429-4835-881a-2c2412293c08 resource = Database result = Ok(()) uri = /v1/instances/instance-9b46092bdd0/serial-console?from_start=0&max_bytes=10485760&project=proj-76656375e39
3072024-12-14T01:15:08.735ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = fbb45c3d-3429-4835-881a-2c2412293c08 roles = RoleSet { roles: {} } uri = /v1/instances/instance-9b46092bdd0/serial-console?from_start=0&max_bytes=10485760&project=proj-76656375e39
3082024-12-14T01:15:08.736ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = fbb45c3d-3429-4835-881a-2c2412293c08 resource = Database result = Ok(()) uri = /v1/instances/instance-9b46092bdd0/serial-console?from_start=0&max_bytes=10485760&project=proj-76656375e39
3092024-12-14T01:15:08.737ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = fbb45c3d-3429-4835-881a-2c2412293c08 roles = RoleSet { roles: {} } uri = /v1/instances/instance-9b46092bdd0/serial-console?from_start=0&max_bytes=10485760&project=proj-76656375e39
3102024-12-14T01:15:08.738ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = fbb45c3d-3429-4835-881a-2c2412293c08 resource = Database result = Ok(()) uri = /v1/instances/instance-9b46092bdd0/serial-console?from_start=0&max_bytes=10485760&project=proj-76656375e39
3112024-12-14T01:15:08.740ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = fbb45c3d-3429-4835-881a-2c2412293c08 roles = RoleSet { roles: {} } uri = /v1/instances/instance-9b46092bdd0/serial-console?from_start=0&max_bytes=10485760&project=proj-76656375e39
3122024-12-14T01:15:08.740ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = fbb45c3d-3429-4835-881a-2c2412293c08 resource = Database result = Ok(()) uri = /v1/instances/instance-9b46092bdd0/serial-console?from_start=0&max_bytes=10485760&project=proj-76656375e39
3132024-12-14T01:15:08.743ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = fbb45c3d-3429-4835-881a-2c2412293c08 roles = RoleSet { roles: {(Silo, 2c668072-a9a1-4a69-928c-e118c99521be, "admin")} } uri = /v1/instances/instance-9b46092bdd0/serial-console?from_start=0&max_bytes=10485760&project=proj-76656375e39
3142024-12-14T01:15:08.746ZDEBGnexus (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = fbb45c3d-3429-4835-881a-2c2412293c08 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 2c668072-a9a1-4a69-928c-e118c99521be, lookup_type: ById(2c668072-a9a1-4a69-928c-e118c99521be) }, key: 776ccd20-a853-4c93-af22-41ffed980f3e, lookup_type: ByName("proj-76656375e39") }, key: d008f4b2-6063-424c-a333-d54d35c8c058, lookup_type: ByName("instance-9b46092bdd0") } result = Ok(()) uri = /v1/instances/instance-9b46092bdd0/serial-console?from_start=0&max_bytes=10485760&project=proj-76656375e39
3152024-12-14T01:15:08.746ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = fbb45c3d-3429-4835-881a-2c2412293c08 roles = RoleSet { roles: {} } uri = /v1/instances/instance-9b46092bdd0/serial-console?from_start=0&max_bytes=10485760&project=proj-76656375e39
3162024-12-14T01:15:08.746ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = fbb45c3d-3429-4835-881a-2c2412293c08 resource = Database result = Ok(()) uri = /v1/instances/instance-9b46092bdd0/serial-console?from_start=0&max_bytes=10485760&project=proj-76656375e39
3172024-12-14T01:15:08.748ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = fbb45c3d-3429-4835-881a-2c2412293c08 roles = RoleSet { roles: {} } uri = /v1/instances/instance-9b46092bdd0/serial-console?from_start=0&max_bytes=10485760&project=proj-76656375e39
3182024-12-14T01:15:08.748ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = fbb45c3d-3429-4835-881a-2c2412293c08 resource = Database result = Ok(()) uri = /v1/instances/instance-9b46092bdd0/serial-console?from_start=0&max_bytes=10485760&project=proj-76656375e39
3192024-12-14T01:15:08.751ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = fbb45c3d-3429-4835-881a-2c2412293c08 roles = RoleSet { roles: {} } uri = /v1/instances/instance-9b46092bdd0/serial-console?from_start=0&max_bytes=10485760&project=proj-76656375e39
3202024-12-14T01:15:08.751ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = fbb45c3d-3429-4835-881a-2c2412293c08 resource = Database result = Ok(()) uri = /v1/instances/instance-9b46092bdd0/serial-console?from_start=0&max_bytes=10485760&project=proj-76656375e39
3212024-12-14T01:15:08.752ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = fbb45c3d-3429-4835-881a-2c2412293c08 roles = RoleSet { roles: {} } uri = /v1/instances/instance-9b46092bdd0/serial-console?from_start=0&max_bytes=10485760&project=proj-76656375e39
3222024-12-14T01:15:08.753ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = fbb45c3d-3429-4835-881a-2c2412293c08 resource = Database result = Ok(()) uri = /v1/instances/instance-9b46092bdd0/serial-console?from_start=0&max_bytes=10485760&project=proj-76656375e39
3232024-12-14T01:15:08.755ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = fbb45c3d-3429-4835-881a-2c2412293c08 roles = RoleSet { roles: {(Silo, 2c668072-a9a1-4a69-928c-e118c99521be, "admin")} } uri = /v1/instances/instance-9b46092bdd0/serial-console?from_start=0&max_bytes=10485760&project=proj-76656375e39
3242024-12-14T01:15:08.758ZDEBGnexus (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = fbb45c3d-3429-4835-881a-2c2412293c08 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 2c668072-a9a1-4a69-928c-e118c99521be, lookup_type: ById(2c668072-a9a1-4a69-928c-e118c99521be) }, key: 776ccd20-a853-4c93-af22-41ffed980f3e, lookup_type: ByName("proj-76656375e39") }, key: d008f4b2-6063-424c-a333-d54d35c8c058, lookup_type: ByName("instance-9b46092bdd0") } result = Ok(()) uri = /v1/instances/instance-9b46092bdd0/serial-console?from_start=0&max_bytes=10485760&project=proj-76656375e39
3252024-12-14T01:15:08.758ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = fbb45c3d-3429-4835-881a-2c2412293c08 roles = RoleSet { roles: {} } uri = /v1/instances/instance-9b46092bdd0/serial-console?from_start=0&max_bytes=10485760&project=proj-76656375e39
3262024-12-14T01:15:08.758ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = fbb45c3d-3429-4835-881a-2c2412293c08 resource = Database result = Ok(()) uri = /v1/instances/instance-9b46092bdd0/serial-console?from_start=0&max_bytes=10485760&project=proj-76656375e39
3272024-12-14T01:15:08.798ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102998 local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = fbb45c3d-3429-4835-881a-2c2412293c08 response_code = 200 uri = /v1/instances/instance-9b46092bdd0/serial-console?from_start=0&max_bytes=10485760&project=proj-76656375e39
3282024-12-14T01:15:10.873ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 71 reason = Timeout
3292024-12-14T01:15:10.873ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 71 reason = Timeout
3302024-12-14T01:15:10.873ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
3312024-12-14T01:15:10.873ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3322024-12-14T01:15:10.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3332024-12-14T01:15:10.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
3342024-12-14T01:15:10.875ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3352024-12-14T01:15:10.879ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
3362024-12-14T01:15:10.879ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3372024-12-14T01:15:10.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3382024-12-14T01:15:10.881ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
3392024-12-14T01:15:10.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
3402024-12-14T01:15:10.881ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3412024-12-14T01:15:10.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3422024-12-14T01:15:10.884ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3432024-12-14T01:15:10.887ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8770bfcc-3a71-4738-a6b0-91008cadcb0f, lookup_type: ById(8770bfcc-3a71-4738-a6b0-91008cadcb0f) } result = Ok(())
3442024-12-14T01:15:10.887ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3452024-12-14T01:15:10.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3462024-12-14T01:15:10.900ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8770bfcc-3a71-4738-a6b0-91008cadcb0f original_time_created = 2024-12-14 01:03:15.378067 UTC target_id = 8770bfcc-3a71-4738-a6b0-91008cadcb0f time_created = 2024-12-14 01:03:15.378067 UTC
3472024-12-14T01:15:10.900ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 26.737034ms iteration = 71 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8770bfcc-3a71-4738-a6b0-91008cadcb0f","time_created":"2024-12-14T01:03:15.378067Z"}
3482024-12-14T01:15:10.912ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 38.579866ms iteration = 71 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
3492024-12-14T01:15:13.463ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3867 local_addr = [fd00:1122:3344:101::a]:59823 method = GET remote_addr = [fd00:1122:3344:101::d]:36065 req_id = f290e729-50b7-4781-8e6c-b4b7e52c29b9 response_code = 200 uri = /ec66f35d-9dc5-46c1-80a1-ebaa91a8212a
3502024-12-14T01:15:13.801ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
3512024-12-14T01:15:13.801ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
3522024-12-14T01:15:13.803ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
3532024-12-14T01:15:13.803ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
3542024-12-14T01:15:13.804ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
3552024-12-14T01:15:13.806ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "4c27b5375e7db4012b4e50525f017d0aef13b0d1", lookup_type: ByCompositeId("token = \\"4c27b5375e7db4012b4e50525f017d0aef13b0d1\\"") } result = Ok(())
3562024-12-14T01:15:13.806ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
3572024-12-14T01:15:13.806ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
3582024-12-14T01:15:13.807ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
3592024-12-14T01:15:13.808ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
3602024-12-14T01:15:13.809ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
3612024-12-14T01:15:13.810ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
3622024-12-14T01:15:13.811ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
3632024-12-14T01:15:13.811ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
3642024-12-14T01:15:13.813ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
3652024-12-14T01:15:13.814ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 2c668072-a9a1-4a69-928c-e118c99521be, lookup_type: ById(2c668072-a9a1-4a69-928c-e118c99521be) }, key: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, lookup_type: ById(2896dd1a-5f1e-476b-86bb-db6c90fa385e) } result = Ok(())
3662024-12-14T01:15:13.814ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
3672024-12-14T01:15:13.814ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
3682024-12-14T01:15:13.815ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
3692024-12-14T01:15:13.817ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "4c27b5375e7db4012b4e50525f017d0aef13b0d1", lookup_type: ByCompositeId("4c27b5375e7db4012b4e50525f017d0aef13b0d1") } result = Ok(())
3702024-12-14T01:15:13.817ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
3712024-12-14T01:15:13.817ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
3722024-12-14T01:15:13.821ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
3732024-12-14T01:15:13.821ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
3742024-12-14T01:15:13.822ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
3752024-12-14T01:15:13.822ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
3762024-12-14T01:15:13.824ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
3772024-12-14T01:15:13.824ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
3782024-12-14T01:15:13.825ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
3792024-12-14T01:15:13.826ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
3802024-12-14T01:15:13.826ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
3812024-12-14T01:15:13.828ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 2c668072-a9a1-4a69-928c-e118c99521be, lookup_type: ById(2c668072-a9a1-4a69-928c-e118c99521be) }, key: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, lookup_type: ById(2896dd1a-5f1e-476b-86bb-db6c90fa385e) } result = Ok(())
3822024-12-14T01:15:13.828ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
3832024-12-14T01:15:13.828ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
3842024-12-14T01:15:13.829ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
3852024-12-14T01:15:13.830ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
3862024-12-14T01:15:13.831ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
3872024-12-14T01:15:13.831ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
3882024-12-14T01:15:13.833ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
3892024-12-14T01:15:13.834ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 2c668072-a9a1-4a69-928c-e118c99521be, lookup_type: ById(2c668072-a9a1-4a69-928c-e118c99521be) } result = Ok(())
3902024-12-14T01:15:13.834ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = fd190add-b8ce-44f3-a8d4-41bb3b6c3304 roles = RoleSet { roles: {} } uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
3912024-12-14T01:15:13.834ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = fd190add-b8ce-44f3-a8d4-41bb3b6c3304 resource = Database result = Ok(()) uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
3922024-12-14T01:15:13.835ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = fd190add-b8ce-44f3-a8d4-41bb3b6c3304 roles = RoleSet { roles: {} } uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
3932024-12-14T01:15:13.835ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = fd190add-b8ce-44f3-a8d4-41bb3b6c3304 resource = Database result = Ok(()) uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
3942024-12-14T01:15:13.836ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = fd190add-b8ce-44f3-a8d4-41bb3b6c3304 roles = RoleSet { roles: {} } uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
3952024-12-14T01:15:13.836ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = fd190add-b8ce-44f3-a8d4-41bb3b6c3304 resource = Database result = Ok(()) uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
3962024-12-14T01:15:13.838ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = fd190add-b8ce-44f3-a8d4-41bb3b6c3304 roles = RoleSet { roles: {} } uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
3972024-12-14T01:15:13.838ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = fd190add-b8ce-44f3-a8d4-41bb3b6c3304 resource = Database result = Ok(()) uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
3982024-12-14T01:15:13.841ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = fd190add-b8ce-44f3-a8d4-41bb3b6c3304 roles = RoleSet { roles: {} } uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
3992024-12-14T01:15:13.841ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = fd190add-b8ce-44f3-a8d4-41bb3b6c3304 resource = Database result = Ok(()) uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
4002024-12-14T01:15:13.843ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = fd190add-b8ce-44f3-a8d4-41bb3b6c3304 roles = RoleSet { roles: {} } uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
4012024-12-14T01:15:13.843ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = fd190add-b8ce-44f3-a8d4-41bb3b6c3304 resource = Database result = Ok(()) uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
4022024-12-14T01:15:13.846ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = fd190add-b8ce-44f3-a8d4-41bb3b6c3304 roles = RoleSet { roles: {} } uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
4032024-12-14T01:15:13.846ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = fd190add-b8ce-44f3-a8d4-41bb3b6c3304 resource = Database result = Ok(()) uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
4042024-12-14T01:15:13.847ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = fd190add-b8ce-44f3-a8d4-41bb3b6c3304 roles = RoleSet { roles: {(Silo, 2c668072-a9a1-4a69-928c-e118c99521be, "admin")} } uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
4052024-12-14T01:15:13.850ZDEBGnexus (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = fd190add-b8ce-44f3-a8d4-41bb3b6c3304 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 2c668072-a9a1-4a69-928c-e118c99521be, lookup_type: ById(2c668072-a9a1-4a69-928c-e118c99521be) }, key: 776ccd20-a853-4c93-af22-41ffed980f3e, lookup_type: ByName("proj-76656375e39") }, key: d008f4b2-6063-424c-a333-d54d35c8c058, lookup_type: ByName("instance-9b46092bdd0") } result = Ok(()) uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
4062024-12-14T01:15:13.850ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = fd190add-b8ce-44f3-a8d4-41bb3b6c3304 roles = RoleSet { roles: {} } uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
4072024-12-14T01:15:13.851ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = fd190add-b8ce-44f3-a8d4-41bb3b6c3304 resource = Database result = Ok(()) uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
4082024-12-14T01:15:13.853ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = fd190add-b8ce-44f3-a8d4-41bb3b6c3304 roles = RoleSet { roles: {} } uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
4092024-12-14T01:15:13.853ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = fd190add-b8ce-44f3-a8d4-41bb3b6c3304 resource = Database result = Ok(()) uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
4102024-12-14T01:15:13.855ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = fd190add-b8ce-44f3-a8d4-41bb3b6c3304 roles = RoleSet { roles: {} } uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
4112024-12-14T01:15:13.855ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = fd190add-b8ce-44f3-a8d4-41bb3b6c3304 resource = Database result = Ok(()) uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
4122024-12-14T01:15:13.857ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = fd190add-b8ce-44f3-a8d4-41bb3b6c3304 roles = RoleSet { roles: {} } uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
4132024-12-14T01:15:13.858ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = fd190add-b8ce-44f3-a8d4-41bb3b6c3304 resource = Database result = Ok(()) uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
4142024-12-14T01:15:13.860ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = fd190add-b8ce-44f3-a8d4-41bb3b6c3304 roles = RoleSet { roles: {(Silo, 2c668072-a9a1-4a69-928c-e118c99521be, "admin")} } uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
4152024-12-14T01:15:13.863ZDEBGnexus (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = fd190add-b8ce-44f3-a8d4-41bb3b6c3304 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 2c668072-a9a1-4a69-928c-e118c99521be, lookup_type: ById(2c668072-a9a1-4a69-928c-e118c99521be) }, key: 776ccd20-a853-4c93-af22-41ffed980f3e, lookup_type: ByName("proj-76656375e39") }, key: d008f4b2-6063-424c-a333-d54d35c8c058, lookup_type: ByName("instance-9b46092bdd0") } result = Ok(()) uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
4162024-12-14T01:15:13.863ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = fd190add-b8ce-44f3-a8d4-41bb3b6c3304 roles = RoleSet { roles: {} } uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
4172024-12-14T01:15:13.863ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = fd190add-b8ce-44f3-a8d4-41bb3b6c3304 resource = Database result = Ok(()) uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
4182024-12-14T01:15:13.866ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 65045 local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = fd190add-b8ce-44f3-a8d4-41bb3b6c3304 response_code = 200 uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
4192024-12-14T01:15:13.867ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
4202024-12-14T01:15:13.867ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
4212024-12-14T01:15:13.868ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
4222024-12-14T01:15:13.868ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
4232024-12-14T01:15:13.869ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
4242024-12-14T01:15:13.870ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "4c27b5375e7db4012b4e50525f017d0aef13b0d1", lookup_type: ByCompositeId("token = \\"4c27b5375e7db4012b4e50525f017d0aef13b0d1\\"") } result = Ok(())
4252024-12-14T01:15:13.870ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
4262024-12-14T01:15:13.871ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
4272024-12-14T01:15:13.872ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
4282024-12-14T01:15:13.872ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
4292024-12-14T01:15:13.873ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
4302024-12-14T01:15:13.873ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
4312024-12-14T01:15:13.874ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
4322024-12-14T01:15:13.875ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
4332024-12-14T01:15:13.876ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
4342024-12-14T01:15:13.877ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 2c668072-a9a1-4a69-928c-e118c99521be, lookup_type: ById(2c668072-a9a1-4a69-928c-e118c99521be) }, key: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, lookup_type: ById(2896dd1a-5f1e-476b-86bb-db6c90fa385e) } result = Ok(())
4352024-12-14T01:15:13.877ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
4362024-12-14T01:15:13.877ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
4372024-12-14T01:15:13.878ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
4382024-12-14T01:15:13.879ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "4c27b5375e7db4012b4e50525f017d0aef13b0d1", lookup_type: ByCompositeId("4c27b5375e7db4012b4e50525f017d0aef13b0d1") } result = Ok(())
4392024-12-14T01:15:13.879ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
4402024-12-14T01:15:13.880ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
4412024-12-14T01:15:13.883ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
4422024-12-14T01:15:13.883ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
4432024-12-14T01:15:13.884ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
4442024-12-14T01:15:13.884ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
4452024-12-14T01:15:13.885ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
4462024-12-14T01:15:13.885ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
4472024-12-14T01:15:13.887ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
4482024-12-14T01:15:13.887ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
4492024-12-14T01:15:13.888ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
4502024-12-14T01:15:13.889ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 2c668072-a9a1-4a69-928c-e118c99521be, lookup_type: ById(2c668072-a9a1-4a69-928c-e118c99521be) }, key: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, lookup_type: ById(2896dd1a-5f1e-476b-86bb-db6c90fa385e) } result = Ok(())
4512024-12-14T01:15:13.889ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
4522024-12-14T01:15:13.889ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
4532024-12-14T01:15:13.891ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
4542024-12-14T01:15:13.891ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
4552024-12-14T01:15:13.892ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
4562024-12-14T01:15:13.892ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
4572024-12-14T01:15:13.893ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
4582024-12-14T01:15:13.894ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 2c668072-a9a1-4a69-928c-e118c99521be, lookup_type: ById(2c668072-a9a1-4a69-928c-e118c99521be) } result = Ok(())
4592024-12-14T01:15:13.894ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = 84c66950-dc33-4c87-9949-e300f38cbcfa roles = RoleSet { roles: {} } uri = /v1/instances/instance-9b46092bdd0/serial-console?from_start=0&max_bytes=10485760&project=proj-76656375e39
4602024-12-14T01:15:13.895ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = 84c66950-dc33-4c87-9949-e300f38cbcfa resource = Database result = Ok(()) uri = /v1/instances/instance-9b46092bdd0/serial-console?from_start=0&max_bytes=10485760&project=proj-76656375e39
4612024-12-14T01:15:13.896ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = 84c66950-dc33-4c87-9949-e300f38cbcfa roles = RoleSet { roles: {} } uri = /v1/instances/instance-9b46092bdd0/serial-console?from_start=0&max_bytes=10485760&project=proj-76656375e39
4622024-12-14T01:15:13.896ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = 84c66950-dc33-4c87-9949-e300f38cbcfa resource = Database result = Ok(()) uri = /v1/instances/instance-9b46092bdd0/serial-console?from_start=0&max_bytes=10485760&project=proj-76656375e39
4632024-12-14T01:15:13.898ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = 84c66950-dc33-4c87-9949-e300f38cbcfa roles = RoleSet { roles: {} } uri = /v1/instances/instance-9b46092bdd0/serial-console?from_start=0&max_bytes=10485760&project=proj-76656375e39
4642024-12-14T01:15:13.898ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = 84c66950-dc33-4c87-9949-e300f38cbcfa resource = Database result = Ok(()) uri = /v1/instances/instance-9b46092bdd0/serial-console?from_start=0&max_bytes=10485760&project=proj-76656375e39
4652024-12-14T01:15:13.900ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = 84c66950-dc33-4c87-9949-e300f38cbcfa roles = RoleSet { roles: {} } uri = /v1/instances/instance-9b46092bdd0/serial-console?from_start=0&max_bytes=10485760&project=proj-76656375e39
4662024-12-14T01:15:13.900ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = 84c66950-dc33-4c87-9949-e300f38cbcfa resource = Database result = Ok(()) uri = /v1/instances/instance-9b46092bdd0/serial-console?from_start=0&max_bytes=10485760&project=proj-76656375e39
4672024-12-14T01:15:13.902ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = 84c66950-dc33-4c87-9949-e300f38cbcfa roles = RoleSet { roles: {} } uri = /v1/instances/instance-9b46092bdd0/serial-console?from_start=0&max_bytes=10485760&project=proj-76656375e39
4682024-12-14T01:15:13.902ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = 84c66950-dc33-4c87-9949-e300f38cbcfa resource = Database result = Ok(()) uri = /v1/instances/instance-9b46092bdd0/serial-console?from_start=0&max_bytes=10485760&project=proj-76656375e39
4692024-12-14T01:15:13.904ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = 84c66950-dc33-4c87-9949-e300f38cbcfa roles = RoleSet { roles: {} } uri = /v1/instances/instance-9b46092bdd0/serial-console?from_start=0&max_bytes=10485760&project=proj-76656375e39
4702024-12-14T01:15:13.904ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = 84c66950-dc33-4c87-9949-e300f38cbcfa resource = Database result = Ok(()) uri = /v1/instances/instance-9b46092bdd0/serial-console?from_start=0&max_bytes=10485760&project=proj-76656375e39
4712024-12-14T01:15:13.906ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = 84c66950-dc33-4c87-9949-e300f38cbcfa roles = RoleSet { roles: {} } uri = /v1/instances/instance-9b46092bdd0/serial-console?from_start=0&max_bytes=10485760&project=proj-76656375e39
4722024-12-14T01:15:13.907ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = 84c66950-dc33-4c87-9949-e300f38cbcfa resource = Database result = Ok(()) uri = /v1/instances/instance-9b46092bdd0/serial-console?from_start=0&max_bytes=10485760&project=proj-76656375e39
4732024-12-14T01:15:13.909ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = 84c66950-dc33-4c87-9949-e300f38cbcfa roles = RoleSet { roles: {(Silo, 2c668072-a9a1-4a69-928c-e118c99521be, "admin")} } uri = /v1/instances/instance-9b46092bdd0/serial-console?from_start=0&max_bytes=10485760&project=proj-76656375e39
4742024-12-14T01:15:13.912ZDEBGnexus (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = 84c66950-dc33-4c87-9949-e300f38cbcfa resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 2c668072-a9a1-4a69-928c-e118c99521be, lookup_type: ById(2c668072-a9a1-4a69-928c-e118c99521be) }, key: 776ccd20-a853-4c93-af22-41ffed980f3e, lookup_type: ByName("proj-76656375e39") }, key: d008f4b2-6063-424c-a333-d54d35c8c058, lookup_type: ByName("instance-9b46092bdd0") } result = Ok(()) uri = /v1/instances/instance-9b46092bdd0/serial-console?from_start=0&max_bytes=10485760&project=proj-76656375e39
4752024-12-14T01:15:13.912ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = 84c66950-dc33-4c87-9949-e300f38cbcfa roles = RoleSet { roles: {} } uri = /v1/instances/instance-9b46092bdd0/serial-console?from_start=0&max_bytes=10485760&project=proj-76656375e39
4762024-12-14T01:15:13.912ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = 84c66950-dc33-4c87-9949-e300f38cbcfa resource = Database result = Ok(()) uri = /v1/instances/instance-9b46092bdd0/serial-console?from_start=0&max_bytes=10485760&project=proj-76656375e39
4772024-12-14T01:15:13.914ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = 84c66950-dc33-4c87-9949-e300f38cbcfa roles = RoleSet { roles: {} } uri = /v1/instances/instance-9b46092bdd0/serial-console?from_start=0&max_bytes=10485760&project=proj-76656375e39
4782024-12-14T01:15:13.914ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = 84c66950-dc33-4c87-9949-e300f38cbcfa resource = Database result = Ok(()) uri = /v1/instances/instance-9b46092bdd0/serial-console?from_start=0&max_bytes=10485760&project=proj-76656375e39
4792024-12-14T01:15:13.917ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = 84c66950-dc33-4c87-9949-e300f38cbcfa roles = RoleSet { roles: {} } uri = /v1/instances/instance-9b46092bdd0/serial-console?from_start=0&max_bytes=10485760&project=proj-76656375e39
4802024-12-14T01:15:13.917ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = 84c66950-dc33-4c87-9949-e300f38cbcfa resource = Database result = Ok(()) uri = /v1/instances/instance-9b46092bdd0/serial-console?from_start=0&max_bytes=10485760&project=proj-76656375e39
4812024-12-14T01:15:13.919ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = 84c66950-dc33-4c87-9949-e300f38cbcfa roles = RoleSet { roles: {} } uri = /v1/instances/instance-9b46092bdd0/serial-console?from_start=0&max_bytes=10485760&project=proj-76656375e39
4822024-12-14T01:15:13.919ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = 84c66950-dc33-4c87-9949-e300f38cbcfa resource = Database result = Ok(()) uri = /v1/instances/instance-9b46092bdd0/serial-console?from_start=0&max_bytes=10485760&project=proj-76656375e39
4832024-12-14T01:15:13.921ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = 84c66950-dc33-4c87-9949-e300f38cbcfa roles = RoleSet { roles: {(Silo, 2c668072-a9a1-4a69-928c-e118c99521be, "admin")} } uri = /v1/instances/instance-9b46092bdd0/serial-console?from_start=0&max_bytes=10485760&project=proj-76656375e39
4842024-12-14T01:15:13.924ZDEBGnexus (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = 84c66950-dc33-4c87-9949-e300f38cbcfa resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 2c668072-a9a1-4a69-928c-e118c99521be, lookup_type: ById(2c668072-a9a1-4a69-928c-e118c99521be) }, key: 776ccd20-a853-4c93-af22-41ffed980f3e, lookup_type: ByName("proj-76656375e39") }, key: d008f4b2-6063-424c-a333-d54d35c8c058, lookup_type: ByName("instance-9b46092bdd0") } result = Ok(()) uri = /v1/instances/instance-9b46092bdd0/serial-console?from_start=0&max_bytes=10485760&project=proj-76656375e39
4852024-12-14T01:15:13.924ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = 84c66950-dc33-4c87-9949-e300f38cbcfa roles = RoleSet { roles: {} } uri = /v1/instances/instance-9b46092bdd0/serial-console?from_start=0&max_bytes=10485760&project=proj-76656375e39
4862024-12-14T01:15:13.924ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = 84c66950-dc33-4c87-9949-e300f38cbcfa resource = Database result = Ok(()) uri = /v1/instances/instance-9b46092bdd0/serial-console?from_start=0&max_bytes=10485760&project=proj-76656375e39
4872024-12-14T01:15:13.960ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92931 local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = 84c66950-dc33-4c87-9949-e300f38cbcfa response_code = 200 uri = /v1/instances/instance-9b46092bdd0/serial-console?from_start=0&max_bytes=10485760&project=proj-76656375e39
4882024-12-14T01:15:14.581ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
4892024-12-14T01:15:14.582ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
4902024-12-14T01:15:14.584ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
4912024-12-14T01:15:14.584ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
4922024-12-14T01:15:14.586ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
4932024-12-14T01:15:14.587ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "4c27b5375e7db4012b4e50525f017d0aef13b0d1", lookup_type: ByCompositeId("token = \\"4c27b5375e7db4012b4e50525f017d0aef13b0d1\\"") } result = Ok(())
4942024-12-14T01:15:14.587ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
4952024-12-14T01:15:14.587ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
4962024-12-14T01:15:14.589ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
4972024-12-14T01:15:14.589ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
4982024-12-14T01:15:14.590ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
4992024-12-14T01:15:14.590ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
5002024-12-14T01:15:14.592ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
5012024-12-14T01:15:14.592ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
5022024-12-14T01:15:14.594ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
5032024-12-14T01:15:14.595ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 2c668072-a9a1-4a69-928c-e118c99521be, lookup_type: ById(2c668072-a9a1-4a69-928c-e118c99521be) }, key: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, lookup_type: ById(2896dd1a-5f1e-476b-86bb-db6c90fa385e) } result = Ok(())
5042024-12-14T01:15:14.595ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
5052024-12-14T01:15:14.595ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
5062024-12-14T01:15:14.597ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
5072024-12-14T01:15:14.598ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "4c27b5375e7db4012b4e50525f017d0aef13b0d1", lookup_type: ByCompositeId("4c27b5375e7db4012b4e50525f017d0aef13b0d1") } result = Ok(())
5082024-12-14T01:15:14.598ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
5092024-12-14T01:15:14.598ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
5102024-12-14T01:15:14.623ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
5112024-12-14T01:15:14.623ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
5122024-12-14T01:15:14.625ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
5132024-12-14T01:15:14.626ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
5142024-12-14T01:15:14.628ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
5152024-12-14T01:15:14.628ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
5162024-12-14T01:15:14.629ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
5172024-12-14T01:15:14.630ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
5182024-12-14T01:15:14.631ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
5192024-12-14T01:15:14.632ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 2c668072-a9a1-4a69-928c-e118c99521be, lookup_type: ById(2c668072-a9a1-4a69-928c-e118c99521be) }, key: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, lookup_type: ById(2896dd1a-5f1e-476b-86bb-db6c90fa385e) } result = Ok(())
5202024-12-14T01:15:14.632ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
5212024-12-14T01:15:14.633ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
5222024-12-14T01:15:14.634ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
5232024-12-14T01:15:14.634ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
5242024-12-14T01:15:14.636ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
5252024-12-14T01:15:14.636ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
5262024-12-14T01:15:14.637ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
5272024-12-14T01:15:14.639ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 2c668072-a9a1-4a69-928c-e118c99521be, lookup_type: ById(2c668072-a9a1-4a69-928c-e118c99521be) } result = Ok(())
5282024-12-14T01:15:14.639ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = aa0afd51-3e1e-4ab7-b93c-1082f814d471 roles = RoleSet { roles: {} } uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
5292024-12-14T01:15:14.639ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = aa0afd51-3e1e-4ab7-b93c-1082f814d471 resource = Database result = Ok(()) uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
5302024-12-14T01:15:14.641ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = aa0afd51-3e1e-4ab7-b93c-1082f814d471 roles = RoleSet { roles: {} } uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
5312024-12-14T01:15:14.641ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = aa0afd51-3e1e-4ab7-b93c-1082f814d471 resource = Database result = Ok(()) uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
5322024-12-14T01:15:14.642ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = aa0afd51-3e1e-4ab7-b93c-1082f814d471 roles = RoleSet { roles: {} } uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
5332024-12-14T01:15:14.643ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = aa0afd51-3e1e-4ab7-b93c-1082f814d471 resource = Database result = Ok(()) uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
5342024-12-14T01:15:14.646ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = aa0afd51-3e1e-4ab7-b93c-1082f814d471 roles = RoleSet { roles: {} } uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
5352024-12-14T01:15:14.646ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = aa0afd51-3e1e-4ab7-b93c-1082f814d471 resource = Database result = Ok(()) uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
5362024-12-14T01:15:14.649ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = aa0afd51-3e1e-4ab7-b93c-1082f814d471 roles = RoleSet { roles: {} } uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
5372024-12-14T01:15:14.649ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = aa0afd51-3e1e-4ab7-b93c-1082f814d471 resource = Database result = Ok(()) uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
5382024-12-14T01:15:14.651ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = aa0afd51-3e1e-4ab7-b93c-1082f814d471 roles = RoleSet { roles: {} } uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
5392024-12-14T01:15:14.651ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = aa0afd51-3e1e-4ab7-b93c-1082f814d471 resource = Database result = Ok(()) uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
5402024-12-14T01:15:14.653ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = aa0afd51-3e1e-4ab7-b93c-1082f814d471 roles = RoleSet { roles: {} } uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
5412024-12-14T01:15:14.654ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = aa0afd51-3e1e-4ab7-b93c-1082f814d471 resource = Database result = Ok(()) uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
5422024-12-14T01:15:14.656ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = aa0afd51-3e1e-4ab7-b93c-1082f814d471 roles = RoleSet { roles: {(Silo, 2c668072-a9a1-4a69-928c-e118c99521be, "admin")} } uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
5432024-12-14T01:15:14.659ZDEBGnexus (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = aa0afd51-3e1e-4ab7-b93c-1082f814d471 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 2c668072-a9a1-4a69-928c-e118c99521be, lookup_type: ById(2c668072-a9a1-4a69-928c-e118c99521be) }, key: 776ccd20-a853-4c93-af22-41ffed980f3e, lookup_type: ByName("proj-76656375e39") }, key: d008f4b2-6063-424c-a333-d54d35c8c058, lookup_type: ByName("instance-9b46092bdd0") } result = Ok(()) uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
5442024-12-14T01:15:14.659ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = aa0afd51-3e1e-4ab7-b93c-1082f814d471 roles = RoleSet { roles: {} } uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
5452024-12-14T01:15:14.659ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = aa0afd51-3e1e-4ab7-b93c-1082f814d471 resource = Database result = Ok(()) uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
5462024-12-14T01:15:14.661ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = aa0afd51-3e1e-4ab7-b93c-1082f814d471 roles = RoleSet { roles: {} } uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
5472024-12-14T01:15:14.661ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = aa0afd51-3e1e-4ab7-b93c-1082f814d471 resource = Database result = Ok(()) uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
5482024-12-14T01:15:14.663ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = aa0afd51-3e1e-4ab7-b93c-1082f814d471 roles = RoleSet { roles: {} } uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
5492024-12-14T01:15:14.664ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = aa0afd51-3e1e-4ab7-b93c-1082f814d471 resource = Database result = Ok(()) uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
5502024-12-14T01:15:14.666ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = aa0afd51-3e1e-4ab7-b93c-1082f814d471 roles = RoleSet { roles: {} } uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
5512024-12-14T01:15:14.666ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = aa0afd51-3e1e-4ab7-b93c-1082f814d471 resource = Database result = Ok(()) uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
5522024-12-14T01:15:14.668ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = aa0afd51-3e1e-4ab7-b93c-1082f814d471 roles = RoleSet { roles: {(Silo, 2c668072-a9a1-4a69-928c-e118c99521be, "admin")} } uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
5532024-12-14T01:15:14.671ZDEBGnexus (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = aa0afd51-3e1e-4ab7-b93c-1082f814d471 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 2c668072-a9a1-4a69-928c-e118c99521be, lookup_type: ById(2c668072-a9a1-4a69-928c-e118c99521be) }, key: 776ccd20-a853-4c93-af22-41ffed980f3e, lookup_type: ByName("proj-76656375e39") }, key: d008f4b2-6063-424c-a333-d54d35c8c058, lookup_type: ByName("instance-9b46092bdd0") } result = Ok(()) uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
5542024-12-14T01:15:14.671ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = aa0afd51-3e1e-4ab7-b93c-1082f814d471 roles = RoleSet { roles: {} } uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
5552024-12-14T01:15:14.671ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = aa0afd51-3e1e-4ab7-b93c-1082f814d471 resource = Database result = Ok(()) uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
5562024-12-14T01:15:14.675ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93212 local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = aa0afd51-3e1e-4ab7-b93c-1082f814d471 response_code = 200 uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
5572024-12-14T01:15:14.676ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
5582024-12-14T01:15:14.676ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
5592024-12-14T01:15:14.677ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
5602024-12-14T01:15:14.677ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
5612024-12-14T01:15:14.679ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
5622024-12-14T01:15:14.680ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "4c27b5375e7db4012b4e50525f017d0aef13b0d1", lookup_type: ByCompositeId("token = \\"4c27b5375e7db4012b4e50525f017d0aef13b0d1\\"") } result = Ok(())
5632024-12-14T01:15:14.680ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
5642024-12-14T01:15:14.680ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
5652024-12-14T01:15:14.681ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
5662024-12-14T01:15:14.682ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
5672024-12-14T01:15:14.683ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
5682024-12-14T01:15:14.683ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
5692024-12-14T01:15:14.684ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
5702024-12-14T01:15:14.684ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
5712024-12-14T01:15:14.685ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
5722024-12-14T01:15:14.687ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 2c668072-a9a1-4a69-928c-e118c99521be, lookup_type: ById(2c668072-a9a1-4a69-928c-e118c99521be) }, key: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, lookup_type: ById(2896dd1a-5f1e-476b-86bb-db6c90fa385e) } result = Ok(())
5732024-12-14T01:15:14.687ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
5742024-12-14T01:15:14.687ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
5752024-12-14T01:15:14.688ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
5762024-12-14T01:15:14.689ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "4c27b5375e7db4012b4e50525f017d0aef13b0d1", lookup_type: ByCompositeId("4c27b5375e7db4012b4e50525f017d0aef13b0d1") } result = Ok(())
5772024-12-14T01:15:14.689ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
5782024-12-14T01:15:14.689ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
5792024-12-14T01:15:14.694ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
5802024-12-14T01:15:14.694ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
5812024-12-14T01:15:14.696ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
5822024-12-14T01:15:14.696ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
5832024-12-14T01:15:14.697ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
5842024-12-14T01:15:14.697ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
5852024-12-14T01:15:14.698ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
5862024-12-14T01:15:14.698ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
5872024-12-14T01:15:14.699ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
5882024-12-14T01:15:14.701ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 2c668072-a9a1-4a69-928c-e118c99521be, lookup_type: ById(2c668072-a9a1-4a69-928c-e118c99521be) }, key: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, lookup_type: ById(2896dd1a-5f1e-476b-86bb-db6c90fa385e) } result = Ok(())
5892024-12-14T01:15:14.701ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
5902024-12-14T01:15:14.701ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
5912024-12-14T01:15:14.702ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
5922024-12-14T01:15:14.702ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
5932024-12-14T01:15:14.703ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
5942024-12-14T01:15:14.704ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
5952024-12-14T01:15:14.705ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
5962024-12-14T01:15:14.706ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 2c668072-a9a1-4a69-928c-e118c99521be, lookup_type: ById(2c668072-a9a1-4a69-928c-e118c99521be) } result = Ok(())
5972024-12-14T01:15:14.706ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = a929e827-36e5-4edf-8aff-e024894d037d roles = RoleSet { roles: {} } uri = /v1/instances/instance-9b46092bdd0/serial-console?max_bytes=1048576&most_recent=1048576&project=proj-76656375e39
5982024-12-14T01:15:14.706ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = a929e827-36e5-4edf-8aff-e024894d037d resource = Database result = Ok(()) uri = /v1/instances/instance-9b46092bdd0/serial-console?max_bytes=1048576&most_recent=1048576&project=proj-76656375e39
5992024-12-14T01:15:14.707ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = a929e827-36e5-4edf-8aff-e024894d037d roles = RoleSet { roles: {} } uri = /v1/instances/instance-9b46092bdd0/serial-console?max_bytes=1048576&most_recent=1048576&project=proj-76656375e39
6002024-12-14T01:15:14.708ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = a929e827-36e5-4edf-8aff-e024894d037d resource = Database result = Ok(()) uri = /v1/instances/instance-9b46092bdd0/serial-console?max_bytes=1048576&most_recent=1048576&project=proj-76656375e39
6012024-12-14T01:15:14.709ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = a929e827-36e5-4edf-8aff-e024894d037d roles = RoleSet { roles: {} } uri = /v1/instances/instance-9b46092bdd0/serial-console?max_bytes=1048576&most_recent=1048576&project=proj-76656375e39
6022024-12-14T01:15:14.709ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = a929e827-36e5-4edf-8aff-e024894d037d resource = Database result = Ok(()) uri = /v1/instances/instance-9b46092bdd0/serial-console?max_bytes=1048576&most_recent=1048576&project=proj-76656375e39
6032024-12-14T01:15:14.711ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = a929e827-36e5-4edf-8aff-e024894d037d roles = RoleSet { roles: {} } uri = /v1/instances/instance-9b46092bdd0/serial-console?max_bytes=1048576&most_recent=1048576&project=proj-76656375e39
6042024-12-14T01:15:14.711ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = a929e827-36e5-4edf-8aff-e024894d037d resource = Database result = Ok(()) uri = /v1/instances/instance-9b46092bdd0/serial-console?max_bytes=1048576&most_recent=1048576&project=proj-76656375e39
6052024-12-14T01:15:14.713ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = a929e827-36e5-4edf-8aff-e024894d037d roles = RoleSet { roles: {} } uri = /v1/instances/instance-9b46092bdd0/serial-console?max_bytes=1048576&most_recent=1048576&project=proj-76656375e39
6062024-12-14T01:15:14.713ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = a929e827-36e5-4edf-8aff-e024894d037d resource = Database result = Ok(()) uri = /v1/instances/instance-9b46092bdd0/serial-console?max_bytes=1048576&most_recent=1048576&project=proj-76656375e39
6072024-12-14T01:15:14.715ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = a929e827-36e5-4edf-8aff-e024894d037d roles = RoleSet { roles: {} } uri = /v1/instances/instance-9b46092bdd0/serial-console?max_bytes=1048576&most_recent=1048576&project=proj-76656375e39
6082024-12-14T01:15:14.715ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = a929e827-36e5-4edf-8aff-e024894d037d resource = Database result = Ok(()) uri = /v1/instances/instance-9b46092bdd0/serial-console?max_bytes=1048576&most_recent=1048576&project=proj-76656375e39
6092024-12-14T01:15:14.717ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = a929e827-36e5-4edf-8aff-e024894d037d roles = RoleSet { roles: {} } uri = /v1/instances/instance-9b46092bdd0/serial-console?max_bytes=1048576&most_recent=1048576&project=proj-76656375e39
6102024-12-14T01:15:14.717ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = a929e827-36e5-4edf-8aff-e024894d037d resource = Database result = Ok(()) uri = /v1/instances/instance-9b46092bdd0/serial-console?max_bytes=1048576&most_recent=1048576&project=proj-76656375e39
6112024-12-14T01:15:14.719ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = a929e827-36e5-4edf-8aff-e024894d037d roles = RoleSet { roles: {(Silo, 2c668072-a9a1-4a69-928c-e118c99521be, "admin")} } uri = /v1/instances/instance-9b46092bdd0/serial-console?max_bytes=1048576&most_recent=1048576&project=proj-76656375e39
6122024-12-14T01:15:14.722ZDEBGnexus (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = a929e827-36e5-4edf-8aff-e024894d037d resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 2c668072-a9a1-4a69-928c-e118c99521be, lookup_type: ById(2c668072-a9a1-4a69-928c-e118c99521be) }, key: 776ccd20-a853-4c93-af22-41ffed980f3e, lookup_type: ByName("proj-76656375e39") }, key: d008f4b2-6063-424c-a333-d54d35c8c058, lookup_type: ByName("instance-9b46092bdd0") } result = Ok(()) uri = /v1/instances/instance-9b46092bdd0/serial-console?max_bytes=1048576&most_recent=1048576&project=proj-76656375e39
6132024-12-14T01:15:14.722ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = a929e827-36e5-4edf-8aff-e024894d037d roles = RoleSet { roles: {} } uri = /v1/instances/instance-9b46092bdd0/serial-console?max_bytes=1048576&most_recent=1048576&project=proj-76656375e39
6142024-12-14T01:15:14.723ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = a929e827-36e5-4edf-8aff-e024894d037d resource = Database result = Ok(()) uri = /v1/instances/instance-9b46092bdd0/serial-console?max_bytes=1048576&most_recent=1048576&project=proj-76656375e39
6152024-12-14T01:15:14.725ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = a929e827-36e5-4edf-8aff-e024894d037d roles = RoleSet { roles: {} } uri = /v1/instances/instance-9b46092bdd0/serial-console?max_bytes=1048576&most_recent=1048576&project=proj-76656375e39
6162024-12-14T01:15:14.725ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = a929e827-36e5-4edf-8aff-e024894d037d resource = Database result = Ok(()) uri = /v1/instances/instance-9b46092bdd0/serial-console?max_bytes=1048576&most_recent=1048576&project=proj-76656375e39
6172024-12-14T01:15:14.727ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = a929e827-36e5-4edf-8aff-e024894d037d roles = RoleSet { roles: {} } uri = /v1/instances/instance-9b46092bdd0/serial-console?max_bytes=1048576&most_recent=1048576&project=proj-76656375e39
6182024-12-14T01:15:14.727ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = a929e827-36e5-4edf-8aff-e024894d037d resource = Database result = Ok(()) uri = /v1/instances/instance-9b46092bdd0/serial-console?max_bytes=1048576&most_recent=1048576&project=proj-76656375e39
6192024-12-14T01:15:14.729ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = a929e827-36e5-4edf-8aff-e024894d037d roles = RoleSet { roles: {} } uri = /v1/instances/instance-9b46092bdd0/serial-console?max_bytes=1048576&most_recent=1048576&project=proj-76656375e39
6202024-12-14T01:15:14.729ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = a929e827-36e5-4edf-8aff-e024894d037d resource = Database result = Ok(()) uri = /v1/instances/instance-9b46092bdd0/serial-console?max_bytes=1048576&most_recent=1048576&project=proj-76656375e39
6212024-12-14T01:15:14.731ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = a929e827-36e5-4edf-8aff-e024894d037d roles = RoleSet { roles: {(Silo, 2c668072-a9a1-4a69-928c-e118c99521be, "admin")} } uri = /v1/instances/instance-9b46092bdd0/serial-console?max_bytes=1048576&most_recent=1048576&project=proj-76656375e39
6222024-12-14T01:15:14.734ZDEBGnexus (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = a929e827-36e5-4edf-8aff-e024894d037d resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 2c668072-a9a1-4a69-928c-e118c99521be, lookup_type: ById(2c668072-a9a1-4a69-928c-e118c99521be) }, key: 776ccd20-a853-4c93-af22-41ffed980f3e, lookup_type: ByName("proj-76656375e39") }, key: d008f4b2-6063-424c-a333-d54d35c8c058, lookup_type: ByName("instance-9b46092bdd0") } result = Ok(()) uri = /v1/instances/instance-9b46092bdd0/serial-console?max_bytes=1048576&most_recent=1048576&project=proj-76656375e39
6232024-12-14T01:15:14.734ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = a929e827-36e5-4edf-8aff-e024894d037d roles = RoleSet { roles: {} } uri = /v1/instances/instance-9b46092bdd0/serial-console?max_bytes=1048576&most_recent=1048576&project=proj-76656375e39
6242024-12-14T01:15:14.734ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = a929e827-36e5-4edf-8aff-e024894d037d resource = Database result = Ok(()) uri = /v1/instances/instance-9b46092bdd0/serial-console?max_bytes=1048576&most_recent=1048576&project=proj-76656375e39
6252024-12-14T01:15:14.778ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101937 local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:38889 req_id = a929e827-36e5-4edf-8aff-e024894d037d response_code = 200 uri = /v1/instances/instance-9b46092bdd0/serial-console?max_bytes=1048576&most_recent=1048576&project=proj-76656375e39
6262024-12-14T01:15:15.695ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
6272024-12-14T01:15:15.696ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
6282024-12-14T01:15:15.697ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
6292024-12-14T01:15:15.697ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
6302024-12-14T01:15:15.699ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
6312024-12-14T01:15:15.700ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "4c27b5375e7db4012b4e50525f017d0aef13b0d1", lookup_type: ByCompositeId("token = \\"4c27b5375e7db4012b4e50525f017d0aef13b0d1\\"") } result = Ok(())
6322024-12-14T01:15:15.700ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
6332024-12-14T01:15:15.701ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
6342024-12-14T01:15:15.702ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
6352024-12-14T01:15:15.702ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
6362024-12-14T01:15:15.704ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
6372024-12-14T01:15:15.704ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
6382024-12-14T01:15:15.706ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
6392024-12-14T01:15:15.706ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
6402024-12-14T01:15:15.707ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
6412024-12-14T01:15:15.709ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 2c668072-a9a1-4a69-928c-e118c99521be, lookup_type: ById(2c668072-a9a1-4a69-928c-e118c99521be) }, key: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, lookup_type: ById(2896dd1a-5f1e-476b-86bb-db6c90fa385e) } result = Ok(())
6422024-12-14T01:15:15.709ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
6432024-12-14T01:15:15.709ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
6442024-12-14T01:15:15.710ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
6452024-12-14T01:15:15.711ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "4c27b5375e7db4012b4e50525f017d0aef13b0d1", lookup_type: ByCompositeId("4c27b5375e7db4012b4e50525f017d0aef13b0d1") } result = Ok(())
6462024-12-14T01:15:15.711ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
6472024-12-14T01:15:15.711ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
6482024-12-14T01:15:15.718ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
6492024-12-14T01:15:15.718ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
6502024-12-14T01:15:15.719ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
6512024-12-14T01:15:15.719ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
6522024-12-14T01:15:15.721ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
6532024-12-14T01:15:15.721ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
6542024-12-14T01:15:15.722ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
6552024-12-14T01:15:15.722ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
6562024-12-14T01:15:15.724ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
6572024-12-14T01:15:15.725ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 2c668072-a9a1-4a69-928c-e118c99521be, lookup_type: ById(2c668072-a9a1-4a69-928c-e118c99521be) }, key: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, lookup_type: ById(2896dd1a-5f1e-476b-86bb-db6c90fa385e) } result = Ok(())
6582024-12-14T01:15:15.725ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
6592024-12-14T01:15:15.725ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
6602024-12-14T01:15:15.727ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
6612024-12-14T01:15:15.727ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
6622024-12-14T01:15:15.728ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
6632024-12-14T01:15:15.728ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
6642024-12-14T01:15:15.729ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
6652024-12-14T01:15:15.731ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 2c668072-a9a1-4a69-928c-e118c99521be, lookup_type: ById(2c668072-a9a1-4a69-928c-e118c99521be) } result = Ok(())
6662024-12-14T01:15:15.731ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.1.100:38889 req_id = 5b867bed-080c-416e-b8d7-1dcad91fc3a7 roles = RoleSet { roles: {} } uri = /v1/instances/instance-9b46092bdd0/stop?project=proj-76656375e39
6672024-12-14T01:15:15.731ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.1.100:38889 req_id = 5b867bed-080c-416e-b8d7-1dcad91fc3a7 resource = Database result = Ok(()) uri = /v1/instances/instance-9b46092bdd0/stop?project=proj-76656375e39
6682024-12-14T01:15:15.732ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.1.100:38889 req_id = 5b867bed-080c-416e-b8d7-1dcad91fc3a7 roles = RoleSet { roles: {} } uri = /v1/instances/instance-9b46092bdd0/stop?project=proj-76656375e39
6692024-12-14T01:15:15.732ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.1.100:38889 req_id = 5b867bed-080c-416e-b8d7-1dcad91fc3a7 resource = Database result = Ok(()) uri = /v1/instances/instance-9b46092bdd0/stop?project=proj-76656375e39
6702024-12-14T01:15:15.734ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.1.100:38889 req_id = 5b867bed-080c-416e-b8d7-1dcad91fc3a7 roles = RoleSet { roles: {} } uri = /v1/instances/instance-9b46092bdd0/stop?project=proj-76656375e39
6712024-12-14T01:15:15.734ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.1.100:38889 req_id = 5b867bed-080c-416e-b8d7-1dcad91fc3a7 resource = Database result = Ok(()) uri = /v1/instances/instance-9b46092bdd0/stop?project=proj-76656375e39
6722024-12-14T01:15:15.736ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.1.100:38889 req_id = 5b867bed-080c-416e-b8d7-1dcad91fc3a7 roles = RoleSet { roles: {} } uri = /v1/instances/instance-9b46092bdd0/stop?project=proj-76656375e39
6732024-12-14T01:15:15.736ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.1.100:38889 req_id = 5b867bed-080c-416e-b8d7-1dcad91fc3a7 resource = Database result = Ok(()) uri = /v1/instances/instance-9b46092bdd0/stop?project=proj-76656375e39
6742024-12-14T01:15:15.738ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.1.100:38889 req_id = 5b867bed-080c-416e-b8d7-1dcad91fc3a7 roles = RoleSet { roles: {} } uri = /v1/instances/instance-9b46092bdd0/stop?project=proj-76656375e39
6752024-12-14T01:15:15.738ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.1.100:38889 req_id = 5b867bed-080c-416e-b8d7-1dcad91fc3a7 resource = Database result = Ok(()) uri = /v1/instances/instance-9b46092bdd0/stop?project=proj-76656375e39
6762024-12-14T01:15:15.740ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.1.100:38889 req_id = 5b867bed-080c-416e-b8d7-1dcad91fc3a7 roles = RoleSet { roles: {} } uri = /v1/instances/instance-9b46092bdd0/stop?project=proj-76656375e39
6772024-12-14T01:15:15.740ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.1.100:38889 req_id = 5b867bed-080c-416e-b8d7-1dcad91fc3a7 resource = Database result = Ok(()) uri = /v1/instances/instance-9b46092bdd0/stop?project=proj-76656375e39
6782024-12-14T01:15:15.743ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.1.100:38889 req_id = 5b867bed-080c-416e-b8d7-1dcad91fc3a7 roles = RoleSet { roles: {} } uri = /v1/instances/instance-9b46092bdd0/stop?project=proj-76656375e39
6792024-12-14T01:15:15.743ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.1.100:38889 req_id = 5b867bed-080c-416e-b8d7-1dcad91fc3a7 resource = Database result = Ok(()) uri = /v1/instances/instance-9b46092bdd0/stop?project=proj-76656375e39
6802024-12-14T01:15:15.745ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.1.100:38889 req_id = 5b867bed-080c-416e-b8d7-1dcad91fc3a7 roles = RoleSet { roles: {(Silo, 2c668072-a9a1-4a69-928c-e118c99521be, "admin")} } uri = /v1/instances/instance-9b46092bdd0/stop?project=proj-76656375e39
6812024-12-14T01:15:15.748ZDEBGnexus (dropshot_external): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.1.100:38889 req_id = 5b867bed-080c-416e-b8d7-1dcad91fc3a7 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 2c668072-a9a1-4a69-928c-e118c99521be, lookup_type: ById(2c668072-a9a1-4a69-928c-e118c99521be) }, key: 776ccd20-a853-4c93-af22-41ffed980f3e, lookup_type: ByName("proj-76656375e39") }, key: d008f4b2-6063-424c-a333-d54d35c8c058, lookup_type: ByName("instance-9b46092bdd0") } result = Ok(()) uri = /v1/instances/instance-9b46092bdd0/stop?project=proj-76656375e39
6822024-12-14T01:15:15.748ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.1.100:38889 req_id = 5b867bed-080c-416e-b8d7-1dcad91fc3a7 roles = RoleSet { roles: {} } uri = /v1/instances/instance-9b46092bdd0/stop?project=proj-76656375e39
6832024-12-14T01:15:15.748ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.1.100:38889 req_id = 5b867bed-080c-416e-b8d7-1dcad91fc3a7 resource = Database result = Ok(()) uri = /v1/instances/instance-9b46092bdd0/stop?project=proj-76656375e39
6842024-12-14T01:15:15.751ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.1.100:38889 req_id = 5b867bed-080c-416e-b8d7-1dcad91fc3a7 roles = RoleSet { roles: {} } uri = /v1/instances/instance-9b46092bdd0/stop?project=proj-76656375e39
6852024-12-14T01:15:15.751ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.1.100:38889 req_id = 5b867bed-080c-416e-b8d7-1dcad91fc3a7 resource = Database result = Ok(()) uri = /v1/instances/instance-9b46092bdd0/stop?project=proj-76656375e39
6862024-12-14T01:15:15.753ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.1.100:38889 req_id = 5b867bed-080c-416e-b8d7-1dcad91fc3a7 roles = RoleSet { roles: {} } uri = /v1/instances/instance-9b46092bdd0/stop?project=proj-76656375e39
6872024-12-14T01:15:15.753ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.1.100:38889 req_id = 5b867bed-080c-416e-b8d7-1dcad91fc3a7 resource = Database result = Ok(()) uri = /v1/instances/instance-9b46092bdd0/stop?project=proj-76656375e39
6882024-12-14T01:15:15.755ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.1.100:38889 req_id = 5b867bed-080c-416e-b8d7-1dcad91fc3a7 roles = RoleSet { roles: {} } uri = /v1/instances/instance-9b46092bdd0/stop?project=proj-76656375e39
6892024-12-14T01:15:15.755ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.1.100:38889 req_id = 5b867bed-080c-416e-b8d7-1dcad91fc3a7 resource = Database result = Ok(()) uri = /v1/instances/instance-9b46092bdd0/stop?project=proj-76656375e39
6902024-12-14T01:15:15.760ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.1.100:38889 req_id = 5b867bed-080c-416e-b8d7-1dcad91fc3a7 roles = RoleSet { roles: {(Silo, 2c668072-a9a1-4a69-928c-e118c99521be, "admin")} } uri = /v1/instances/instance-9b46092bdd0/stop?project=proj-76656375e39
6912024-12-14T01:15:15.764ZDEBGnexus (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.1.100:38889 req_id = 5b867bed-080c-416e-b8d7-1dcad91fc3a7 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 2c668072-a9a1-4a69-928c-e118c99521be, lookup_type: ById(2c668072-a9a1-4a69-928c-e118c99521be) }, key: 776ccd20-a853-4c93-af22-41ffed980f3e, lookup_type: ByName("proj-76656375e39") }, key: d008f4b2-6063-424c-a333-d54d35c8c058, lookup_type: ByName("instance-9b46092bdd0") } result = Ok(()) uri = /v1/instances/instance-9b46092bdd0/stop?project=proj-76656375e39
6922024-12-14T01:15:15.764ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.1.100:38889 req_id = 5b867bed-080c-416e-b8d7-1dcad91fc3a7 roles = RoleSet { roles: {} } uri = /v1/instances/instance-9b46092bdd0/stop?project=proj-76656375e39
6932024-12-14T01:15:15.764ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.1.100:38889 req_id = 5b867bed-080c-416e-b8d7-1dcad91fc3a7 resource = Database result = Ok(()) uri = /v1/instances/instance-9b46092bdd0/stop?project=proj-76656375e39
6942024-12-14T01:15:15.766ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
6952024-12-14T01:15:15.766ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
6962024-12-14T01:15:15.768ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
6972024-12-14T01:15:15.768ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
6982024-12-14T01:15:15.769ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
6992024-12-14T01:15:15.771ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Sled { parent: Fleet, key: 7e423e95-464a-471f-a0d9-4799977f0b0f, lookup_type: ById(7e423e95-464a-471f-a0d9-4799977f0b0f) } result = Ok(())
7002024-12-14T01:15:15.801ZDEBGnexus: client request SledAgent = 7e423e95-464a-471f-a0d9-4799977f0b0f body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vmms/b2d035ea-f96d-499b-a259-358e56f0523e/state
7012024-12-14T01:15:15.802ZDEBGnexus: client response SledAgent = 7e423e95-464a-471f-a0d9-4799977f0b0f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vmms/b2d035ea-f96d-499b-a259-358e56f0523e/state", status: 200, headers: {"content-type": "application/json", "x-request-id": "847de00d-e44d-4a35-ad9a-d7b32c1e2a74", "content-length": "151", "date": "Sat, 14 Dec 2024 01:15:15 GMT"} })
7022024-12-14T01:15:15.802ZINFOnexus (dropshot_external): received new VMM runtime state from sled agent actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true file = nexus/src/app/instance.rs:2116 local_addr = 172.30.2.5:443 method = POST migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = b2d035ea-f96d-499b-a259-358e56f0523e remote_addr = 10.151.1.100:38889 req_id = 5b867bed-080c-416e-b8d7-1dcad91fc3a7 uri = /v1/instances/instance-9b46092bdd0/stop?project=proj-76656375e39 vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(5), time_updated: 2024-12-14T01:15:15.802565126Z }
7032024-12-14T01:15:15.802ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.1.100:38889 req_id = 5b867bed-080c-416e-b8d7-1dcad91fc3a7 roles = RoleSet { roles: {} } uri = /v1/instances/instance-9b46092bdd0/stop?project=proj-76656375e39
7042024-12-14T01:15:15.803ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.1.100:38889 req_id = 5b867bed-080c-416e-b8d7-1dcad91fc3a7 resource = Database result = Ok(()) uri = /v1/instances/instance-9b46092bdd0/stop?project=proj-76656375e39
7052024-12-14T01:15:15.815ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.1.100:38889 req_id = 5b867bed-080c-416e-b8d7-1dcad91fc3a7 roles = RoleSet { roles: {} } uri = /v1/instances/instance-9b46092bdd0/stop?project=proj-76656375e39
7062024-12-14T01:15:15.815ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.1.100:38889 req_id = 5b867bed-080c-416e-b8d7-1dcad91fc3a7 resource = Database result = Ok(()) uri = /v1/instances/instance-9b46092bdd0/stop?project=proj-76656375e39
7072024-12-14T01:15:15.818ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.1.100:38889 req_id = 5b867bed-080c-416e-b8d7-1dcad91fc3a7 roles = RoleSet { roles: {} } uri = /v1/instances/instance-9b46092bdd0/stop?project=proj-76656375e39
7082024-12-14T01:15:15.818ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.1.100:38889 req_id = 5b867bed-080c-416e-b8d7-1dcad91fc3a7 resource = Database result = Ok(()) uri = /v1/instances/instance-9b46092bdd0/stop?project=proj-76656375e39
7092024-12-14T01:15:15.821ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.1.100:38889 req_id = 5b867bed-080c-416e-b8d7-1dcad91fc3a7 roles = RoleSet { roles: {} } uri = /v1/instances/instance-9b46092bdd0/stop?project=proj-76656375e39
7102024-12-14T01:15:15.821ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.1.100:38889 req_id = 5b867bed-080c-416e-b8d7-1dcad91fc3a7 resource = Database result = Ok(()) uri = /v1/instances/instance-9b46092bdd0/stop?project=proj-76656375e39
7112024-12-14T01:15:15.824ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.1.100:38889 req_id = 5b867bed-080c-416e-b8d7-1dcad91fc3a7 roles = RoleSet { roles: {} } uri = /v1/instances/instance-9b46092bdd0/stop?project=proj-76656375e39
7122024-12-14T01:15:15.824ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.1.100:38889 req_id = 5b867bed-080c-416e-b8d7-1dcad91fc3a7 resource = Database result = Ok(()) uri = /v1/instances/instance-9b46092bdd0/stop?project=proj-76656375e39
7132024-12-14T01:15:15.826ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.1.100:38889 req_id = 5b867bed-080c-416e-b8d7-1dcad91fc3a7 roles = RoleSet { roles: {(Silo, 2c668072-a9a1-4a69-928c-e118c99521be, "admin")} } uri = /v1/instances/instance-9b46092bdd0/stop?project=proj-76656375e39
7142024-12-14T01:15:15.829ZDEBGnexus (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.1.100:38889 req_id = 5b867bed-080c-416e-b8d7-1dcad91fc3a7 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 2c668072-a9a1-4a69-928c-e118c99521be, lookup_type: ById(2c668072-a9a1-4a69-928c-e118c99521be) }, key: 776ccd20-a853-4c93-af22-41ffed980f3e, lookup_type: ByName("proj-76656375e39") }, key: d008f4b2-6063-424c-a333-d54d35c8c058, lookup_type: ByName("instance-9b46092bdd0") } result = Ok(()) uri = /v1/instances/instance-9b46092bdd0/stop?project=proj-76656375e39
7152024-12-14T01:15:15.829ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.1.100:38889 req_id = 5b867bed-080c-416e-b8d7-1dcad91fc3a7 roles = RoleSet { roles: {} } uri = /v1/instances/instance-9b46092bdd0/stop?project=proj-76656375e39
7162024-12-14T01:15:15.829ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.1.100:38889 req_id = 5b867bed-080c-416e-b8d7-1dcad91fc3a7 resource = Database result = Ok(()) uri = /v1/instances/instance-9b46092bdd0/stop?project=proj-76656375e39
7172024-12-14T01:15:15.832ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 139834 local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.1.100:38889 req_id = 5b867bed-080c-416e-b8d7-1dcad91fc3a7 response_code = 202 uri = /v1/instances/instance-9b46092bdd0/stop?project=proj-76656375e39
7182024-12-14T01:15:15.835ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
7192024-12-14T01:15:15.835ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
7202024-12-14T01:15:15.837ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
7212024-12-14T01:15:15.837ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
7222024-12-14T01:15:15.839ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
7232024-12-14T01:15:15.840ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "4c27b5375e7db4012b4e50525f017d0aef13b0d1", lookup_type: ByCompositeId("token = \\"4c27b5375e7db4012b4e50525f017d0aef13b0d1\\"") } result = Ok(())
7242024-12-14T01:15:15.840ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
7252024-12-14T01:15:15.840ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
7262024-12-14T01:15:15.841ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
7272024-12-14T01:15:15.841ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
7282024-12-14T01:15:15.843ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
7292024-12-14T01:15:15.843ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
7302024-12-14T01:15:15.844ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
7312024-12-14T01:15:15.845ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
7322024-12-14T01:15:15.846ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
7332024-12-14T01:15:15.847ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 2c668072-a9a1-4a69-928c-e118c99521be, lookup_type: ById(2c668072-a9a1-4a69-928c-e118c99521be) }, key: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, lookup_type: ById(2896dd1a-5f1e-476b-86bb-db6c90fa385e) } result = Ok(())
7342024-12-14T01:15:15.847ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
7352024-12-14T01:15:15.847ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
7362024-12-14T01:15:15.849ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
7372024-12-14T01:15:15.850ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "4c27b5375e7db4012b4e50525f017d0aef13b0d1", lookup_type: ByCompositeId("4c27b5375e7db4012b4e50525f017d0aef13b0d1") } result = Ok(())
7382024-12-14T01:15:15.850ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
7392024-12-14T01:15:15.850ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
7402024-12-14T01:15:15.855ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
7412024-12-14T01:15:15.855ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
7422024-12-14T01:15:15.856ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
7432024-12-14T01:15:15.856ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
7442024-12-14T01:15:15.858ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
7452024-12-14T01:15:15.858ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
7462024-12-14T01:15:15.859ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
7472024-12-14T01:15:15.859ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
7482024-12-14T01:15:15.860ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
7492024-12-14T01:15:15.862ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 2c668072-a9a1-4a69-928c-e118c99521be, lookup_type: ById(2c668072-a9a1-4a69-928c-e118c99521be) }, key: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, lookup_type: ById(2896dd1a-5f1e-476b-86bb-db6c90fa385e) } result = Ok(())
7502024-12-14T01:15:15.862ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
7512024-12-14T01:15:15.862ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
7522024-12-14T01:15:15.863ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
7532024-12-14T01:15:15.864ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
7542024-12-14T01:15:15.865ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
7552024-12-14T01:15:15.865ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
7562024-12-14T01:15:15.866ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
7572024-12-14T01:15:15.868ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 2c668072-a9a1-4a69-928c-e118c99521be, lookup_type: ById(2c668072-a9a1-4a69-928c-e118c99521be) } result = Ok(())
7582024-12-14T01:15:15.868ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 59bd140c-e803-44fe-9732-f31171cb5fd6 roles = RoleSet { roles: {} } uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
7592024-12-14T01:15:15.868ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 59bd140c-e803-44fe-9732-f31171cb5fd6 resource = Database result = Ok(()) uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
7602024-12-14T01:15:15.869ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 59bd140c-e803-44fe-9732-f31171cb5fd6 roles = RoleSet { roles: {} } uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
7612024-12-14T01:15:15.869ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 59bd140c-e803-44fe-9732-f31171cb5fd6 resource = Database result = Ok(()) uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
7622024-12-14T01:15:15.871ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 59bd140c-e803-44fe-9732-f31171cb5fd6 roles = RoleSet { roles: {} } uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
7632024-12-14T01:15:15.871ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 59bd140c-e803-44fe-9732-f31171cb5fd6 resource = Database result = Ok(()) uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
7642024-12-14T01:15:15.873ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 59bd140c-e803-44fe-9732-f31171cb5fd6 roles = RoleSet { roles: {} } uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
7652024-12-14T01:15:15.873ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 59bd140c-e803-44fe-9732-f31171cb5fd6 resource = Database result = Ok(()) uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
7662024-12-14T01:15:15.875ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 59bd140c-e803-44fe-9732-f31171cb5fd6 roles = RoleSet { roles: {} } uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
7672024-12-14T01:15:15.875ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 59bd140c-e803-44fe-9732-f31171cb5fd6 resource = Database result = Ok(()) uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
7682024-12-14T01:15:15.877ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 59bd140c-e803-44fe-9732-f31171cb5fd6 roles = RoleSet { roles: {} } uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
7692024-12-14T01:15:15.877ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 59bd140c-e803-44fe-9732-f31171cb5fd6 resource = Database result = Ok(()) uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
7702024-12-14T01:15:15.880ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 59bd140c-e803-44fe-9732-f31171cb5fd6 roles = RoleSet { roles: {} } uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
7712024-12-14T01:15:15.880ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 59bd140c-e803-44fe-9732-f31171cb5fd6 resource = Database result = Ok(()) uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
7722024-12-14T01:15:15.882ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 59bd140c-e803-44fe-9732-f31171cb5fd6 roles = RoleSet { roles: {(Silo, 2c668072-a9a1-4a69-928c-e118c99521be, "admin")} } uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
7732024-12-14T01:15:15.885ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 59bd140c-e803-44fe-9732-f31171cb5fd6 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 2c668072-a9a1-4a69-928c-e118c99521be, lookup_type: ById(2c668072-a9a1-4a69-928c-e118c99521be) }, key: 776ccd20-a853-4c93-af22-41ffed980f3e, lookup_type: ByName("proj-76656375e39") }, key: d008f4b2-6063-424c-a333-d54d35c8c058, lookup_type: ByName("instance-9b46092bdd0") } result = Ok(()) uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
7742024-12-14T01:15:15.885ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
7752024-12-14T01:15:15.885ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
7762024-12-14T01:15:15.886ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
7772024-12-14T01:15:15.887ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Fleet result = Ok(())
7782024-12-14T01:15:15.887ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
7792024-12-14T01:15:15.888ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
7802024-12-14T01:15:15.893ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = d64d18f3-083c-41c4-8e63-0d0d164ec14e saga_name = instance-delete
7812024-12-14T01:15:15.893ZINFOnexus (SEC): saga create dag = {"end_node":5,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[4,0,null],[3,5,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"instance_delete.instance_delete_nat","label":"InstanceDeleteNat","name":"no_result4"}},{"Action":{"action_name":"instance_delete.instance_delete_record","label":"InstanceDeleteRecord","name":"no_result1"}},{"Action":{"action_name":"instance_delete.delete_network_interfaces","label":"DeleteNetworkInterfaces","name":"no_result2"}},{"Action":{"action_name":"instance_delete.deallocate_external_ip","label":"DeallocateExternalIp","name":"no_result3"}},{"Start":{"params":{"authz_instance":{"key":"d008f4b2-6063-424c-a333-d54d35c8c058","lookup_type":{"ByName":"instance-9b46092bdd0"},"parent":{"key":"776ccd20-a853-4c93-af22-41ffed980f3e","lookup_type":{"ByName":"proj-76656375e39"},"parent":{"key":"2c668072-a9a1-4a69-928c-e118c99521be","lookup_type":{"ById":"2c668072-a9a1-4a69-928c-e118c99521be"},"parent":null}}},"boundary_switches":["switch0"],"instance":{"auto_restart":{"cooldown":null,"policy":null},"boot_disk_id":"03cca168-b332-42b3-bd85-e17bd7884c8f","hostname":"localshark","identity":{"description":"","id":"d008f4b2-6063-424c-a333-d54d35c8c058","name":"instance-9b46092bdd0","time_created":"2024-12-14T01:14:55.295559Z","time_deleted":null,"time_modified":"2024-12-14T01:14:55.295559Z"},"memory":1073741824,"ncpus":2,"project_id":"776ccd20-a853-4c93-af22-41ffed980f3e","runtime_state":{"dst_propolis_id":null,"gen":3,"migration_id":null,"nexus_state":"Vmm","propolis_id":"b2d035ea-f96d-499b-a259-358e56f0523e","time_last_auto_restarted":null,"time_updated":"2024-12-14T01:14:55.295559Z"},"updater_gen":1,"updater_id":null,"user_data":[]},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"SiloUser":{"silo_id":"2c668072-a9a1-4a69-928c-e118c99521be","silo_user_id":"2896dd1a-5f1e-476b-86bb-db6c90fa385e"}}},{"mapped_fleet_roles":{"admin":["admin"]}}]}}}}},"End"]},"saga_name":"instance-delete","start_node":4} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = d64d18f3-083c-41c4-8e63-0d0d164ec14e saga_name = instance-delete sec_id = ec66f35d-9dc5-46c1-80a1-ebaa91a8212a
7822024-12-14T01:15:15.893ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = d64d18f3-083c-41c4-8e63-0d0d164ec14e saga_name = instance-delete
7832024-12-14T01:15:15.898ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = d64d18f3-083c-41c4-8e63-0d0d164ec14e saga_name = instance-delete
7842024-12-14T01:15:15.898ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = d64d18f3-083c-41c4-8e63-0d0d164ec14e saga_name = instance-delete sec_id = ec66f35d-9dc5-46c1-80a1-ebaa91a8212a
7852024-12-14T01:15:15.898ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = ec66f35d-9dc5-46c1-80a1-ebaa91a8212a
7862024-12-14T01:15:15.898ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = d64d18f3-083c-41c4-8e63-0d0d164ec14e
7872024-12-14T01:15:15.904ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = ec66f35d-9dc5-46c1-80a1-ebaa91a8212a
7882024-12-14T01:15:15.904ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = d64d18f3-083c-41c4-8e63-0d0d164ec14e
7892024-12-14T01:15:15.908ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = ec66f35d-9dc5-46c1-80a1-ebaa91a8212a
7902024-12-14T01:15:15.908ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = d64d18f3-083c-41c4-8e63-0d0d164ec14e
7912024-12-14T01:15:15.913ZDEBGnexus (SagaExecutor): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true roles = RoleSet { roles: {} } saga_id = d64d18f3-083c-41c4-8e63-0d0d164ec14e saga_name = instance-delete saga_node = InstanceDeleteNat
7922024-12-14T01:15:15.914ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true resource = Database result = Ok(()) saga_id = d64d18f3-083c-41c4-8e63-0d0d164ec14e saga_name = instance-delete saga_node = InstanceDeleteNat
7932024-12-14T01:15:15.915ZDEBGnexus (SagaExecutor): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true roles = RoleSet { roles: {} } saga_id = d64d18f3-083c-41c4-8e63-0d0d164ec14e saga_name = instance-delete saga_node = InstanceDeleteNat
7942024-12-14T01:15:15.915ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true resource = Database result = Ok(()) saga_id = d64d18f3-083c-41c4-8e63-0d0d164ec14e saga_name = instance-delete saga_node = InstanceDeleteNat
7952024-12-14T01:15:15.917ZDEBGnexus (SagaExecutor): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true roles = RoleSet { roles: {} } saga_id = d64d18f3-083c-41c4-8e63-0d0d164ec14e saga_name = instance-delete saga_node = InstanceDeleteNat
7962024-12-14T01:15:15.917ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true resource = Database result = Ok(()) saga_id = d64d18f3-083c-41c4-8e63-0d0d164ec14e saga_name = instance-delete saga_node = InstanceDeleteNat
7972024-12-14T01:15:15.919ZDEBGnexus (SagaExecutor): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true roles = RoleSet { roles: {} } saga_id = d64d18f3-083c-41c4-8e63-0d0d164ec14e saga_name = instance-delete saga_node = InstanceDeleteNat
7982024-12-14T01:15:15.919ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true resource = Database result = Ok(()) saga_id = d64d18f3-083c-41c4-8e63-0d0d164ec14e saga_name = instance-delete saga_node = InstanceDeleteNat
7992024-12-14T01:15:15.921ZDEBGnexus (SagaExecutor): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true roles = RoleSet { roles: {} } saga_id = d64d18f3-083c-41c4-8e63-0d0d164ec14e saga_name = instance-delete saga_node = InstanceDeleteNat
8002024-12-14T01:15:15.921ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true resource = Database result = Ok(()) saga_id = d64d18f3-083c-41c4-8e63-0d0d164ec14e saga_name = instance-delete saga_node = InstanceDeleteNat
8012024-12-14T01:15:15.924ZDEBGnexus (SagaExecutor): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true roles = RoleSet { roles: {} } saga_id = d64d18f3-083c-41c4-8e63-0d0d164ec14e saga_name = instance-delete saga_node = InstanceDeleteNat
8022024-12-14T01:15:15.924ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true resource = Database result = Ok(()) saga_id = d64d18f3-083c-41c4-8e63-0d0d164ec14e saga_name = instance-delete saga_node = InstanceDeleteNat
8032024-12-14T01:15:15.926ZDEBGnexus (SagaExecutor): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true roles = RoleSet { roles: {} } saga_id = d64d18f3-083c-41c4-8e63-0d0d164ec14e saga_name = instance-delete saga_node = InstanceDeleteNat
8042024-12-14T01:15:15.926ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true resource = Database result = Ok(()) saga_id = d64d18f3-083c-41c4-8e63-0d0d164ec14e saga_name = instance-delete saga_node = InstanceDeleteNat
8052024-12-14T01:15:15.928ZDEBGnexus (SagaExecutor): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true roles = RoleSet { roles: {(Silo, 2c668072-a9a1-4a69-928c-e118c99521be, "admin")} } saga_id = d64d18f3-083c-41c4-8e63-0d0d164ec14e saga_name = instance-delete saga_node = InstanceDeleteNat
8062024-12-14T01:15:15.931ZDEBGnexus (SagaExecutor): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 2c668072-a9a1-4a69-928c-e118c99521be, lookup_type: ById(2c668072-a9a1-4a69-928c-e118c99521be) }, key: 776ccd20-a853-4c93-af22-41ffed980f3e, lookup_type: ById(776ccd20-a853-4c93-af22-41ffed980f3e) }, key: d008f4b2-6063-424c-a333-d54d35c8c058, lookup_type: ById(d008f4b2-6063-424c-a333-d54d35c8c058) } result = Ok(()) saga_id = d64d18f3-083c-41c4-8e63-0d0d164ec14e saga_name = instance-delete saga_node = InstanceDeleteNat
8072024-12-14T01:15:15.931ZINFOnexus: deleting instance dpd configuration file = nexus/src/app/instance_network.rs:548 instance_id = d008f4b2-6063-424c-a333-d54d35c8c058
8082024-12-14T01:15:15.931ZDEBGnexus (SagaExecutor): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true roles = RoleSet { roles: {} } saga_id = d64d18f3-083c-41c4-8e63-0d0d164ec14e saga_name = instance-delete saga_node = InstanceDeleteNat
8092024-12-14T01:15:15.931ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true resource = Database result = Ok(()) saga_id = d64d18f3-083c-41c4-8e63-0d0d164ec14e saga_name = instance-delete saga_node = InstanceDeleteNat
8102024-12-14T01:15:15.935ZDEBGnexus (SagaExecutor): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true roles = RoleSet { roles: {} } saga_id = d64d18f3-083c-41c4-8e63-0d0d164ec14e saga_name = instance-delete saga_node = InstanceDeleteNat
8112024-12-14T01:15:15.935ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true resource = Database result = Ok(()) saga_id = d64d18f3-083c-41c4-8e63-0d0d164ec14e saga_name = instance-delete saga_node = InstanceDeleteNat
8122024-12-14T01:15:15.947ZDEBGnexus (SagaExecutor): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true roles = RoleSet { roles: {} } saga_id = d64d18f3-083c-41c4-8e63-0d0d164ec14e saga_name = instance-delete saga_node = InstanceDeleteNat
8132024-12-14T01:15:15.947ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true resource = Database result = Ok(()) saga_id = d64d18f3-083c-41c4-8e63-0d0d164ec14e saga_name = instance-delete saga_node = InstanceDeleteNat
8142024-12-14T01:15:15.953ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
8152024-12-14T01:15:15.953ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
8162024-12-14T01:15:15.954ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
8172024-12-14T01:15:15.955ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Fleet result = Ok(())
8182024-12-14T01:15:15.955ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
8192024-12-14T01:15:15.955ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
8202024-12-14T01:15:15.960ZDEBGnexus: notifying dendrite of updates instance_id = Some(d008f4b2-6063-424c-a333-d54d35c8c058 (instance)) switch = switch0
8212024-12-14T01:15:15.960ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-7e423e95-464a-471f-a0d9-4799977f0b0f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-7e423e95-464a-471f-a0d9-4799977f0b0f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1478, tv_nsec: 789777139 } })
8222024-12-14T01:15:15.961ZINFOnexus: Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1103
8232024-12-14T01:15:15.992ZINFOnexus: determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
8242024-12-14T01:15:15.992ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
8252024-12-14T01:15:15.992ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "888b2f49-c852-40bf-b0ae-7e75c21a7895", "content-length": "26", "date": "Sat, 14 Dec 2024 01:15:15 GMT"} })
8262024-12-14T01:15:15.992ZINFOnexus: identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
8272024-12-14T01:15:15.993ZINFOnexus: completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
8282024-12-14T01:15:16.024ZDEBGnexus (DpdClient): client request body = None method = POST uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger
8292024-12-14T01:15:16.024ZDEBGnexus (DpdClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger", status: 200, headers: {"content-type": "application/json", "x-request-id": "9cfc27db-32d6-4dcb-b0ec-0edb1e4348aa", "content-length": "4", "date": "Sat, 14 Dec 2024 01:15:15 GMT"} })
8302024-12-14T01:15:16.026ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = ec66f35d-9dc5-46c1-80a1-ebaa91a8212a
8312024-12-14T01:15:16.026ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 0 saga_id = d64d18f3-083c-41c4-8e63-0d0d164ec14e
8322024-12-14T01:15:16.030ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = ec66f35d-9dc5-46c1-80a1-ebaa91a8212a
8332024-12-14T01:15:16.030ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = d64d18f3-083c-41c4-8e63-0d0d164ec14e
8342024-12-14T01:15:16.034ZDEBGnexus (SagaExecutor): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true roles = RoleSet { roles: {} } saga_id = d64d18f3-083c-41c4-8e63-0d0d164ec14e saga_name = instance-delete saga_node = InstanceDeleteRecord
8352024-12-14T01:15:16.035ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true resource = Database result = Ok(()) saga_id = d64d18f3-083c-41c4-8e63-0d0d164ec14e saga_name = instance-delete saga_node = InstanceDeleteRecord
8362024-12-14T01:15:16.037ZDEBGnexus (SagaExecutor): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true roles = RoleSet { roles: {} } saga_id = d64d18f3-083c-41c4-8e63-0d0d164ec14e saga_name = instance-delete saga_node = InstanceDeleteRecord
8372024-12-14T01:15:16.037ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true resource = Database result = Ok(()) saga_id = d64d18f3-083c-41c4-8e63-0d0d164ec14e saga_name = instance-delete saga_node = InstanceDeleteRecord
8382024-12-14T01:15:16.039ZDEBGnexus (SagaExecutor): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true roles = RoleSet { roles: {} } saga_id = d64d18f3-083c-41c4-8e63-0d0d164ec14e saga_name = instance-delete saga_node = InstanceDeleteRecord
8392024-12-14T01:15:16.040ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true resource = Database result = Ok(()) saga_id = d64d18f3-083c-41c4-8e63-0d0d164ec14e saga_name = instance-delete saga_node = InstanceDeleteRecord
8402024-12-14T01:15:16.042ZDEBGnexus (SagaExecutor): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true roles = RoleSet { roles: {} } saga_id = d64d18f3-083c-41c4-8e63-0d0d164ec14e saga_name = instance-delete saga_node = InstanceDeleteRecord
8412024-12-14T01:15:16.043ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true resource = Database result = Ok(()) saga_id = d64d18f3-083c-41c4-8e63-0d0d164ec14e saga_name = instance-delete saga_node = InstanceDeleteRecord
8422024-12-14T01:15:16.045ZDEBGnexus (SagaExecutor): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true roles = RoleSet { roles: {(Silo, 2c668072-a9a1-4a69-928c-e118c99521be, "admin")} } saga_id = d64d18f3-083c-41c4-8e63-0d0d164ec14e saga_name = instance-delete saga_node = InstanceDeleteRecord
8432024-12-14T01:15:16.048ZDEBGnexus (SagaExecutor): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 2c668072-a9a1-4a69-928c-e118c99521be, lookup_type: ById(2c668072-a9a1-4a69-928c-e118c99521be) }, key: 776ccd20-a853-4c93-af22-41ffed980f3e, lookup_type: ByName("proj-76656375e39") }, key: d008f4b2-6063-424c-a333-d54d35c8c058, lookup_type: ByName("instance-9b46092bdd0") } result = Ok(()) saga_id = d64d18f3-083c-41c4-8e63-0d0d164ec14e saga_name = instance-delete saga_node = InstanceDeleteRecord
8442024-12-14T01:15:16.048ZDEBGnexus (SagaExecutor): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true roles = RoleSet { roles: {} } saga_id = d64d18f3-083c-41c4-8e63-0d0d164ec14e saga_name = instance-delete saga_node = InstanceDeleteRecord
8452024-12-14T01:15:16.048ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true resource = Database result = Ok(()) saga_id = d64d18f3-083c-41c4-8e63-0d0d164ec14e saga_name = instance-delete saga_node = InstanceDeleteRecord
8462024-12-14T01:15:16.073ZDEBGnexus (SEC): saga log event new_state = N001 failed sec_id = ec66f35d-9dc5-46c1-80a1-ebaa91a8212a
8472024-12-14T01:15:16.073ZDEBGnexus (SecStore): recording saga event event_type = Failed(ActionFailed { source_error: Object {"InvalidRequest": Object {"message": Object {"external_message": String("cannot delete instance: instance is running or has not yet fully stopped"), "internal_context": String("")}}} }) node_id = 1 saga_id = d64d18f3-083c-41c4-8e63-0d0d164ec14e
8482024-12-14T01:15:16.081ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Unwinding saga_id = d64d18f3-083c-41c4-8e63-0d0d164ec14e sec_id = ec66f35d-9dc5-46c1-80a1-ebaa91a8212a
8492024-12-14T01:15:16.081ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = unwinding saga_id = d64d18f3-083c-41c4-8e63-0d0d164ec14e
8502024-12-14T01:15:16.091ZDEBGnexus (SEC): saga log event new_state = N000 undo_started sec_id = ec66f35d-9dc5-46c1-80a1-ebaa91a8212a
8512024-12-14T01:15:16.091ZDEBGnexus (SecStore): recording saga event event_type = UndoStarted node_id = 0 saga_id = d64d18f3-083c-41c4-8e63-0d0d164ec14e
8522024-12-14T01:15:16.095ZDEBGnexus (SEC): saga log event new_state = N000 undo_finished sec_id = ec66f35d-9dc5-46c1-80a1-ebaa91a8212a
8532024-12-14T01:15:16.095ZDEBGnexus (SecStore): recording saga event event_type = UndoFinished node_id = 0 saga_id = d64d18f3-083c-41c4-8e63-0d0d164ec14e
8542024-12-14T01:15:16.098ZDEBGnexus (SEC): saga log event new_state = N004 undo_started sec_id = ec66f35d-9dc5-46c1-80a1-ebaa91a8212a
8552024-12-14T01:15:16.098ZDEBGnexus (SecStore): recording saga event event_type = UndoStarted node_id = 4 saga_id = d64d18f3-083c-41c4-8e63-0d0d164ec14e
8562024-12-14T01:15:16.101ZDEBGnexus (SEC): saga log event new_state = N004 undo_finished sec_id = ec66f35d-9dc5-46c1-80a1-ebaa91a8212a
8572024-12-14T01:15:16.101ZDEBGnexus (SecStore): recording saga event event_type = UndoFinished node_id = 4 saga_id = d64d18f3-083c-41c4-8e63-0d0d164ec14e
8582024-12-14T01:15:16.105ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = d64d18f3-083c-41c4-8e63-0d0d164ec14e sec_id = ec66f35d-9dc5-46c1-80a1-ebaa91a8212a
8592024-12-14T01:15:16.105ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = d64d18f3-083c-41c4-8e63-0d0d164ec14e
8602024-12-14T01:15:16.111ZWARNnexus (SEC): saga finished action_error_node_name = "no_result1" action_error_source = ActionFailed { source_error: Object {"InvalidRequest": Object {"message": Object {"external_message": String("cannot delete instance: instance is running or has not yet fully stopped"), "internal_context": String("")}}} } file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1044 result = failure saga_id = d64d18f3-083c-41c4-8e63-0d0d164ec14e saga_name = instance-delete sec_id = ec66f35d-9dc5-46c1-80a1-ebaa91a8212a undo_result = success
8612024-12-14T01:15:16.111ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = d64d18f3-083c-41c4-8e63-0d0d164ec14e saga_name = instance-delete saga_result = SagaResult { saga_id: d64d18f3-083c-41c4-8e63-0d0d164ec14e, saga_log: SagaLog { saga_id: d64d18f3-083c-41c4-8e63-0d0d164ec14e, unwinding: true, events: [N004 started, N004 succeeded, N000 started, N000 succeeded, N001 started, N001 failed, N000 undo_started, N000 undo_finished, N004 undo_started, N004 undo_finished], node_status: {0: UndoFinished, 1: Failed(ActionFailed { source_error: Object {"InvalidRequest": Object {"message": Object {"external_message": String("cannot delete instance: instance is running or has not yet fully stopped"), "internal_context": String("")}}} }), 4: UndoFinished} }, kind: Err(SagaResultErr { error_node_name: "no_result1", error_source: ActionFailed { source_error: Object {"InvalidRequest": Object {"message": Object {"external_message": String("cannot delete instance: instance is running or has not yet fully stopped"), "internal_context": String("")}}} }, undo_failure: None }) }
8622024-12-14T01:15:16.111ZINFOnexus (dropshot_external): request completed error_message_external = cannot delete instance: instance is running or has not yet fully stopped error_message_internal = cannot delete instance: instance is running or has not yet fully stopped (with internal context: saga ACTION error at node "no_result1") file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 278405 local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 59bd140c-e803-44fe-9732-f31171cb5fd6 response_code = 400 uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
8632024-12-14T01:15:17.114ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
8642024-12-14T01:15:17.114ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
8652024-12-14T01:15:17.116ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
8662024-12-14T01:15:17.116ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
8672024-12-14T01:15:17.118ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
8682024-12-14T01:15:17.119ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "4c27b5375e7db4012b4e50525f017d0aef13b0d1", lookup_type: ByCompositeId("token = \\"4c27b5375e7db4012b4e50525f017d0aef13b0d1\\"") } result = Ok(())
8692024-12-14T01:15:17.119ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
8702024-12-14T01:15:17.119ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
8712024-12-14T01:15:17.121ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
8722024-12-14T01:15:17.121ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
8732024-12-14T01:15:17.123ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
8742024-12-14T01:15:17.123ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
8752024-12-14T01:15:17.125ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
8762024-12-14T01:15:17.125ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
8772024-12-14T01:15:17.126ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
8782024-12-14T01:15:17.128ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 2c668072-a9a1-4a69-928c-e118c99521be, lookup_type: ById(2c668072-a9a1-4a69-928c-e118c99521be) }, key: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, lookup_type: ById(2896dd1a-5f1e-476b-86bb-db6c90fa385e) } result = Ok(())
8792024-12-14T01:15:17.128ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
8802024-12-14T01:15:17.128ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
8812024-12-14T01:15:17.129ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
8822024-12-14T01:15:17.130ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "4c27b5375e7db4012b4e50525f017d0aef13b0d1", lookup_type: ByCompositeId("4c27b5375e7db4012b4e50525f017d0aef13b0d1") } result = Ok(())
8832024-12-14T01:15:17.130ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
8842024-12-14T01:15:17.131ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
8852024-12-14T01:15:17.135ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
8862024-12-14T01:15:17.135ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
8872024-12-14T01:15:17.136ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
8882024-12-14T01:15:17.137ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
8892024-12-14T01:15:17.138ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
8902024-12-14T01:15:17.138ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
8912024-12-14T01:15:17.140ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
8922024-12-14T01:15:17.140ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
8932024-12-14T01:15:17.141ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
8942024-12-14T01:15:17.142ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 2c668072-a9a1-4a69-928c-e118c99521be, lookup_type: ById(2c668072-a9a1-4a69-928c-e118c99521be) }, key: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, lookup_type: ById(2896dd1a-5f1e-476b-86bb-db6c90fa385e) } result = Ok(())
8952024-12-14T01:15:17.142ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
8962024-12-14T01:15:17.142ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
8972024-12-14T01:15:17.144ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
8982024-12-14T01:15:17.144ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
8992024-12-14T01:15:17.145ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
9002024-12-14T01:15:17.145ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
9012024-12-14T01:15:17.146ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
9022024-12-14T01:15:17.148ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 2c668072-a9a1-4a69-928c-e118c99521be, lookup_type: ById(2c668072-a9a1-4a69-928c-e118c99521be) } result = Ok(())
9032024-12-14T01:15:17.148ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 0670458a-0f8e-4971-b382-ee24b5b961a3 roles = RoleSet { roles: {} } uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
9042024-12-14T01:15:17.148ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 0670458a-0f8e-4971-b382-ee24b5b961a3 resource = Database result = Ok(()) uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
9052024-12-14T01:15:17.149ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 0670458a-0f8e-4971-b382-ee24b5b961a3 roles = RoleSet { roles: {} } uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
9062024-12-14T01:15:17.149ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 0670458a-0f8e-4971-b382-ee24b5b961a3 resource = Database result = Ok(()) uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
9072024-12-14T01:15:17.151ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 0670458a-0f8e-4971-b382-ee24b5b961a3 roles = RoleSet { roles: {} } uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
9082024-12-14T01:15:17.151ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 0670458a-0f8e-4971-b382-ee24b5b961a3 resource = Database result = Ok(()) uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
9092024-12-14T01:15:17.153ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 0670458a-0f8e-4971-b382-ee24b5b961a3 roles = RoleSet { roles: {} } uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
9102024-12-14T01:15:17.153ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 0670458a-0f8e-4971-b382-ee24b5b961a3 resource = Database result = Ok(()) uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
9112024-12-14T01:15:17.156ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 0670458a-0f8e-4971-b382-ee24b5b961a3 roles = RoleSet { roles: {} } uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
9122024-12-14T01:15:17.156ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 0670458a-0f8e-4971-b382-ee24b5b961a3 resource = Database result = Ok(()) uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
9132024-12-14T01:15:17.158ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 0670458a-0f8e-4971-b382-ee24b5b961a3 roles = RoleSet { roles: {} } uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
9142024-12-14T01:15:17.158ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 0670458a-0f8e-4971-b382-ee24b5b961a3 resource = Database result = Ok(()) uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
9152024-12-14T01:15:17.160ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 0670458a-0f8e-4971-b382-ee24b5b961a3 roles = RoleSet { roles: {} } uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
9162024-12-14T01:15:17.160ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 0670458a-0f8e-4971-b382-ee24b5b961a3 resource = Database result = Ok(()) uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
9172024-12-14T01:15:17.163ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 0670458a-0f8e-4971-b382-ee24b5b961a3 roles = RoleSet { roles: {(Silo, 2c668072-a9a1-4a69-928c-e118c99521be, "admin")} } uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
9182024-12-14T01:15:17.165ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 0670458a-0f8e-4971-b382-ee24b5b961a3 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 2c668072-a9a1-4a69-928c-e118c99521be, lookup_type: ById(2c668072-a9a1-4a69-928c-e118c99521be) }, key: 776ccd20-a853-4c93-af22-41ffed980f3e, lookup_type: ByName("proj-76656375e39") }, key: d008f4b2-6063-424c-a333-d54d35c8c058, lookup_type: ByName("instance-9b46092bdd0") } result = Ok(()) uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
9192024-12-14T01:15:17.165ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
9202024-12-14T01:15:17.165ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
9212024-12-14T01:15:17.167ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
9222024-12-14T01:15:17.168ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Fleet result = Ok(())
9232024-12-14T01:15:17.168ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
9242024-12-14T01:15:17.168ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
9252024-12-14T01:15:17.173ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = 398f38a7-28be-4960-a83e-a43bd1a02359 saga_name = instance-delete
9262024-12-14T01:15:17.173ZINFOnexus (SEC): saga create dag = {"end_node":5,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[4,0,null],[3,5,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"instance_delete.instance_delete_nat","label":"InstanceDeleteNat","name":"no_result4"}},{"Action":{"action_name":"instance_delete.instance_delete_record","label":"InstanceDeleteRecord","name":"no_result1"}},{"Action":{"action_name":"instance_delete.delete_network_interfaces","label":"DeleteNetworkInterfaces","name":"no_result2"}},{"Action":{"action_name":"instance_delete.deallocate_external_ip","label":"DeallocateExternalIp","name":"no_result3"}},{"Start":{"params":{"authz_instance":{"key":"d008f4b2-6063-424c-a333-d54d35c8c058","lookup_type":{"ByName":"instance-9b46092bdd0"},"parent":{"key":"776ccd20-a853-4c93-af22-41ffed980f3e","lookup_type":{"ByName":"proj-76656375e39"},"parent":{"key":"2c668072-a9a1-4a69-928c-e118c99521be","lookup_type":{"ById":"2c668072-a9a1-4a69-928c-e118c99521be"},"parent":null}}},"boundary_switches":["switch0"],"instance":{"auto_restart":{"cooldown":null,"policy":null},"boot_disk_id":"03cca168-b332-42b3-bd85-e17bd7884c8f","hostname":"localshark","identity":{"description":"","id":"d008f4b2-6063-424c-a333-d54d35c8c058","name":"instance-9b46092bdd0","time_created":"2024-12-14T01:14:55.295559Z","time_deleted":null,"time_modified":"2024-12-14T01:14:55.295559Z"},"memory":1073741824,"ncpus":2,"project_id":"776ccd20-a853-4c93-af22-41ffed980f3e","runtime_state":{"dst_propolis_id":null,"gen":3,"migration_id":null,"nexus_state":"Vmm","propolis_id":"b2d035ea-f96d-499b-a259-358e56f0523e","time_last_auto_restarted":null,"time_updated":"2024-12-14T01:14:55.295559Z"},"updater_gen":1,"updater_id":null,"user_data":[]},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"SiloUser":{"silo_id":"2c668072-a9a1-4a69-928c-e118c99521be","silo_user_id":"2896dd1a-5f1e-476b-86bb-db6c90fa385e"}}},{"mapped_fleet_roles":{"admin":["admin"]}}]}}}}},"End"]},"saga_name":"instance-delete","start_node":4} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = 398f38a7-28be-4960-a83e-a43bd1a02359 saga_name = instance-delete sec_id = ec66f35d-9dc5-46c1-80a1-ebaa91a8212a
9272024-12-14T01:15:17.173ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 398f38a7-28be-4960-a83e-a43bd1a02359 saga_name = instance-delete
9282024-12-14T01:15:17.177ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = 398f38a7-28be-4960-a83e-a43bd1a02359 saga_name = instance-delete
9292024-12-14T01:15:17.177ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = 398f38a7-28be-4960-a83e-a43bd1a02359 saga_name = instance-delete sec_id = ec66f35d-9dc5-46c1-80a1-ebaa91a8212a
9302024-12-14T01:15:17.177ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = ec66f35d-9dc5-46c1-80a1-ebaa91a8212a
9312024-12-14T01:15:17.177ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 398f38a7-28be-4960-a83e-a43bd1a02359
9322024-12-14T01:15:17.181ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = ec66f35d-9dc5-46c1-80a1-ebaa91a8212a
9332024-12-14T01:15:17.181ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = 398f38a7-28be-4960-a83e-a43bd1a02359
9342024-12-14T01:15:17.184ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = ec66f35d-9dc5-46c1-80a1-ebaa91a8212a
9352024-12-14T01:15:17.184ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 398f38a7-28be-4960-a83e-a43bd1a02359
9362024-12-14T01:15:17.187ZDEBGnexus (SagaExecutor): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true roles = RoleSet { roles: {} } saga_id = 398f38a7-28be-4960-a83e-a43bd1a02359 saga_name = instance-delete saga_node = InstanceDeleteNat
9372024-12-14T01:15:17.187ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true resource = Database result = Ok(()) saga_id = 398f38a7-28be-4960-a83e-a43bd1a02359 saga_name = instance-delete saga_node = InstanceDeleteNat
9382024-12-14T01:15:17.189ZDEBGnexus (SagaExecutor): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true roles = RoleSet { roles: {} } saga_id = 398f38a7-28be-4960-a83e-a43bd1a02359 saga_name = instance-delete saga_node = InstanceDeleteNat
9392024-12-14T01:15:17.189ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true resource = Database result = Ok(()) saga_id = 398f38a7-28be-4960-a83e-a43bd1a02359 saga_name = instance-delete saga_node = InstanceDeleteNat
9402024-12-14T01:15:17.190ZDEBGnexus (SagaExecutor): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true roles = RoleSet { roles: {} } saga_id = 398f38a7-28be-4960-a83e-a43bd1a02359 saga_name = instance-delete saga_node = InstanceDeleteNat
9412024-12-14T01:15:17.190ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true resource = Database result = Ok(()) saga_id = 398f38a7-28be-4960-a83e-a43bd1a02359 saga_name = instance-delete saga_node = InstanceDeleteNat
9422024-12-14T01:15:17.191ZDEBGnexus (SagaExecutor): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true roles = RoleSet { roles: {} } saga_id = 398f38a7-28be-4960-a83e-a43bd1a02359 saga_name = instance-delete saga_node = InstanceDeleteNat
9432024-12-14T01:15:17.191ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true resource = Database result = Ok(()) saga_id = 398f38a7-28be-4960-a83e-a43bd1a02359 saga_name = instance-delete saga_node = InstanceDeleteNat
9442024-12-14T01:15:17.194ZDEBGnexus (SagaExecutor): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true roles = RoleSet { roles: {} } saga_id = 398f38a7-28be-4960-a83e-a43bd1a02359 saga_name = instance-delete saga_node = InstanceDeleteNat
9452024-12-14T01:15:17.194ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true resource = Database result = Ok(()) saga_id = 398f38a7-28be-4960-a83e-a43bd1a02359 saga_name = instance-delete saga_node = InstanceDeleteNat
9462024-12-14T01:15:17.196ZDEBGnexus (SagaExecutor): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true roles = RoleSet { roles: {} } saga_id = 398f38a7-28be-4960-a83e-a43bd1a02359 saga_name = instance-delete saga_node = InstanceDeleteNat
9472024-12-14T01:15:17.197ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true resource = Database result = Ok(()) saga_id = 398f38a7-28be-4960-a83e-a43bd1a02359 saga_name = instance-delete saga_node = InstanceDeleteNat
9482024-12-14T01:15:17.199ZDEBGnexus (SagaExecutor): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true roles = RoleSet { roles: {} } saga_id = 398f38a7-28be-4960-a83e-a43bd1a02359 saga_name = instance-delete saga_node = InstanceDeleteNat
9492024-12-14T01:15:17.199ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true resource = Database result = Ok(()) saga_id = 398f38a7-28be-4960-a83e-a43bd1a02359 saga_name = instance-delete saga_node = InstanceDeleteNat
9502024-12-14T01:15:17.200ZDEBGnexus (SagaExecutor): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true roles = RoleSet { roles: {(Silo, 2c668072-a9a1-4a69-928c-e118c99521be, "admin")} } saga_id = 398f38a7-28be-4960-a83e-a43bd1a02359 saga_name = instance-delete saga_node = InstanceDeleteNat
9512024-12-14T01:15:17.203ZDEBGnexus (SagaExecutor): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 2c668072-a9a1-4a69-928c-e118c99521be, lookup_type: ById(2c668072-a9a1-4a69-928c-e118c99521be) }, key: 776ccd20-a853-4c93-af22-41ffed980f3e, lookup_type: ById(776ccd20-a853-4c93-af22-41ffed980f3e) }, key: d008f4b2-6063-424c-a333-d54d35c8c058, lookup_type: ById(d008f4b2-6063-424c-a333-d54d35c8c058) } result = Ok(()) saga_id = 398f38a7-28be-4960-a83e-a43bd1a02359 saga_name = instance-delete saga_node = InstanceDeleteNat
9522024-12-14T01:15:17.203ZINFOnexus: deleting instance dpd configuration file = nexus/src/app/instance_network.rs:548 instance_id = d008f4b2-6063-424c-a333-d54d35c8c058
9532024-12-14T01:15:17.203ZDEBGnexus (SagaExecutor): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true roles = RoleSet { roles: {} } saga_id = 398f38a7-28be-4960-a83e-a43bd1a02359 saga_name = instance-delete saga_node = InstanceDeleteNat
9542024-12-14T01:15:17.203ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true resource = Database result = Ok(()) saga_id = 398f38a7-28be-4960-a83e-a43bd1a02359 saga_name = instance-delete saga_node = InstanceDeleteNat
9552024-12-14T01:15:17.206ZDEBGnexus (SagaExecutor): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true roles = RoleSet { roles: {} } saga_id = 398f38a7-28be-4960-a83e-a43bd1a02359 saga_name = instance-delete saga_node = InstanceDeleteNat
9562024-12-14T01:15:17.206ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true resource = Database result = Ok(()) saga_id = 398f38a7-28be-4960-a83e-a43bd1a02359 saga_name = instance-delete saga_node = InstanceDeleteNat
9572024-12-14T01:15:17.208ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
9582024-12-14T01:15:17.208ZDEBGnexus (SagaExecutor): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true roles = RoleSet { roles: {} } saga_id = 398f38a7-28be-4960-a83e-a43bd1a02359 saga_name = instance-delete saga_node = InstanceDeleteNat
9592024-12-14T01:15:17.209ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true resource = Database result = Ok(()) saga_id = 398f38a7-28be-4960-a83e-a43bd1a02359 saga_name = instance-delete saga_node = InstanceDeleteNat
9602024-12-14T01:15:17.211ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
9612024-12-14T01:15:17.211ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
9622024-12-14T01:15:17.211ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
9632024-12-14T01:15:17.212ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
9642024-12-14T01:15:17.213ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Fleet result = Ok(())
9652024-12-14T01:15:17.213ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
9662024-12-14T01:15:17.214ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
9672024-12-14T01:15:17.218ZDEBGnexus: notifying dendrite of updates instance_id = Some(d008f4b2-6063-424c-a333-d54d35c8c058 (instance)) switch = switch0
9682024-12-14T01:15:17.218ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-7e423e95-464a-471f-a0d9-4799977f0b0f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-7e423e95-464a-471f-a0d9-4799977f0b0f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1480, tv_nsec: 47557968 } })
9692024-12-14T01:15:17.218ZINFOnexus: Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1103
9702024-12-14T01:15:17.249ZINFOnexus: determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
9712024-12-14T01:15:17.249ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
9722024-12-14T01:15:17.249ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "81078247-ec43-4351-8493-16b6958f84ed", "content-length": "26", "date": "Sat, 14 Dec 2024 01:15:17 GMT"} })
9732024-12-14T01:15:17.249ZINFOnexus: identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
9742024-12-14T01:15:17.250ZINFOnexus: completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
9752024-12-14T01:15:17.279ZDEBGnexus (DpdClient): client request body = None method = POST uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger
9762024-12-14T01:15:17.279ZDEBGnexus (DpdClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger", status: 200, headers: {"content-type": "application/json", "x-request-id": "316a54fb-1ced-4d18-9cd5-8970589a916e", "content-length": "4", "date": "Sat, 14 Dec 2024 01:15:16 GMT"} })
9772024-12-14T01:15:17.280ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = ec66f35d-9dc5-46c1-80a1-ebaa91a8212a
9782024-12-14T01:15:17.280ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 0 saga_id = 398f38a7-28be-4960-a83e-a43bd1a02359
9792024-12-14T01:15:17.284ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = ec66f35d-9dc5-46c1-80a1-ebaa91a8212a
9802024-12-14T01:15:17.284ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 398f38a7-28be-4960-a83e-a43bd1a02359
9812024-12-14T01:15:17.288ZDEBGnexus (SagaExecutor): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true roles = RoleSet { roles: {} } saga_id = 398f38a7-28be-4960-a83e-a43bd1a02359 saga_name = instance-delete saga_node = InstanceDeleteRecord
9822024-12-14T01:15:17.288ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true resource = Database result = Ok(()) saga_id = 398f38a7-28be-4960-a83e-a43bd1a02359 saga_name = instance-delete saga_node = InstanceDeleteRecord
9832024-12-14T01:15:17.290ZDEBGnexus (SagaExecutor): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true roles = RoleSet { roles: {} } saga_id = 398f38a7-28be-4960-a83e-a43bd1a02359 saga_name = instance-delete saga_node = InstanceDeleteRecord
9842024-12-14T01:15:17.290ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true resource = Database result = Ok(()) saga_id = 398f38a7-28be-4960-a83e-a43bd1a02359 saga_name = instance-delete saga_node = InstanceDeleteRecord
9852024-12-14T01:15:17.293ZDEBGnexus (SagaExecutor): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true roles = RoleSet { roles: {} } saga_id = 398f38a7-28be-4960-a83e-a43bd1a02359 saga_name = instance-delete saga_node = InstanceDeleteRecord
9862024-12-14T01:15:17.293ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true resource = Database result = Ok(()) saga_id = 398f38a7-28be-4960-a83e-a43bd1a02359 saga_name = instance-delete saga_node = InstanceDeleteRecord
9872024-12-14T01:15:17.295ZDEBGnexus (SagaExecutor): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true roles = RoleSet { roles: {} } saga_id = 398f38a7-28be-4960-a83e-a43bd1a02359 saga_name = instance-delete saga_node = InstanceDeleteRecord
9882024-12-14T01:15:17.295ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true resource = Database result = Ok(()) saga_id = 398f38a7-28be-4960-a83e-a43bd1a02359 saga_name = instance-delete saga_node = InstanceDeleteRecord
9892024-12-14T01:15:17.298ZDEBGnexus (SagaExecutor): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true roles = RoleSet { roles: {(Silo, 2c668072-a9a1-4a69-928c-e118c99521be, "admin")} } saga_id = 398f38a7-28be-4960-a83e-a43bd1a02359 saga_name = instance-delete saga_node = InstanceDeleteRecord
9902024-12-14T01:15:17.301ZDEBGnexus (SagaExecutor): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 2c668072-a9a1-4a69-928c-e118c99521be, lookup_type: ById(2c668072-a9a1-4a69-928c-e118c99521be) }, key: 776ccd20-a853-4c93-af22-41ffed980f3e, lookup_type: ByName("proj-76656375e39") }, key: d008f4b2-6063-424c-a333-d54d35c8c058, lookup_type: ByName("instance-9b46092bdd0") } result = Ok(()) saga_id = 398f38a7-28be-4960-a83e-a43bd1a02359 saga_name = instance-delete saga_node = InstanceDeleteRecord
9912024-12-14T01:15:17.301ZDEBGnexus (SagaExecutor): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true roles = RoleSet { roles: {} } saga_id = 398f38a7-28be-4960-a83e-a43bd1a02359 saga_name = instance-delete saga_node = InstanceDeleteRecord
9922024-12-14T01:15:17.301ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true resource = Database result = Ok(()) saga_id = 398f38a7-28be-4960-a83e-a43bd1a02359 saga_name = instance-delete saga_node = InstanceDeleteRecord
9932024-12-14T01:15:17.371ZDEBGnexus (SEC): saga log event new_state = N001 failed sec_id = ec66f35d-9dc5-46c1-80a1-ebaa91a8212a
9942024-12-14T01:15:17.371ZDEBGnexus (SecStore): recording saga event event_type = Failed(ActionFailed { source_error: Object {"InvalidRequest": Object {"message": Object {"external_message": String("cannot delete instance: instance is running or has not yet fully stopped"), "internal_context": String("")}}} }) node_id = 1 saga_id = 398f38a7-28be-4960-a83e-a43bd1a02359
9952024-12-14T01:15:17.375ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Unwinding saga_id = 398f38a7-28be-4960-a83e-a43bd1a02359 sec_id = ec66f35d-9dc5-46c1-80a1-ebaa91a8212a
9962024-12-14T01:15:17.375ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = unwinding saga_id = 398f38a7-28be-4960-a83e-a43bd1a02359
9972024-12-14T01:15:17.381ZDEBGnexus (SEC): saga log event new_state = N000 undo_started sec_id = ec66f35d-9dc5-46c1-80a1-ebaa91a8212a
9982024-12-14T01:15:17.381ZDEBGnexus (SecStore): recording saga event event_type = UndoStarted node_id = 0 saga_id = 398f38a7-28be-4960-a83e-a43bd1a02359
9992024-12-14T01:15:17.384ZDEBGnexus (SEC): saga log event new_state = N000 undo_finished sec_id = ec66f35d-9dc5-46c1-80a1-ebaa91a8212a
10002024-12-14T01:15:17.384ZDEBGnexus (SecStore): recording saga event event_type = UndoFinished node_id = 0 saga_id = 398f38a7-28be-4960-a83e-a43bd1a02359
10012024-12-14T01:15:17.388ZDEBGnexus (SEC): saga log event new_state = N004 undo_started sec_id = ec66f35d-9dc5-46c1-80a1-ebaa91a8212a
10022024-12-14T01:15:17.388ZDEBGnexus (SecStore): recording saga event event_type = UndoStarted node_id = 4 saga_id = 398f38a7-28be-4960-a83e-a43bd1a02359
10032024-12-14T01:15:17.390ZDEBGnexus (SEC): saga log event new_state = N004 undo_finished sec_id = ec66f35d-9dc5-46c1-80a1-ebaa91a8212a
10042024-12-14T01:15:17.391ZDEBGnexus (SecStore): recording saga event event_type = UndoFinished node_id = 4 saga_id = 398f38a7-28be-4960-a83e-a43bd1a02359
10052024-12-14T01:15:17.394ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 398f38a7-28be-4960-a83e-a43bd1a02359 sec_id = ec66f35d-9dc5-46c1-80a1-ebaa91a8212a
10062024-12-14T01:15:17.394ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 398f38a7-28be-4960-a83e-a43bd1a02359
10072024-12-14T01:15:17.400ZWARNnexus (SEC): saga finished action_error_node_name = "no_result1" action_error_source = ActionFailed { source_error: Object {"InvalidRequest": Object {"message": Object {"external_message": String("cannot delete instance: instance is running or has not yet fully stopped"), "internal_context": String("")}}} } file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1044 result = failure saga_id = 398f38a7-28be-4960-a83e-a43bd1a02359 saga_name = instance-delete sec_id = ec66f35d-9dc5-46c1-80a1-ebaa91a8212a undo_result = success
10082024-12-14T01:15:17.400ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = 398f38a7-28be-4960-a83e-a43bd1a02359 saga_name = instance-delete saga_result = SagaResult { saga_id: 398f38a7-28be-4960-a83e-a43bd1a02359, saga_log: SagaLog { saga_id: 398f38a7-28be-4960-a83e-a43bd1a02359, unwinding: true, events: [N004 started, N004 succeeded, N000 started, N000 succeeded, N001 started, N001 failed, N000 undo_started, N000 undo_finished, N004 undo_started, N004 undo_finished], node_status: {0: UndoFinished, 1: Failed(ActionFailed { source_error: Object {"InvalidRequest": Object {"message": Object {"external_message": String("cannot delete instance: instance is running or has not yet fully stopped"), "internal_context": String("")}}} }), 4: UndoFinished} }, kind: Err(SagaResultErr { error_node_name: "no_result1", error_source: ActionFailed { source_error: Object {"InvalidRequest": Object {"message": Object {"external_message": String("cannot delete instance: instance is running or has not yet fully stopped"), "internal_context": String("")}}} }, undo_failure: None }) }
10092024-12-14T01:15:17.400ZINFOnexus (dropshot_external): request completed error_message_external = cannot delete instance: instance is running or has not yet fully stopped error_message_internal = cannot delete instance: instance is running or has not yet fully stopped (with internal context: saga ACTION error at node "no_result1") file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 285614 local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 0670458a-0f8e-4971-b382-ee24b5b961a3 response_code = 400 uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
10102024-12-14T01:15:18.402ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
10112024-12-14T01:15:18.402ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
10122024-12-14T01:15:18.404ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
10132024-12-14T01:15:18.404ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
10142024-12-14T01:15:18.405ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
10152024-12-14T01:15:18.407ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "4c27b5375e7db4012b4e50525f017d0aef13b0d1", lookup_type: ByCompositeId("token = \\"4c27b5375e7db4012b4e50525f017d0aef13b0d1\\"") } result = Ok(())
10162024-12-14T01:15:18.407ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
10172024-12-14T01:15:18.407ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
10182024-12-14T01:15:18.408ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
10192024-12-14T01:15:18.408ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
10202024-12-14T01:15:18.410ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
10212024-12-14T01:15:18.410ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
10222024-12-14T01:15:18.412ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
10232024-12-14T01:15:18.412ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
10242024-12-14T01:15:18.413ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
10252024-12-14T01:15:18.414ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 2c668072-a9a1-4a69-928c-e118c99521be, lookup_type: ById(2c668072-a9a1-4a69-928c-e118c99521be) }, key: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, lookup_type: ById(2896dd1a-5f1e-476b-86bb-db6c90fa385e) } result = Ok(())
10262024-12-14T01:15:18.414ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
10272024-12-14T01:15:18.414ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
10282024-12-14T01:15:18.416ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
10292024-12-14T01:15:18.417ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "4c27b5375e7db4012b4e50525f017d0aef13b0d1", lookup_type: ByCompositeId("4c27b5375e7db4012b4e50525f017d0aef13b0d1") } result = Ok(())
10302024-12-14T01:15:18.417ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
10312024-12-14T01:15:18.417ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
10322024-12-14T01:15:18.421ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
10332024-12-14T01:15:18.421ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
10342024-12-14T01:15:18.423ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
10352024-12-14T01:15:18.423ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
10362024-12-14T01:15:18.424ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
10372024-12-14T01:15:18.424ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
10382024-12-14T01:15:18.425ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
10392024-12-14T01:15:18.426ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
10402024-12-14T01:15:18.427ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
10412024-12-14T01:15:18.428ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 2c668072-a9a1-4a69-928c-e118c99521be, lookup_type: ById(2c668072-a9a1-4a69-928c-e118c99521be) }, key: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, lookup_type: ById(2896dd1a-5f1e-476b-86bb-db6c90fa385e) } result = Ok(())
10422024-12-14T01:15:18.428ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
10432024-12-14T01:15:18.429ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
10442024-12-14T01:15:18.430ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
10452024-12-14T01:15:18.430ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
10462024-12-14T01:15:18.432ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
10472024-12-14T01:15:18.432ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
10482024-12-14T01:15:18.433ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
10492024-12-14T01:15:18.434ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 2c668072-a9a1-4a69-928c-e118c99521be, lookup_type: ById(2c668072-a9a1-4a69-928c-e118c99521be) } result = Ok(())
10502024-12-14T01:15:18.434ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 2e38df1c-71ff-4577-b9d3-208168b917c1 roles = RoleSet { roles: {} } uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
10512024-12-14T01:15:18.434ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 2e38df1c-71ff-4577-b9d3-208168b917c1 resource = Database result = Ok(()) uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
10522024-12-14T01:15:18.436ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 2e38df1c-71ff-4577-b9d3-208168b917c1 roles = RoleSet { roles: {} } uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
10532024-12-14T01:15:18.436ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 2e38df1c-71ff-4577-b9d3-208168b917c1 resource = Database result = Ok(()) uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
10542024-12-14T01:15:18.438ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 2e38df1c-71ff-4577-b9d3-208168b917c1 roles = RoleSet { roles: {} } uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
10552024-12-14T01:15:18.438ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 2e38df1c-71ff-4577-b9d3-208168b917c1 resource = Database result = Ok(()) uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
10562024-12-14T01:15:18.439ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 2e38df1c-71ff-4577-b9d3-208168b917c1 roles = RoleSet { roles: {} } uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
10572024-12-14T01:15:18.440ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 2e38df1c-71ff-4577-b9d3-208168b917c1 resource = Database result = Ok(()) uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
10582024-12-14T01:15:18.442ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 2e38df1c-71ff-4577-b9d3-208168b917c1 roles = RoleSet { roles: {} } uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
10592024-12-14T01:15:18.442ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 2e38df1c-71ff-4577-b9d3-208168b917c1 resource = Database result = Ok(()) uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
10602024-12-14T01:15:18.444ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 2e38df1c-71ff-4577-b9d3-208168b917c1 roles = RoleSet { roles: {} } uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
10612024-12-14T01:15:18.444ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 2e38df1c-71ff-4577-b9d3-208168b917c1 resource = Database result = Ok(()) uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
10622024-12-14T01:15:18.446ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 2e38df1c-71ff-4577-b9d3-208168b917c1 roles = RoleSet { roles: {} } uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
10632024-12-14T01:15:18.446ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 2e38df1c-71ff-4577-b9d3-208168b917c1 resource = Database result = Ok(()) uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
10642024-12-14T01:15:18.448ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 2e38df1c-71ff-4577-b9d3-208168b917c1 roles = RoleSet { roles: {(Silo, 2c668072-a9a1-4a69-928c-e118c99521be, "admin")} } uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
10652024-12-14T01:15:18.451ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 2e38df1c-71ff-4577-b9d3-208168b917c1 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 2c668072-a9a1-4a69-928c-e118c99521be, lookup_type: ById(2c668072-a9a1-4a69-928c-e118c99521be) }, key: 776ccd20-a853-4c93-af22-41ffed980f3e, lookup_type: ByName("proj-76656375e39") }, key: d008f4b2-6063-424c-a333-d54d35c8c058, lookup_type: ByName("instance-9b46092bdd0") } result = Ok(()) uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
10662024-12-14T01:15:18.451ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
10672024-12-14T01:15:18.451ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
10682024-12-14T01:15:18.453ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
10692024-12-14T01:15:18.454ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Fleet result = Ok(())
10702024-12-14T01:15:18.454ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
10712024-12-14T01:15:18.454ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
10722024-12-14T01:15:18.458ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = 06723b68-66ed-4b92-a0ae-a1be23a6dea9 saga_name = instance-delete
10732024-12-14T01:15:18.458ZINFOnexus (SEC): saga create dag = {"end_node":5,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[4,0,null],[3,5,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"instance_delete.instance_delete_nat","label":"InstanceDeleteNat","name":"no_result4"}},{"Action":{"action_name":"instance_delete.instance_delete_record","label":"InstanceDeleteRecord","name":"no_result1"}},{"Action":{"action_name":"instance_delete.delete_network_interfaces","label":"DeleteNetworkInterfaces","name":"no_result2"}},{"Action":{"action_name":"instance_delete.deallocate_external_ip","label":"DeallocateExternalIp","name":"no_result3"}},{"Start":{"params":{"authz_instance":{"key":"d008f4b2-6063-424c-a333-d54d35c8c058","lookup_type":{"ByName":"instance-9b46092bdd0"},"parent":{"key":"776ccd20-a853-4c93-af22-41ffed980f3e","lookup_type":{"ByName":"proj-76656375e39"},"parent":{"key":"2c668072-a9a1-4a69-928c-e118c99521be","lookup_type":{"ById":"2c668072-a9a1-4a69-928c-e118c99521be"},"parent":null}}},"boundary_switches":["switch0"],"instance":{"auto_restart":{"cooldown":null,"policy":null},"boot_disk_id":"03cca168-b332-42b3-bd85-e17bd7884c8f","hostname":"localshark","identity":{"description":"","id":"d008f4b2-6063-424c-a333-d54d35c8c058","name":"instance-9b46092bdd0","time_created":"2024-12-14T01:14:55.295559Z","time_deleted":null,"time_modified":"2024-12-14T01:14:55.295559Z"},"memory":1073741824,"ncpus":2,"project_id":"776ccd20-a853-4c93-af22-41ffed980f3e","runtime_state":{"dst_propolis_id":null,"gen":3,"migration_id":null,"nexus_state":"Vmm","propolis_id":"b2d035ea-f96d-499b-a259-358e56f0523e","time_last_auto_restarted":null,"time_updated":"2024-12-14T01:14:55.295559Z"},"updater_gen":2,"updater_id":"6cdd7099-b1d6-454c-9e50-ce1b3fe34715","user_data":[]},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"SiloUser":{"silo_id":"2c668072-a9a1-4a69-928c-e118c99521be","silo_user_id":"2896dd1a-5f1e-476b-86bb-db6c90fa385e"}}},{"mapped_fleet_roles":{"admin":["admin"]}}]}}}}},"End"]},"saga_name":"instance-delete","start_node":4} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = 06723b68-66ed-4b92-a0ae-a1be23a6dea9 saga_name = instance-delete sec_id = ec66f35d-9dc5-46c1-80a1-ebaa91a8212a
10742024-12-14T01:15:18.458ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 06723b68-66ed-4b92-a0ae-a1be23a6dea9 saga_name = instance-delete
10752024-12-14T01:15:18.461ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = 06723b68-66ed-4b92-a0ae-a1be23a6dea9 saga_name = instance-delete
10762024-12-14T01:15:18.461ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = 06723b68-66ed-4b92-a0ae-a1be23a6dea9 saga_name = instance-delete sec_id = ec66f35d-9dc5-46c1-80a1-ebaa91a8212a
10772024-12-14T01:15:18.461ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = ec66f35d-9dc5-46c1-80a1-ebaa91a8212a
10782024-12-14T01:15:18.461ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 06723b68-66ed-4b92-a0ae-a1be23a6dea9
10792024-12-14T01:15:18.464ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = ec66f35d-9dc5-46c1-80a1-ebaa91a8212a
10802024-12-14T01:15:18.464ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = 06723b68-66ed-4b92-a0ae-a1be23a6dea9
10812024-12-14T01:15:18.467ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = ec66f35d-9dc5-46c1-80a1-ebaa91a8212a
10822024-12-14T01:15:18.467ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 06723b68-66ed-4b92-a0ae-a1be23a6dea9
10832024-12-14T01:15:18.470ZDEBGnexus (SagaExecutor): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true roles = RoleSet { roles: {} } saga_id = 06723b68-66ed-4b92-a0ae-a1be23a6dea9 saga_name = instance-delete saga_node = InstanceDeleteNat
10842024-12-14T01:15:18.471ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true resource = Database result = Ok(()) saga_id = 06723b68-66ed-4b92-a0ae-a1be23a6dea9 saga_name = instance-delete saga_node = InstanceDeleteNat
10852024-12-14T01:15:18.472ZDEBGnexus (SagaExecutor): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true roles = RoleSet { roles: {} } saga_id = 06723b68-66ed-4b92-a0ae-a1be23a6dea9 saga_name = instance-delete saga_node = InstanceDeleteNat
10862024-12-14T01:15:18.472ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true resource = Database result = Ok(()) saga_id = 06723b68-66ed-4b92-a0ae-a1be23a6dea9 saga_name = instance-delete saga_node = InstanceDeleteNat
10872024-12-14T01:15:18.474ZDEBGnexus (SagaExecutor): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true roles = RoleSet { roles: {} } saga_id = 06723b68-66ed-4b92-a0ae-a1be23a6dea9 saga_name = instance-delete saga_node = InstanceDeleteNat
10882024-12-14T01:15:18.474ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true resource = Database result = Ok(()) saga_id = 06723b68-66ed-4b92-a0ae-a1be23a6dea9 saga_name = instance-delete saga_node = InstanceDeleteNat
10892024-12-14T01:15:18.476ZDEBGnexus (SagaExecutor): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true roles = RoleSet { roles: {} } saga_id = 06723b68-66ed-4b92-a0ae-a1be23a6dea9 saga_name = instance-delete saga_node = InstanceDeleteNat
10902024-12-14T01:15:18.476ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true resource = Database result = Ok(()) saga_id = 06723b68-66ed-4b92-a0ae-a1be23a6dea9 saga_name = instance-delete saga_node = InstanceDeleteNat
10912024-12-14T01:15:18.481ZDEBGnexus (SagaExecutor): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true roles = RoleSet { roles: {} } saga_id = 06723b68-66ed-4b92-a0ae-a1be23a6dea9 saga_name = instance-delete saga_node = InstanceDeleteNat
10922024-12-14T01:15:18.481ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true resource = Database result = Ok(()) saga_id = 06723b68-66ed-4b92-a0ae-a1be23a6dea9 saga_name = instance-delete saga_node = InstanceDeleteNat
10932024-12-14T01:15:18.484ZDEBGnexus (SagaExecutor): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true roles = RoleSet { roles: {} } saga_id = 06723b68-66ed-4b92-a0ae-a1be23a6dea9 saga_name = instance-delete saga_node = InstanceDeleteNat
10942024-12-14T01:15:18.484ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true resource = Database result = Ok(()) saga_id = 06723b68-66ed-4b92-a0ae-a1be23a6dea9 saga_name = instance-delete saga_node = InstanceDeleteNat
10952024-12-14T01:15:18.487ZDEBGnexus (SagaExecutor): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true roles = RoleSet { roles: {} } saga_id = 06723b68-66ed-4b92-a0ae-a1be23a6dea9 saga_name = instance-delete saga_node = InstanceDeleteNat
10962024-12-14T01:15:18.487ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true resource = Database result = Ok(()) saga_id = 06723b68-66ed-4b92-a0ae-a1be23a6dea9 saga_name = instance-delete saga_node = InstanceDeleteNat
10972024-12-14T01:15:18.490ZDEBGnexus (SagaExecutor): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true roles = RoleSet { roles: {(Silo, 2c668072-a9a1-4a69-928c-e118c99521be, "admin")} } saga_id = 06723b68-66ed-4b92-a0ae-a1be23a6dea9 saga_name = instance-delete saga_node = InstanceDeleteNat
10982024-12-14T01:15:18.493ZDEBGnexus (SagaExecutor): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 2c668072-a9a1-4a69-928c-e118c99521be, lookup_type: ById(2c668072-a9a1-4a69-928c-e118c99521be) }, key: 776ccd20-a853-4c93-af22-41ffed980f3e, lookup_type: ById(776ccd20-a853-4c93-af22-41ffed980f3e) }, key: d008f4b2-6063-424c-a333-d54d35c8c058, lookup_type: ById(d008f4b2-6063-424c-a333-d54d35c8c058) } result = Ok(()) saga_id = 06723b68-66ed-4b92-a0ae-a1be23a6dea9 saga_name = instance-delete saga_node = InstanceDeleteNat
10992024-12-14T01:15:18.493ZINFOnexus: deleting instance dpd configuration file = nexus/src/app/instance_network.rs:548 instance_id = d008f4b2-6063-424c-a333-d54d35c8c058
11002024-12-14T01:15:18.493ZDEBGnexus (SagaExecutor): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true roles = RoleSet { roles: {} } saga_id = 06723b68-66ed-4b92-a0ae-a1be23a6dea9 saga_name = instance-delete saga_node = InstanceDeleteNat
11012024-12-14T01:15:18.493ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true resource = Database result = Ok(()) saga_id = 06723b68-66ed-4b92-a0ae-a1be23a6dea9 saga_name = instance-delete saga_node = InstanceDeleteNat
11022024-12-14T01:15:18.494ZDEBGnexus (SagaExecutor): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true roles = RoleSet { roles: {} } saga_id = 06723b68-66ed-4b92-a0ae-a1be23a6dea9 saga_name = instance-delete saga_node = InstanceDeleteNat
11032024-12-14T01:15:18.495ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true resource = Database result = Ok(()) saga_id = 06723b68-66ed-4b92-a0ae-a1be23a6dea9 saga_name = instance-delete saga_node = InstanceDeleteNat
11042024-12-14T01:15:18.497ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
11052024-12-14T01:15:18.497ZDEBGnexus (SagaExecutor): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true roles = RoleSet { roles: {} } saga_id = 06723b68-66ed-4b92-a0ae-a1be23a6dea9 saga_name = instance-delete saga_node = InstanceDeleteNat
11062024-12-14T01:15:18.497ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true resource = Database result = Ok(()) saga_id = 06723b68-66ed-4b92-a0ae-a1be23a6dea9 saga_name = instance-delete saga_node = InstanceDeleteNat
11072024-12-14T01:15:18.499ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
11082024-12-14T01:15:18.499ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
11092024-12-14T01:15:18.499ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
11102024-12-14T01:15:18.500ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
11112024-12-14T01:15:18.501ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Fleet result = Ok(())
11122024-12-14T01:15:18.501ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
11132024-12-14T01:15:18.502ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
11142024-12-14T01:15:18.506ZDEBGnexus: notifying dendrite of updates instance_id = Some(d008f4b2-6063-424c-a333-d54d35c8c058 (instance)) switch = switch0
11152024-12-14T01:15:18.506ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-7e423e95-464a-471f-a0d9-4799977f0b0f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-7e423e95-464a-471f-a0d9-4799977f0b0f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1481, tv_nsec: 335456128 } })
11162024-12-14T01:15:18.506ZINFOnexus: Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1103
11172024-12-14T01:15:18.537ZINFOnexus: determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
11182024-12-14T01:15:18.537ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
11192024-12-14T01:15:18.537ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c7a69800-db45-4b48-bf3e-dc0d123ab4da", "content-length": "26", "date": "Sat, 14 Dec 2024 01:15:18 GMT"} })
11202024-12-14T01:15:18.537ZINFOnexus: identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
11212024-12-14T01:15:18.538ZINFOnexus: completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
11222024-12-14T01:15:18.567ZDEBGnexus (DpdClient): client request body = None method = POST uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger
11232024-12-14T01:15:18.567ZDEBGnexus (DpdClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger", status: 200, headers: {"content-type": "application/json", "x-request-id": "c5c2e43b-520a-4528-96df-86d5d21ad103", "content-length": "4", "date": "Sat, 14 Dec 2024 01:15:17 GMT"} })
11242024-12-14T01:15:18.570ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = ec66f35d-9dc5-46c1-80a1-ebaa91a8212a
11252024-12-14T01:15:18.570ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 0 saga_id = 06723b68-66ed-4b92-a0ae-a1be23a6dea9
11262024-12-14T01:15:18.574ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = ec66f35d-9dc5-46c1-80a1-ebaa91a8212a
11272024-12-14T01:15:18.574ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 06723b68-66ed-4b92-a0ae-a1be23a6dea9
11282024-12-14T01:15:18.577ZDEBGnexus (SagaExecutor): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true roles = RoleSet { roles: {} } saga_id = 06723b68-66ed-4b92-a0ae-a1be23a6dea9 saga_name = instance-delete saga_node = InstanceDeleteRecord
11292024-12-14T01:15:18.577ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true resource = Database result = Ok(()) saga_id = 06723b68-66ed-4b92-a0ae-a1be23a6dea9 saga_name = instance-delete saga_node = InstanceDeleteRecord
11302024-12-14T01:15:18.580ZDEBGnexus (SagaExecutor): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true roles = RoleSet { roles: {} } saga_id = 06723b68-66ed-4b92-a0ae-a1be23a6dea9 saga_name = instance-delete saga_node = InstanceDeleteRecord
11312024-12-14T01:15:18.580ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true resource = Database result = Ok(()) saga_id = 06723b68-66ed-4b92-a0ae-a1be23a6dea9 saga_name = instance-delete saga_node = InstanceDeleteRecord
11322024-12-14T01:15:18.583ZDEBGnexus (SagaExecutor): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true roles = RoleSet { roles: {} } saga_id = 06723b68-66ed-4b92-a0ae-a1be23a6dea9 saga_name = instance-delete saga_node = InstanceDeleteRecord
11332024-12-14T01:15:18.583ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true resource = Database result = Ok(()) saga_id = 06723b68-66ed-4b92-a0ae-a1be23a6dea9 saga_name = instance-delete saga_node = InstanceDeleteRecord
11342024-12-14T01:15:18.585ZDEBGnexus (SagaExecutor): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true roles = RoleSet { roles: {} } saga_id = 06723b68-66ed-4b92-a0ae-a1be23a6dea9 saga_name = instance-delete saga_node = InstanceDeleteRecord
11352024-12-14T01:15:18.585ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true resource = Database result = Ok(()) saga_id = 06723b68-66ed-4b92-a0ae-a1be23a6dea9 saga_name = instance-delete saga_node = InstanceDeleteRecord
11362024-12-14T01:15:18.587ZDEBGnexus (SagaExecutor): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true roles = RoleSet { roles: {(Silo, 2c668072-a9a1-4a69-928c-e118c99521be, "admin")} } saga_id = 06723b68-66ed-4b92-a0ae-a1be23a6dea9 saga_name = instance-delete saga_node = InstanceDeleteRecord
11372024-12-14T01:15:18.590ZDEBGnexus (SagaExecutor): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 2c668072-a9a1-4a69-928c-e118c99521be, lookup_type: ById(2c668072-a9a1-4a69-928c-e118c99521be) }, key: 776ccd20-a853-4c93-af22-41ffed980f3e, lookup_type: ByName("proj-76656375e39") }, key: d008f4b2-6063-424c-a333-d54d35c8c058, lookup_type: ByName("instance-9b46092bdd0") } result = Ok(()) saga_id = 06723b68-66ed-4b92-a0ae-a1be23a6dea9 saga_name = instance-delete saga_node = InstanceDeleteRecord
11382024-12-14T01:15:18.590ZDEBGnexus (SagaExecutor): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true roles = RoleSet { roles: {} } saga_id = 06723b68-66ed-4b92-a0ae-a1be23a6dea9 saga_name = instance-delete saga_node = InstanceDeleteRecord
11392024-12-14T01:15:18.590ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true resource = Database result = Ok(()) saga_id = 06723b68-66ed-4b92-a0ae-a1be23a6dea9 saga_name = instance-delete saga_node = InstanceDeleteRecord
11402024-12-14T01:15:18.659ZDEBGnexus (SEC): saga log event new_state = N001 failed sec_id = ec66f35d-9dc5-46c1-80a1-ebaa91a8212a
11412024-12-14T01:15:18.659ZDEBGnexus (SecStore): recording saga event event_type = Failed(ActionFailed { source_error: Object {"InvalidRequest": Object {"message": Object {"external_message": String("cannot delete instance: instance is running or has not yet fully stopped"), "internal_context": String("")}}} }) node_id = 1 saga_id = 06723b68-66ed-4b92-a0ae-a1be23a6dea9
11422024-12-14T01:15:18.664ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Unwinding saga_id = 06723b68-66ed-4b92-a0ae-a1be23a6dea9 sec_id = ec66f35d-9dc5-46c1-80a1-ebaa91a8212a
11432024-12-14T01:15:18.664ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = unwinding saga_id = 06723b68-66ed-4b92-a0ae-a1be23a6dea9
11442024-12-14T01:15:18.675ZDEBGnexus (SEC): saga log event new_state = N000 undo_started sec_id = ec66f35d-9dc5-46c1-80a1-ebaa91a8212a
11452024-12-14T01:15:18.675ZDEBGnexus (SecStore): recording saga event event_type = UndoStarted node_id = 0 saga_id = 06723b68-66ed-4b92-a0ae-a1be23a6dea9
11462024-12-14T01:15:18.678ZDEBGnexus (SEC): saga log event new_state = N000 undo_finished sec_id = ec66f35d-9dc5-46c1-80a1-ebaa91a8212a
11472024-12-14T01:15:18.678ZDEBGnexus (SecStore): recording saga event event_type = UndoFinished node_id = 0 saga_id = 06723b68-66ed-4b92-a0ae-a1be23a6dea9
11482024-12-14T01:15:18.681ZDEBGnexus (SEC): saga log event new_state = N004 undo_started sec_id = ec66f35d-9dc5-46c1-80a1-ebaa91a8212a
11492024-12-14T01:15:18.681ZDEBGnexus (SecStore): recording saga event event_type = UndoStarted node_id = 4 saga_id = 06723b68-66ed-4b92-a0ae-a1be23a6dea9
11502024-12-14T01:15:18.685ZDEBGnexus (SEC): saga log event new_state = N004 undo_finished sec_id = ec66f35d-9dc5-46c1-80a1-ebaa91a8212a
11512024-12-14T01:15:18.685ZDEBGnexus (SecStore): recording saga event event_type = UndoFinished node_id = 4 saga_id = 06723b68-66ed-4b92-a0ae-a1be23a6dea9
11522024-12-14T01:15:18.688ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 06723b68-66ed-4b92-a0ae-a1be23a6dea9 sec_id = ec66f35d-9dc5-46c1-80a1-ebaa91a8212a
11532024-12-14T01:15:18.688ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 06723b68-66ed-4b92-a0ae-a1be23a6dea9
11542024-12-14T01:15:18.694ZWARNnexus (SEC): saga finished action_error_node_name = "no_result1" action_error_source = ActionFailed { source_error: Object {"InvalidRequest": Object {"message": Object {"external_message": String("cannot delete instance: instance is running or has not yet fully stopped"), "internal_context": String("")}}} } file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1044 result = failure saga_id = 06723b68-66ed-4b92-a0ae-a1be23a6dea9 saga_name = instance-delete sec_id = ec66f35d-9dc5-46c1-80a1-ebaa91a8212a undo_result = success
11552024-12-14T01:15:18.694ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = 06723b68-66ed-4b92-a0ae-a1be23a6dea9 saga_name = instance-delete saga_result = SagaResult { saga_id: 06723b68-66ed-4b92-a0ae-a1be23a6dea9, saga_log: SagaLog { saga_id: 06723b68-66ed-4b92-a0ae-a1be23a6dea9, unwinding: true, events: [N004 started, N004 succeeded, N000 started, N000 succeeded, N001 started, N001 failed, N000 undo_started, N000 undo_finished, N004 undo_started, N004 undo_finished], node_status: {0: UndoFinished, 1: Failed(ActionFailed { source_error: Object {"InvalidRequest": Object {"message": Object {"external_message": String("cannot delete instance: instance is running or has not yet fully stopped"), "internal_context": String("")}}} }), 4: UndoFinished} }, kind: Err(SagaResultErr { error_node_name: "no_result1", error_source: ActionFailed { source_error: Object {"InvalidRequest": Object {"message": Object {"external_message": String("cannot delete instance: instance is running or has not yet fully stopped"), "internal_context": String("")}}} }, undo_failure: None }) }
11562024-12-14T01:15:18.694ZINFOnexus (dropshot_external): request completed error_message_external = cannot delete instance: instance is running or has not yet fully stopped error_message_internal = cannot delete instance: instance is running or has not yet fully stopped (with internal context: saga ACTION error at node "no_result1") file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 292470 local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 2e38df1c-71ff-4577-b9d3-208168b917c1 response_code = 400 uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
11572024-12-14T01:15:19.697ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
11582024-12-14T01:15:19.697ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
11592024-12-14T01:15:19.699ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
11602024-12-14T01:15:19.699ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
11612024-12-14T01:15:19.700ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
11622024-12-14T01:15:19.702ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "4c27b5375e7db4012b4e50525f017d0aef13b0d1", lookup_type: ByCompositeId("token = \\"4c27b5375e7db4012b4e50525f017d0aef13b0d1\\"") } result = Ok(())
11632024-12-14T01:15:19.702ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
11642024-12-14T01:15:19.702ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
11652024-12-14T01:15:19.704ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
11662024-12-14T01:15:19.704ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
11672024-12-14T01:15:19.706ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
11682024-12-14T01:15:19.706ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
11692024-12-14T01:15:19.708ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
11702024-12-14T01:15:19.708ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
11712024-12-14T01:15:19.710ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
11722024-12-14T01:15:19.711ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 2c668072-a9a1-4a69-928c-e118c99521be, lookup_type: ById(2c668072-a9a1-4a69-928c-e118c99521be) }, key: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, lookup_type: ById(2896dd1a-5f1e-476b-86bb-db6c90fa385e) } result = Ok(())
11732024-12-14T01:15:19.711ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
11742024-12-14T01:15:19.711ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
11752024-12-14T01:15:19.712ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
11762024-12-14T01:15:19.714ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "4c27b5375e7db4012b4e50525f017d0aef13b0d1", lookup_type: ByCompositeId("4c27b5375e7db4012b4e50525f017d0aef13b0d1") } result = Ok(())
11772024-12-14T01:15:19.714ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
11782024-12-14T01:15:19.714ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
11792024-12-14T01:15:19.718ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
11802024-12-14T01:15:19.718ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
11812024-12-14T01:15:19.720ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
11822024-12-14T01:15:19.720ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
11832024-12-14T01:15:19.722ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
11842024-12-14T01:15:19.722ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
11852024-12-14T01:15:19.723ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
11862024-12-14T01:15:19.723ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
11872024-12-14T01:15:19.724ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
11882024-12-14T01:15:19.725ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 2c668072-a9a1-4a69-928c-e118c99521be, lookup_type: ById(2c668072-a9a1-4a69-928c-e118c99521be) }, key: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, lookup_type: ById(2896dd1a-5f1e-476b-86bb-db6c90fa385e) } result = Ok(())
11892024-12-14T01:15:19.725ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
11902024-12-14T01:15:19.726ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
11912024-12-14T01:15:19.727ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
11922024-12-14T01:15:19.727ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
11932024-12-14T01:15:19.729ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
11942024-12-14T01:15:19.729ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
11952024-12-14T01:15:19.730ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
11962024-12-14T01:15:19.731ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 2c668072-a9a1-4a69-928c-e118c99521be, lookup_type: ById(2c668072-a9a1-4a69-928c-e118c99521be) } result = Ok(())
11972024-12-14T01:15:19.731ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = e653f18a-1eed-43b0-9944-11f884823aa1 roles = RoleSet { roles: {} } uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
11982024-12-14T01:15:19.732ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = e653f18a-1eed-43b0-9944-11f884823aa1 resource = Database result = Ok(()) uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
11992024-12-14T01:15:19.733ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = e653f18a-1eed-43b0-9944-11f884823aa1 roles = RoleSet { roles: {} } uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
12002024-12-14T01:15:19.733ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = e653f18a-1eed-43b0-9944-11f884823aa1 resource = Database result = Ok(()) uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
12012024-12-14T01:15:19.734ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = e653f18a-1eed-43b0-9944-11f884823aa1 roles = RoleSet { roles: {} } uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
12022024-12-14T01:15:19.734ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = e653f18a-1eed-43b0-9944-11f884823aa1 resource = Database result = Ok(()) uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
12032024-12-14T01:15:19.737ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = e653f18a-1eed-43b0-9944-11f884823aa1 roles = RoleSet { roles: {} } uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
12042024-12-14T01:15:19.737ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = e653f18a-1eed-43b0-9944-11f884823aa1 resource = Database result = Ok(()) uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
12052024-12-14T01:15:19.739ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = e653f18a-1eed-43b0-9944-11f884823aa1 roles = RoleSet { roles: {} } uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
12062024-12-14T01:15:19.739ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = e653f18a-1eed-43b0-9944-11f884823aa1 resource = Database result = Ok(()) uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
12072024-12-14T01:15:19.741ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = e653f18a-1eed-43b0-9944-11f884823aa1 roles = RoleSet { roles: {} } uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
12082024-12-14T01:15:19.742ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = e653f18a-1eed-43b0-9944-11f884823aa1 resource = Database result = Ok(()) uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
12092024-12-14T01:15:19.744ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = e653f18a-1eed-43b0-9944-11f884823aa1 roles = RoleSet { roles: {} } uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
12102024-12-14T01:15:19.744ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = e653f18a-1eed-43b0-9944-11f884823aa1 resource = Database result = Ok(()) uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
12112024-12-14T01:15:19.746ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = e653f18a-1eed-43b0-9944-11f884823aa1 roles = RoleSet { roles: {(Silo, 2c668072-a9a1-4a69-928c-e118c99521be, "admin")} } uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
12122024-12-14T01:15:19.749ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = e653f18a-1eed-43b0-9944-11f884823aa1 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 2c668072-a9a1-4a69-928c-e118c99521be, lookup_type: ById(2c668072-a9a1-4a69-928c-e118c99521be) }, key: 776ccd20-a853-4c93-af22-41ffed980f3e, lookup_type: ByName("proj-76656375e39") }, key: d008f4b2-6063-424c-a333-d54d35c8c058, lookup_type: ByName("instance-9b46092bdd0") } result = Ok(()) uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
12132024-12-14T01:15:19.749ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
12142024-12-14T01:15:19.749ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
12152024-12-14T01:15:19.751ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
12162024-12-14T01:15:19.752ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Fleet result = Ok(())
12172024-12-14T01:15:19.752ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
12182024-12-14T01:15:19.752ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
12192024-12-14T01:15:19.756ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = 87b0ff27-c08e-4927-a687-d6d4f5b38936 saga_name = instance-delete
12202024-12-14T01:15:19.756ZINFOnexus (SEC): saga create dag = {"end_node":5,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[4,0,null],[3,5,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"instance_delete.instance_delete_nat","label":"InstanceDeleteNat","name":"no_result4"}},{"Action":{"action_name":"instance_delete.instance_delete_record","label":"InstanceDeleteRecord","name":"no_result1"}},{"Action":{"action_name":"instance_delete.delete_network_interfaces","label":"DeleteNetworkInterfaces","name":"no_result2"}},{"Action":{"action_name":"instance_delete.deallocate_external_ip","label":"DeallocateExternalIp","name":"no_result3"}},{"Start":{"params":{"authz_instance":{"key":"d008f4b2-6063-424c-a333-d54d35c8c058","lookup_type":{"ByName":"instance-9b46092bdd0"},"parent":{"key":"776ccd20-a853-4c93-af22-41ffed980f3e","lookup_type":{"ByName":"proj-76656375e39"},"parent":{"key":"2c668072-a9a1-4a69-928c-e118c99521be","lookup_type":{"ById":"2c668072-a9a1-4a69-928c-e118c99521be"},"parent":null}}},"boundary_switches":["switch0"],"instance":{"auto_restart":{"cooldown":null,"policy":null},"boot_disk_id":"03cca168-b332-42b3-bd85-e17bd7884c8f","hostname":"localshark","identity":{"description":"","id":"d008f4b2-6063-424c-a333-d54d35c8c058","name":"instance-9b46092bdd0","time_created":"2024-12-14T01:14:55.295559Z","time_deleted":null,"time_modified":"2024-12-14T01:14:55.295559Z"},"memory":1073741824,"ncpus":2,"project_id":"776ccd20-a853-4c93-af22-41ffed980f3e","runtime_state":{"dst_propolis_id":null,"gen":4,"migration_id":null,"nexus_state":"NoVmm","propolis_id":null,"time_last_auto_restarted":null,"time_updated":"2024-12-14T01:15:18.459797Z"},"updater_gen":4,"updater_id":null,"user_data":[]},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"SiloUser":{"silo_id":"2c668072-a9a1-4a69-928c-e118c99521be","silo_user_id":"2896dd1a-5f1e-476b-86bb-db6c90fa385e"}}},{"mapped_fleet_roles":{"admin":["admin"]}}]}}}}},"End"]},"saga_name":"instance-delete","start_node":4} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = 87b0ff27-c08e-4927-a687-d6d4f5b38936 saga_name = instance-delete sec_id = ec66f35d-9dc5-46c1-80a1-ebaa91a8212a
12212024-12-14T01:15:19.756ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 87b0ff27-c08e-4927-a687-d6d4f5b38936 saga_name = instance-delete
12222024-12-14T01:15:19.760ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = 87b0ff27-c08e-4927-a687-d6d4f5b38936 saga_name = instance-delete
12232024-12-14T01:15:19.760ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = 87b0ff27-c08e-4927-a687-d6d4f5b38936 saga_name = instance-delete sec_id = ec66f35d-9dc5-46c1-80a1-ebaa91a8212a
12242024-12-14T01:15:19.760ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = ec66f35d-9dc5-46c1-80a1-ebaa91a8212a
12252024-12-14T01:15:19.760ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 87b0ff27-c08e-4927-a687-d6d4f5b38936
12262024-12-14T01:15:19.764ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = ec66f35d-9dc5-46c1-80a1-ebaa91a8212a
12272024-12-14T01:15:19.764ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = 87b0ff27-c08e-4927-a687-d6d4f5b38936
12282024-12-14T01:15:19.768ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = ec66f35d-9dc5-46c1-80a1-ebaa91a8212a
12292024-12-14T01:15:19.768ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 87b0ff27-c08e-4927-a687-d6d4f5b38936
12302024-12-14T01:15:19.771ZDEBGnexus (SagaExecutor): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true roles = RoleSet { roles: {} } saga_id = 87b0ff27-c08e-4927-a687-d6d4f5b38936 saga_name = instance-delete saga_node = InstanceDeleteNat
12312024-12-14T01:15:19.771ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true resource = Database result = Ok(()) saga_id = 87b0ff27-c08e-4927-a687-d6d4f5b38936 saga_name = instance-delete saga_node = InstanceDeleteNat
12322024-12-14T01:15:19.772ZDEBGnexus (SagaExecutor): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true roles = RoleSet { roles: {} } saga_id = 87b0ff27-c08e-4927-a687-d6d4f5b38936 saga_name = instance-delete saga_node = InstanceDeleteNat
12332024-12-14T01:15:19.773ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true resource = Database result = Ok(()) saga_id = 87b0ff27-c08e-4927-a687-d6d4f5b38936 saga_name = instance-delete saga_node = InstanceDeleteNat
12342024-12-14T01:15:19.774ZDEBGnexus (SagaExecutor): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true roles = RoleSet { roles: {} } saga_id = 87b0ff27-c08e-4927-a687-d6d4f5b38936 saga_name = instance-delete saga_node = InstanceDeleteNat
12352024-12-14T01:15:19.774ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true resource = Database result = Ok(()) saga_id = 87b0ff27-c08e-4927-a687-d6d4f5b38936 saga_name = instance-delete saga_node = InstanceDeleteNat
12362024-12-14T01:15:19.775ZDEBGnexus (SagaExecutor): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true roles = RoleSet { roles: {} } saga_id = 87b0ff27-c08e-4927-a687-d6d4f5b38936 saga_name = instance-delete saga_node = InstanceDeleteNat
12372024-12-14T01:15:19.775ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true resource = Database result = Ok(()) saga_id = 87b0ff27-c08e-4927-a687-d6d4f5b38936 saga_name = instance-delete saga_node = InstanceDeleteNat
12382024-12-14T01:15:19.777ZDEBGnexus (SagaExecutor): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true roles = RoleSet { roles: {} } saga_id = 87b0ff27-c08e-4927-a687-d6d4f5b38936 saga_name = instance-delete saga_node = InstanceDeleteNat
12392024-12-14T01:15:19.777ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true resource = Database result = Ok(()) saga_id = 87b0ff27-c08e-4927-a687-d6d4f5b38936 saga_name = instance-delete saga_node = InstanceDeleteNat
12402024-12-14T01:15:19.780ZDEBGnexus (SagaExecutor): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true roles = RoleSet { roles: {} } saga_id = 87b0ff27-c08e-4927-a687-d6d4f5b38936 saga_name = instance-delete saga_node = InstanceDeleteNat
12412024-12-14T01:15:19.780ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true resource = Database result = Ok(()) saga_id = 87b0ff27-c08e-4927-a687-d6d4f5b38936 saga_name = instance-delete saga_node = InstanceDeleteNat
12422024-12-14T01:15:19.783ZDEBGnexus (SagaExecutor): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true roles = RoleSet { roles: {} } saga_id = 87b0ff27-c08e-4927-a687-d6d4f5b38936 saga_name = instance-delete saga_node = InstanceDeleteNat
12432024-12-14T01:15:19.783ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true resource = Database result = Ok(()) saga_id = 87b0ff27-c08e-4927-a687-d6d4f5b38936 saga_name = instance-delete saga_node = InstanceDeleteNat
12442024-12-14T01:15:19.785ZDEBGnexus (SagaExecutor): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true roles = RoleSet { roles: {(Silo, 2c668072-a9a1-4a69-928c-e118c99521be, "admin")} } saga_id = 87b0ff27-c08e-4927-a687-d6d4f5b38936 saga_name = instance-delete saga_node = InstanceDeleteNat
12452024-12-14T01:15:19.788ZDEBGnexus (SagaExecutor): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 2c668072-a9a1-4a69-928c-e118c99521be, lookup_type: ById(2c668072-a9a1-4a69-928c-e118c99521be) }, key: 776ccd20-a853-4c93-af22-41ffed980f3e, lookup_type: ById(776ccd20-a853-4c93-af22-41ffed980f3e) }, key: d008f4b2-6063-424c-a333-d54d35c8c058, lookup_type: ById(d008f4b2-6063-424c-a333-d54d35c8c058) } result = Ok(()) saga_id = 87b0ff27-c08e-4927-a687-d6d4f5b38936 saga_name = instance-delete saga_node = InstanceDeleteNat
12462024-12-14T01:15:19.788ZINFOnexus: deleting instance dpd configuration file = nexus/src/app/instance_network.rs:548 instance_id = d008f4b2-6063-424c-a333-d54d35c8c058
12472024-12-14T01:15:19.788ZDEBGnexus (SagaExecutor): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true roles = RoleSet { roles: {} } saga_id = 87b0ff27-c08e-4927-a687-d6d4f5b38936 saga_name = instance-delete saga_node = InstanceDeleteNat
12482024-12-14T01:15:19.788ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true resource = Database result = Ok(()) saga_id = 87b0ff27-c08e-4927-a687-d6d4f5b38936 saga_name = instance-delete saga_node = InstanceDeleteNat
12492024-12-14T01:15:19.790ZDEBGnexus (SagaExecutor): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true roles = RoleSet { roles: {} } saga_id = 87b0ff27-c08e-4927-a687-d6d4f5b38936 saga_name = instance-delete saga_node = InstanceDeleteNat
12502024-12-14T01:15:19.791ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true resource = Database result = Ok(()) saga_id = 87b0ff27-c08e-4927-a687-d6d4f5b38936 saga_name = instance-delete saga_node = InstanceDeleteNat
12512024-12-14T01:15:19.792ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
12522024-12-14T01:15:19.792ZDEBGnexus (SagaExecutor): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true roles = RoleSet { roles: {} } saga_id = 87b0ff27-c08e-4927-a687-d6d4f5b38936 saga_name = instance-delete saga_node = InstanceDeleteNat
12532024-12-14T01:15:19.792ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true resource = Database result = Ok(()) saga_id = 87b0ff27-c08e-4927-a687-d6d4f5b38936 saga_name = instance-delete saga_node = InstanceDeleteNat
12542024-12-14T01:15:19.794ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
12552024-12-14T01:15:19.794ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
12562024-12-14T01:15:19.795ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
12572024-12-14T01:15:19.796ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
12582024-12-14T01:15:19.797ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Fleet result = Ok(())
12592024-12-14T01:15:19.797ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
12602024-12-14T01:15:19.797ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
12612024-12-14T01:15:19.800ZDEBGnexus: notifying dendrite of updates instance_id = Some(d008f4b2-6063-424c-a333-d54d35c8c058 (instance)) switch = switch0
12622024-12-14T01:15:19.801ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-7e423e95-464a-471f-a0d9-4799977f0b0f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-7e423e95-464a-471f-a0d9-4799977f0b0f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1482, tv_nsec: 630157935 } })
12632024-12-14T01:15:19.801ZINFOnexus: Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1103
12642024-12-14T01:15:19.832ZINFOnexus: determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
12652024-12-14T01:15:19.832ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
12662024-12-14T01:15:19.832ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a7bacc8b-9f87-49ef-9921-83f6e9536343", "content-length": "26", "date": "Sat, 14 Dec 2024 01:15:19 GMT"} })
12672024-12-14T01:15:19.832ZINFOnexus: identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
12682024-12-14T01:15:19.833ZINFOnexus: completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
12692024-12-14T01:15:19.862ZDEBGnexus (DpdClient): client request body = None method = POST uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger
12702024-12-14T01:15:19.862ZDEBGnexus (DpdClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger", status: 200, headers: {"content-type": "application/json", "x-request-id": "576e50e9-8ccb-421c-81b6-6ff2a5847ebd", "content-length": "4", "date": "Sat, 14 Dec 2024 01:15:18 GMT"} })
12712024-12-14T01:15:19.865ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = ec66f35d-9dc5-46c1-80a1-ebaa91a8212a
12722024-12-14T01:15:19.865ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 0 saga_id = 87b0ff27-c08e-4927-a687-d6d4f5b38936
12732024-12-14T01:15:19.868ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = ec66f35d-9dc5-46c1-80a1-ebaa91a8212a
12742024-12-14T01:15:19.868ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 87b0ff27-c08e-4927-a687-d6d4f5b38936
12752024-12-14T01:15:19.871ZDEBGnexus (SagaExecutor): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true roles = RoleSet { roles: {} } saga_id = 87b0ff27-c08e-4927-a687-d6d4f5b38936 saga_name = instance-delete saga_node = InstanceDeleteRecord
12762024-12-14T01:15:19.871ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true resource = Database result = Ok(()) saga_id = 87b0ff27-c08e-4927-a687-d6d4f5b38936 saga_name = instance-delete saga_node = InstanceDeleteRecord
12772024-12-14T01:15:19.873ZDEBGnexus (SagaExecutor): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true roles = RoleSet { roles: {} } saga_id = 87b0ff27-c08e-4927-a687-d6d4f5b38936 saga_name = instance-delete saga_node = InstanceDeleteRecord
12782024-12-14T01:15:19.874ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true resource = Database result = Ok(()) saga_id = 87b0ff27-c08e-4927-a687-d6d4f5b38936 saga_name = instance-delete saga_node = InstanceDeleteRecord
12792024-12-14T01:15:19.876ZDEBGnexus (SagaExecutor): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true roles = RoleSet { roles: {} } saga_id = 87b0ff27-c08e-4927-a687-d6d4f5b38936 saga_name = instance-delete saga_node = InstanceDeleteRecord
12802024-12-14T01:15:19.876ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true resource = Database result = Ok(()) saga_id = 87b0ff27-c08e-4927-a687-d6d4f5b38936 saga_name = instance-delete saga_node = InstanceDeleteRecord
12812024-12-14T01:15:19.879ZDEBGnexus (SagaExecutor): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true roles = RoleSet { roles: {} } saga_id = 87b0ff27-c08e-4927-a687-d6d4f5b38936 saga_name = instance-delete saga_node = InstanceDeleteRecord
12822024-12-14T01:15:19.879ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true resource = Database result = Ok(()) saga_id = 87b0ff27-c08e-4927-a687-d6d4f5b38936 saga_name = instance-delete saga_node = InstanceDeleteRecord
12832024-12-14T01:15:19.881ZDEBGnexus (SagaExecutor): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true roles = RoleSet { roles: {(Silo, 2c668072-a9a1-4a69-928c-e118c99521be, "admin")} } saga_id = 87b0ff27-c08e-4927-a687-d6d4f5b38936 saga_name = instance-delete saga_node = InstanceDeleteRecord
12842024-12-14T01:15:19.884ZDEBGnexus (SagaExecutor): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 2c668072-a9a1-4a69-928c-e118c99521be, lookup_type: ById(2c668072-a9a1-4a69-928c-e118c99521be) }, key: 776ccd20-a853-4c93-af22-41ffed980f3e, lookup_type: ByName("proj-76656375e39") }, key: d008f4b2-6063-424c-a333-d54d35c8c058, lookup_type: ByName("instance-9b46092bdd0") } result = Ok(()) saga_id = 87b0ff27-c08e-4927-a687-d6d4f5b38936 saga_name = instance-delete saga_node = InstanceDeleteRecord
12852024-12-14T01:15:19.884ZDEBGnexus (SagaExecutor): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true roles = RoleSet { roles: {} } saga_id = 87b0ff27-c08e-4927-a687-d6d4f5b38936 saga_name = instance-delete saga_node = InstanceDeleteRecord
12862024-12-14T01:15:19.884ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true resource = Database result = Ok(()) saga_id = 87b0ff27-c08e-4927-a687-d6d4f5b38936 saga_name = instance-delete saga_node = InstanceDeleteRecord
12872024-12-14T01:15:19.965ZDEBGnexus (SagaExecutor): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true roles = RoleSet { roles: {} } saga_id = 87b0ff27-c08e-4927-a687-d6d4f5b38936 saga_name = instance-delete saga_node = InstanceDeleteRecord
12882024-12-14T01:15:19.965ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true resource = Database result = Ok(()) saga_id = 87b0ff27-c08e-4927-a687-d6d4f5b38936 saga_name = instance-delete saga_node = InstanceDeleteRecord
12892024-12-14T01:15:19.973ZDEBGnexus (SagaExecutor): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true roles = RoleSet { roles: {} } saga_id = 87b0ff27-c08e-4927-a687-d6d4f5b38936 saga_name = instance-delete saga_node = InstanceDeleteRecord
12902024-12-14T01:15:19.974ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true resource = Database result = Ok(()) saga_id = 87b0ff27-c08e-4927-a687-d6d4f5b38936 saga_name = instance-delete saga_node = InstanceDeleteRecord
12912024-12-14T01:15:19.976ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = ec66f35d-9dc5-46c1-80a1-ebaa91a8212a
12922024-12-14T01:15:19.976ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 1 saga_id = 87b0ff27-c08e-4927-a687-d6d4f5b38936
12932024-12-14T01:15:19.980ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = ec66f35d-9dc5-46c1-80a1-ebaa91a8212a
12942024-12-14T01:15:19.980ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 87b0ff27-c08e-4927-a687-d6d4f5b38936
12952024-12-14T01:15:19.983ZDEBGnexus (SagaExecutor): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true roles = RoleSet { roles: {} } saga_id = 87b0ff27-c08e-4927-a687-d6d4f5b38936 saga_name = instance-delete saga_node = DeleteNetworkInterfaces
12962024-12-14T01:15:19.984ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true resource = Database result = Ok(()) saga_id = 87b0ff27-c08e-4927-a687-d6d4f5b38936 saga_name = instance-delete saga_node = DeleteNetworkInterfaces
12972024-12-14T01:15:19.985ZDEBGnexus (SagaExecutor): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true roles = RoleSet { roles: {} } saga_id = 87b0ff27-c08e-4927-a687-d6d4f5b38936 saga_name = instance-delete saga_node = DeleteNetworkInterfaces
12982024-12-14T01:15:19.986ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true resource = Database result = Ok(()) saga_id = 87b0ff27-c08e-4927-a687-d6d4f5b38936 saga_name = instance-delete saga_node = DeleteNetworkInterfaces
12992024-12-14T01:15:19.988ZDEBGnexus (SagaExecutor): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true roles = RoleSet { roles: {} } saga_id = 87b0ff27-c08e-4927-a687-d6d4f5b38936 saga_name = instance-delete saga_node = DeleteNetworkInterfaces
13002024-12-14T01:15:19.988ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true resource = Database result = Ok(()) saga_id = 87b0ff27-c08e-4927-a687-d6d4f5b38936 saga_name = instance-delete saga_node = DeleteNetworkInterfaces
13012024-12-14T01:15:19.991ZDEBGnexus (SagaExecutor): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true roles = RoleSet { roles: {} } saga_id = 87b0ff27-c08e-4927-a687-d6d4f5b38936 saga_name = instance-delete saga_node = DeleteNetworkInterfaces
13022024-12-14T01:15:19.991ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true resource = Database result = Ok(()) saga_id = 87b0ff27-c08e-4927-a687-d6d4f5b38936 saga_name = instance-delete saga_node = DeleteNetworkInterfaces
13032024-12-14T01:15:19.993ZDEBGnexus (SagaExecutor): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true roles = RoleSet { roles: {(Silo, 2c668072-a9a1-4a69-928c-e118c99521be, "admin")} } saga_id = 87b0ff27-c08e-4927-a687-d6d4f5b38936 saga_name = instance-delete saga_node = DeleteNetworkInterfaces
13042024-12-14T01:15:19.996ZDEBGnexus (SagaExecutor): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 2c668072-a9a1-4a69-928c-e118c99521be, lookup_type: ById(2c668072-a9a1-4a69-928c-e118c99521be) }, key: 776ccd20-a853-4c93-af22-41ffed980f3e, lookup_type: ByName("proj-76656375e39") }, key: d008f4b2-6063-424c-a333-d54d35c8c058, lookup_type: ByName("instance-9b46092bdd0") } result = Ok(()) saga_id = 87b0ff27-c08e-4927-a687-d6d4f5b38936 saga_name = instance-delete saga_node = DeleteNetworkInterfaces
13052024-12-14T01:15:19.996ZDEBGnexus (SagaExecutor): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true roles = RoleSet { roles: {} } saga_id = 87b0ff27-c08e-4927-a687-d6d4f5b38936 saga_name = instance-delete saga_node = DeleteNetworkInterfaces
13062024-12-14T01:15:19.996ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true resource = Database result = Ok(()) saga_id = 87b0ff27-c08e-4927-a687-d6d4f5b38936 saga_name = instance-delete saga_node = DeleteNetworkInterfaces
13072024-12-14T01:15:20.003ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = ec66f35d-9dc5-46c1-80a1-ebaa91a8212a
13082024-12-14T01:15:20.003ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 2 saga_id = 87b0ff27-c08e-4927-a687-d6d4f5b38936
13092024-12-14T01:15:20.003ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 26 reason = Signaled
13102024-12-14T01:15:20.003ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
13112024-12-14T01:15:20.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
13122024-12-14T01:15:20.006ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = ec66f35d-9dc5-46c1-80a1-ebaa91a8212a
13132024-12-14T01:15:20.006ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 87b0ff27-c08e-4927-a687-d6d4f5b38936
13142024-12-14T01:15:20.010ZDEBGnexus (SagaExecutor): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true roles = RoleSet { roles: {} } saga_id = 87b0ff27-c08e-4927-a687-d6d4f5b38936 saga_name = instance-delete saga_node = DeallocateExternalIp
13152024-12-14T01:15:20.010ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true resource = Database result = Ok(()) saga_id = 87b0ff27-c08e-4927-a687-d6d4f5b38936 saga_name = instance-delete saga_node = DeallocateExternalIp
13162024-12-14T01:15:20.015ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
13172024-12-14T01:15:20.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
13182024-12-14T01:15:20.044ZDEBGnexus (SagaExecutor): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true roles = RoleSet { roles: {} } saga_id = 87b0ff27-c08e-4927-a687-d6d4f5b38936 saga_name = instance-delete saga_node = DeallocateExternalIp
13192024-12-14T01:15:20.044ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true resource = Database result = Ok(()) saga_id = 87b0ff27-c08e-4927-a687-d6d4f5b38936 saga_name = instance-delete saga_node = DeallocateExternalIp
13202024-12-14T01:15:20.048ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = ec66f35d-9dc5-46c1-80a1-ebaa91a8212a
13212024-12-14T01:15:20.048ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = 87b0ff27-c08e-4927-a687-d6d4f5b38936
13222024-12-14T01:15:20.052ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = ec66f35d-9dc5-46c1-80a1-ebaa91a8212a
13232024-12-14T01:15:20.052ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = 87b0ff27-c08e-4927-a687-d6d4f5b38936
13242024-12-14T01:15:20.058ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = ec66f35d-9dc5-46c1-80a1-ebaa91a8212a
13252024-12-14T01:15:20.058ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = 87b0ff27-c08e-4927-a687-d6d4f5b38936
13262024-12-14T01:15:20.062ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 87b0ff27-c08e-4927-a687-d6d4f5b38936 sec_id = ec66f35d-9dc5-46c1-80a1-ebaa91a8212a
13272024-12-14T01:15:20.062ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 87b0ff27-c08e-4927-a687-d6d4f5b38936
13282024-12-14T01:15:20.082ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
13292024-12-14T01:15:20.082ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
13302024-12-14T01:15:20.083ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13312024-12-14T01:15:20.085ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
13322024-12-14T01:15:20.085ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
13332024-12-14T01:15:20.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
13342024-12-14T01:15:20.087ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13352024-12-14T01:15:20.088ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
13362024-12-14T01:15:20.089ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
13372024-12-14T01:15:20.089ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
13382024-12-14T01:15:20.105ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = 87b0ff27-c08e-4927-a687-d6d4f5b38936 saga_name = instance-delete sec_id = ec66f35d-9dc5-46c1-80a1-ebaa91a8212a
13392024-12-14T01:15:20.105ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = 87b0ff27-c08e-4927-a687-d6d4f5b38936 saga_name = instance-delete saga_result = SagaResult { saga_id: 87b0ff27-c08e-4927-a687-d6d4f5b38936, saga_log: SagaLog { saga_id: 87b0ff27-c08e-4927-a687-d6d4f5b38936, unwinding: false, events: [N004 started, N004 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N005 started, N005 succeeded], node_status: {0: Succeeded(Null), 1: Succeeded(Null), 2: Succeeded(Null), 3: Succeeded(Null), 4: Succeeded(Null), 5: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"no_result1": Null, "no_result2": Null, "no_result3": Null, "no_result4": Null} }) }
13402024-12-14T01:15:20.105ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 26 reason = Signaled
13412024-12-14T01:15:20.105ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
13422024-12-14T01:15:20.105ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 408729 local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = e653f18a-1eed-43b0-9944-11f884823aa1 response_code = 204 uri = /v1/instances/instance-9b46092bdd0?project=proj-76656375e39
13432024-12-14T01:15:20.105ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13442024-12-14T01:15:20.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13452024-12-14T01:15:20.106ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
13462024-12-14T01:15:20.107ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
13472024-12-14T01:15:20.107ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13482024-12-14T01:15:20.108ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
13492024-12-14T01:15:20.108ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
13502024-12-14T01:15:20.109ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
13512024-12-14T01:15:20.109ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13522024-12-14T01:15:20.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13532024-12-14T01:15:20.109ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
13542024-12-14T01:15:20.111ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "4c27b5375e7db4012b4e50525f017d0aef13b0d1", lookup_type: ByCompositeId("token = \\"4c27b5375e7db4012b4e50525f017d0aef13b0d1\\"") } result = Ok(())
13552024-12-14T01:15:20.111ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
13562024-12-14T01:15:20.111ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13572024-12-14T01:15:20.111ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
13582024-12-14T01:15:20.112ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
13592024-12-14T01:15:20.112ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13602024-12-14T01:15:20.113ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13612024-12-14T01:15:20.122ZDEBGnexus (BackgroundTasks): client request SledAgent = 7e423e95-464a-471f-a0d9-4799977f0b0f background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
13622024-12-14T01:15:20.122ZDEBGnexus (BackgroundTasks): client response SledAgent = 7e423e95-464a-471f-a0d9-4799977f0b0f background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "e455d4c0-56d9-4e0d-a9f0-c69735b25ce7", "content-length": "691", "date": "Sat, 14 Dec 2024 01:15:20 GMT"} })
13632024-12-14T01:15:20.122ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
13642024-12-14T01:15:20.122ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
13652024-12-14T01:15:20.122ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
13662024-12-14T01:15:20.124ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
13672024-12-14T01:15:20.124ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
13682024-12-14T01:15:20.124ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 120.785655ms iteration = 26 status = {}
13692024-12-14T01:15:20.125ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
13702024-12-14T01:15:20.126ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
13712024-12-14T01:15:20.126ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
13722024-12-14T01:15:20.127ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
13732024-12-14T01:15:20.128ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
13742024-12-14T01:15:20.129ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 2c668072-a9a1-4a69-928c-e118c99521be, lookup_type: ById(2c668072-a9a1-4a69-928c-e118c99521be) }, key: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, lookup_type: ById(2896dd1a-5f1e-476b-86bb-db6c90fa385e) } result = Ok(())
13752024-12-14T01:15:20.129ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
13762024-12-14T01:15:20.129ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
13772024-12-14T01:15:20.131ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
13782024-12-14T01:15:20.132ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "4c27b5375e7db4012b4e50525f017d0aef13b0d1", lookup_type: ByCompositeId("4c27b5375e7db4012b4e50525f017d0aef13b0d1") } result = Ok(())
13792024-12-14T01:15:20.132ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
13802024-12-14T01:15:20.132ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
13812024-12-14T01:15:20.155ZINFOnexus (BackgroundTasks): VPC route manager sled 7e423e95-464a-471f-a0d9-4799977f0b0f background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
13822024-12-14T01:15:20.155ZDEBGnexus (BackgroundTasks): client request SledAgent = 7e423e95-464a-471f-a0d9-4799977f0b0f background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
13832024-12-14T01:15:20.155ZDEBGnexus (BackgroundTasks): client response SledAgent = 7e423e95-464a-471f-a0d9-4799977f0b0f background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "8d7e3930-b7d5-4295-ac09-2f60d107f1a1", "content-length": "372", "date": "Sat, 14 Dec 2024 01:15:20 GMT"} })
13842024-12-14T01:15:20.155ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13852024-12-14T01:15:20.156ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13862024-12-14T01:15:20.160ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
13872024-12-14T01:15:20.160ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
13882024-12-14T01:15:20.161ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
13892024-12-14T01:15:20.161ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
13902024-12-14T01:15:20.163ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
13912024-12-14T01:15:20.163ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
13922024-12-14T01:15:20.164ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
13932024-12-14T01:15:20.164ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
13942024-12-14T01:15:20.166ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
13952024-12-14T01:15:20.167ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 2c668072-a9a1-4a69-928c-e118c99521be, lookup_type: ById(2c668072-a9a1-4a69-928c-e118c99521be) }, key: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, lookup_type: ById(2896dd1a-5f1e-476b-86bb-db6c90fa385e) } result = Ok(())
13962024-12-14T01:15:20.167ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
13972024-12-14T01:15:20.167ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
13982024-12-14T01:15:20.169ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
13992024-12-14T01:15:20.169ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
14002024-12-14T01:15:20.169ZDEBGnexus (BackgroundTasks): client request SledAgent = 7e423e95-464a-471f-a0d9-4799977f0b0f background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
14012024-12-14T01:15:20.169ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
14022024-12-14T01:15:20.169ZDEBGnexus (BackgroundTasks): client response SledAgent = 7e423e95-464a-471f-a0d9-4799977f0b0f background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "99ba0e1f-2cd0-43a7-9e65-684632cc71ed", "date": "Sat, 14 Dec 2024 01:15:20 GMT"} })
14032024-12-14T01:15:20.169ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14042024-12-14T01:15:20.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14052024-12-14T01:15:20.170ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
14062024-12-14T01:15:20.170ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
14072024-12-14T01:15:20.171ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14082024-12-14T01:15:20.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14092024-12-14T01:15:20.172ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
14102024-12-14T01:15:20.173ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 2c668072-a9a1-4a69-928c-e118c99521be, lookup_type: ById(2c668072-a9a1-4a69-928c-e118c99521be) } result = Ok(())
14112024-12-14T01:15:20.173ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 28f7a3b6-9044-4fdc-b545-f0a8971d37fe roles = RoleSet { roles: {} } uri = /v1/disks/disk-e45a2f373a8?project=proj-76656375e39
14122024-12-14T01:15:20.173ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 28f7a3b6-9044-4fdc-b545-f0a8971d37fe resource = Database result = Ok(()) uri = /v1/disks/disk-e45a2f373a8?project=proj-76656375e39
14132024-12-14T01:15:20.173ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14142024-12-14T01:15:20.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14152024-12-14T01:15:20.174ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 28f7a3b6-9044-4fdc-b545-f0a8971d37fe roles = RoleSet { roles: {} } uri = /v1/disks/disk-e45a2f373a8?project=proj-76656375e39
14162024-12-14T01:15:20.175ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 28f7a3b6-9044-4fdc-b545-f0a8971d37fe resource = Database result = Ok(()) uri = /v1/disks/disk-e45a2f373a8?project=proj-76656375e39
14172024-12-14T01:15:20.175ZINFOnexus (BackgroundTasks): VPC route manager sled 7e423e95-464a-471f-a0d9-4799977f0b0f push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
14182024-12-14T01:15:20.175ZDEBGnexus (BackgroundTasks): client request SledAgent = 7e423e95-464a-471f-a0d9-4799977f0b0f background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
14192024-12-14T01:15:20.176ZDEBGnexus (BackgroundTasks): client response SledAgent = 7e423e95-464a-471f-a0d9-4799977f0b0f background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "3771764b-4b6e-4e88-b300-226fb48aebd1", "date": "Sat, 14 Dec 2024 01:15:20 GMT"} })
14202024-12-14T01:15:20.176ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 28f7a3b6-9044-4fdc-b545-f0a8971d37fe roles = RoleSet { roles: {} } uri = /v1/disks/disk-e45a2f373a8?project=proj-76656375e39
14212024-12-14T01:15:20.176ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 28f7a3b6-9044-4fdc-b545-f0a8971d37fe resource = Database result = Ok(()) uri = /v1/disks/disk-e45a2f373a8?project=proj-76656375e39
14222024-12-14T01:15:20.177ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 71.913671ms iteration = 26 status = {}
14232024-12-14T01:15:20.178ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 28f7a3b6-9044-4fdc-b545-f0a8971d37fe roles = RoleSet { roles: {} } uri = /v1/disks/disk-e45a2f373a8?project=proj-76656375e39
14242024-12-14T01:15:20.178ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 28f7a3b6-9044-4fdc-b545-f0a8971d37fe resource = Database result = Ok(()) uri = /v1/disks/disk-e45a2f373a8?project=proj-76656375e39
14252024-12-14T01:15:20.181ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 28f7a3b6-9044-4fdc-b545-f0a8971d37fe roles = RoleSet { roles: {} } uri = /v1/disks/disk-e45a2f373a8?project=proj-76656375e39
14262024-12-14T01:15:20.181ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 28f7a3b6-9044-4fdc-b545-f0a8971d37fe resource = Database result = Ok(()) uri = /v1/disks/disk-e45a2f373a8?project=proj-76656375e39
14272024-12-14T01:15:20.183ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 28f7a3b6-9044-4fdc-b545-f0a8971d37fe roles = RoleSet { roles: {} } uri = /v1/disks/disk-e45a2f373a8?project=proj-76656375e39
14282024-12-14T01:15:20.183ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 28f7a3b6-9044-4fdc-b545-f0a8971d37fe resource = Database result = Ok(()) uri = /v1/disks/disk-e45a2f373a8?project=proj-76656375e39
14292024-12-14T01:15:20.185ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 28f7a3b6-9044-4fdc-b545-f0a8971d37fe roles = RoleSet { roles: {} } uri = /v1/disks/disk-e45a2f373a8?project=proj-76656375e39
14302024-12-14T01:15:20.185ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 28f7a3b6-9044-4fdc-b545-f0a8971d37fe resource = Database result = Ok(()) uri = /v1/disks/disk-e45a2f373a8?project=proj-76656375e39
14312024-12-14T01:15:20.187ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 28f7a3b6-9044-4fdc-b545-f0a8971d37fe roles = RoleSet { roles: {(Silo, 2c668072-a9a1-4a69-928c-e118c99521be, "admin")} } uri = /v1/disks/disk-e45a2f373a8?project=proj-76656375e39
14322024-12-14T01:15:20.190ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 28f7a3b6-9044-4fdc-b545-f0a8971d37fe resource = Disk { parent: Project { parent: Silo { parent: Fleet, key: 2c668072-a9a1-4a69-928c-e118c99521be, lookup_type: ById(2c668072-a9a1-4a69-928c-e118c99521be) }, key: 776ccd20-a853-4c93-af22-41ffed980f3e, lookup_type: ByName("proj-76656375e39") }, key: 03cca168-b332-42b3-bd85-e17bd7884c8f, lookup_type: ByName("disk-e45a2f373a8") } result = Ok(()) uri = /v1/disks/disk-e45a2f373a8?project=proj-76656375e39
14332024-12-14T01:15:20.190ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 28f7a3b6-9044-4fdc-b545-f0a8971d37fe roles = RoleSet { roles: {} } uri = /v1/disks/disk-e45a2f373a8?project=proj-76656375e39
14342024-12-14T01:15:20.190ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 28f7a3b6-9044-4fdc-b545-f0a8971d37fe resource = Database result = Ok(()) uri = /v1/disks/disk-e45a2f373a8?project=proj-76656375e39
14352024-12-14T01:15:20.192ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 28f7a3b6-9044-4fdc-b545-f0a8971d37fe roles = RoleSet { roles: {} } uri = /v1/disks/disk-e45a2f373a8?project=proj-76656375e39
14362024-12-14T01:15:20.192ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 28f7a3b6-9044-4fdc-b545-f0a8971d37fe resource = Database result = Ok(()) uri = /v1/disks/disk-e45a2f373a8?project=proj-76656375e39
14372024-12-14T01:15:20.193ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 28f7a3b6-9044-4fdc-b545-f0a8971d37fe roles = RoleSet { roles: {} } uri = /v1/disks/disk-e45a2f373a8?project=proj-76656375e39
14382024-12-14T01:15:20.193ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 28f7a3b6-9044-4fdc-b545-f0a8971d37fe resource = Database result = Ok(()) uri = /v1/disks/disk-e45a2f373a8?project=proj-76656375e39
14392024-12-14T01:15:20.194ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 28f7a3b6-9044-4fdc-b545-f0a8971d37fe roles = RoleSet { roles: {} } uri = /v1/disks/disk-e45a2f373a8?project=proj-76656375e39
14402024-12-14T01:15:20.195ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 28f7a3b6-9044-4fdc-b545-f0a8971d37fe resource = Database result = Ok(()) uri = /v1/disks/disk-e45a2f373a8?project=proj-76656375e39
14412024-12-14T01:15:20.196ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 28f7a3b6-9044-4fdc-b545-f0a8971d37fe roles = RoleSet { roles: {} } uri = /v1/disks/disk-e45a2f373a8?project=proj-76656375e39
14422024-12-14T01:15:20.196ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 28f7a3b6-9044-4fdc-b545-f0a8971d37fe resource = Database result = Ok(()) uri = /v1/disks/disk-e45a2f373a8?project=proj-76656375e39
14432024-12-14T01:15:20.198ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 28f7a3b6-9044-4fdc-b545-f0a8971d37fe roles = RoleSet { roles: {} } uri = /v1/disks/disk-e45a2f373a8?project=proj-76656375e39
14442024-12-14T01:15:20.198ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 28f7a3b6-9044-4fdc-b545-f0a8971d37fe resource = Database result = Ok(()) uri = /v1/disks/disk-e45a2f373a8?project=proj-76656375e39
14452024-12-14T01:15:20.201ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 28f7a3b6-9044-4fdc-b545-f0a8971d37fe roles = RoleSet { roles: {} } uri = /v1/disks/disk-e45a2f373a8?project=proj-76656375e39
14462024-12-14T01:15:20.201ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 28f7a3b6-9044-4fdc-b545-f0a8971d37fe resource = Database result = Ok(()) uri = /v1/disks/disk-e45a2f373a8?project=proj-76656375e39
14472024-12-14T01:15:20.203ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 28f7a3b6-9044-4fdc-b545-f0a8971d37fe roles = RoleSet { roles: {(Silo, 2c668072-a9a1-4a69-928c-e118c99521be, "admin")} } uri = /v1/disks/disk-e45a2f373a8?project=proj-76656375e39
14482024-12-14T01:15:20.206ZDEBGnexus (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 28f7a3b6-9044-4fdc-b545-f0a8971d37fe resource = Disk { parent: Project { parent: Silo { parent: Fleet, key: 2c668072-a9a1-4a69-928c-e118c99521be, lookup_type: ById(2c668072-a9a1-4a69-928c-e118c99521be) }, key: 776ccd20-a853-4c93-af22-41ffed980f3e, lookup_type: ById(776ccd20-a853-4c93-af22-41ffed980f3e) }, key: 03cca168-b332-42b3-bd85-e17bd7884c8f, lookup_type: ById(03cca168-b332-42b3-bd85-e17bd7884c8f) } result = Ok(()) uri = /v1/disks/disk-e45a2f373a8?project=proj-76656375e39
14492024-12-14T01:15:20.206ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = bc519d71-5839-49a8-a9b3-427ef59bfe73 saga_name = disk-delete
14502024-12-14T01:15:20.206ZINFOnexus (SEC): saga create dag = {"end_node":14,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[4,5,null],[4,6,null],[6,7,null],[5,7,null],[7,8,null],[8,9,null],[9,10,null],[10,11,null],[3,4,null],[11,12,null],[13,0,null],[12,14,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"disk_delete.delete_disk_record","label":"DeleteDiskRecord","name":"deleted_disk"}},{"Action":{"action_name":"disk_delete.space_account","label":"SpaceAccount","name":"no_result1"}},{"Constant":{"name":"params_for_volume_delete_subsaga","value":{"serialized_authn":{"kind":{"Authenticated":[{"actor":{"SiloUser":{"silo_id":"2c668072-a9a1-4a69-928c-e118c99521be","silo_user_id":"2896dd1a-5f1e-476b-86bb-db6c90fa385e"}}},{"mapped_fleet_roles":{"admin":["admin"]}}]}},"volume_id":"e5fa68ba-b69f-4421-98bb-c8880cb66b6c"}}},{"SubsagaStart":{"params_node_name":"params_for_volume_delete_subsaga","saga_name":"volume-delete"}},{"Action":{"action_name":"volume_delete.decrease_crucible_resource_count","label":"DecreaseCrucibleResourceCount","name":"crucible_resources_to_delete"}},{"Action":{"action_name":"volume_delete.delete_crucible_regions","label":"DeleteCrucibleRegions","name":"no_result_1"}},{"Action":{"action_name":"volume_delete.delete_crucible_running_snapshots","label":"DeleteCrucibleRunningSnapshots","name":"no_result_2"}},{"Action":{"action_name":"volume_delete.delete_crucible_snapshots","label":"DeleteCrucibleSnapshots","name":"no_result_3"}},{"Action":{"action_name":"volume_delete.delete_crucible_snapshot_records","label":"DeleteCrucibleSnapshotRecords","name":"no_result_4"}},{"Action":{"action_name":"volume_delete.find_freed_crucible_regions","label":"FindFreedCrucibleRegions","name":"freed_crucible_regions"}},{"Action":{"action_name":"volume_delete.delete_freed_crucible_regions","label":"DeleteFreedCrucibleRegions","name":"no_result_5"}},{"Action":{"action_name":"volume_delete.hard_delete_volume_record","label":"HardDeleteVolumeRecord","name":"volume_hard_deleted"}},{"SubsagaEnd":{"name":"volume_delete_subsaga_no_result"}},{"Start":{"params":{"disk_id":"03cca168-b332-42b3-bd85-e17bd7884c8f","project_id":"776ccd20-a853-4c93-af22-41ffed980f3e","serialized_authn":{"kind":{"Authenticated":[{"actor":{"SiloUser":{"silo_id":"2c668072-a9a1-4a69-928c-e118c99521be","silo_user_id":"2896dd1a-5f1e-476b-86bb-db6c90fa385e"}}},{"mapped_fleet_roles":{"admin":["admin"]}}]}},"volume_id":"e5fa68ba-b69f-4421-98bb-c8880cb66b6c"}}},"End"]},"saga_name":"disk-delete","start_node":13} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = bc519d71-5839-49a8-a9b3-427ef59bfe73 saga_name = disk-delete sec_id = ec66f35d-9dc5-46c1-80a1-ebaa91a8212a
14512024-12-14T01:15:20.206ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = bc519d71-5839-49a8-a9b3-427ef59bfe73 saga_name = disk-delete
14522024-12-14T01:15:20.211ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = bc519d71-5839-49a8-a9b3-427ef59bfe73 saga_name = disk-delete
14532024-12-14T01:15:20.211ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = bc519d71-5839-49a8-a9b3-427ef59bfe73 saga_name = disk-delete sec_id = ec66f35d-9dc5-46c1-80a1-ebaa91a8212a
14542024-12-14T01:15:20.211ZDEBGnexus (SEC): saga log event new_state = N013 started sec_id = ec66f35d-9dc5-46c1-80a1-ebaa91a8212a
14552024-12-14T01:15:20.211ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 13 saga_id = bc519d71-5839-49a8-a9b3-427ef59bfe73
14562024-12-14T01:15:20.215ZDEBGnexus (SEC): saga log event new_state = N013 succeeded sec_id = ec66f35d-9dc5-46c1-80a1-ebaa91a8212a
14572024-12-14T01:15:20.215ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 13 saga_id = bc519d71-5839-49a8-a9b3-427ef59bfe73
14582024-12-14T01:15:20.218ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = ec66f35d-9dc5-46c1-80a1-ebaa91a8212a
14592024-12-14T01:15:20.218ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = bc519d71-5839-49a8-a9b3-427ef59bfe73
14602024-12-14T01:15:20.230ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = ec66f35d-9dc5-46c1-80a1-ebaa91a8212a
14612024-12-14T01:15:20.230ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"block_size": String("Traditional"), "create_image_id": String("69e9eb03-3dc0-4220-9d21-3e637de439be"), "create_snapshot_id": Null, "identity": Object {"description": String(""), "id": String("03cca168-b332-42b3-bd85-e17bd7884c8f"), "name": String("disk-e45a2f373a8"), "time_created": String("2024-12-14T01:14:54.048548Z"), "time_deleted": Null, "time_modified": String("2024-12-14T01:14:54.048548Z")}, "pantry_address": Null, "project_id": String("776ccd20-a853-4c93-af22-41ffed980f3e"), "rcgen": Number(1), "runtime_state": Object {"attach_instance_id": Null, "disk_state": String("detached"), "gen": Number(2), "time_updated": String("2024-12-14T01:14:55.026216Z")}, "size": Number(2147483648), "slot": Null, "volume_id": String("e5fa68ba-b69f-4421-98bb-c8880cb66b6c")}) node_id = 0 saga_id = bc519d71-5839-49a8-a9b3-427ef59bfe73
14622024-12-14T01:15:20.234ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = ec66f35d-9dc5-46c1-80a1-ebaa91a8212a
14632024-12-14T01:15:20.234ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = bc519d71-5839-49a8-a9b3-427ef59bfe73
14642024-12-14T01:15:20.236ZDEBGnexus (SagaExecutor): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true roles = RoleSet { roles: {} } saga_id = bc519d71-5839-49a8-a9b3-427ef59bfe73 saga_name = disk-delete saga_node = SpaceAccount
14652024-12-14T01:15:20.237ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true resource = Database result = Ok(()) saga_id = bc519d71-5839-49a8-a9b3-427ef59bfe73 saga_name = disk-delete saga_node = SpaceAccount
14662024-12-14T01:15:20.248ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = ec66f35d-9dc5-46c1-80a1-ebaa91a8212a
14672024-12-14T01:15:20.248ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 1 saga_id = bc519d71-5839-49a8-a9b3-427ef59bfe73
14682024-12-14T01:15:20.251ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = ec66f35d-9dc5-46c1-80a1-ebaa91a8212a
14692024-12-14T01:15:20.251ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = bc519d71-5839-49a8-a9b3-427ef59bfe73
14702024-12-14T01:15:20.254ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = ec66f35d-9dc5-46c1-80a1-ebaa91a8212a
14712024-12-14T01:15:20.255ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"SiloUser": Object {"silo_id": String("2c668072-a9a1-4a69-928c-e118c99521be"), "silo_user_id": String("2896dd1a-5f1e-476b-86bb-db6c90fa385e")}}}, Object {"mapped_fleet_roles": Object {"admin": Array [String("admin")]}}]}}, "volume_id": String("e5fa68ba-b69f-4421-98bb-c8880cb66b6c")}) node_id = 2 saga_id = bc519d71-5839-49a8-a9b3-427ef59bfe73
14722024-12-14T01:15:20.258ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = ec66f35d-9dc5-46c1-80a1-ebaa91a8212a
14732024-12-14T01:15:20.258ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = bc519d71-5839-49a8-a9b3-427ef59bfe73
14742024-12-14T01:15:20.261ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = ec66f35d-9dc5-46c1-80a1-ebaa91a8212a
14752024-12-14T01:15:20.261ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = bc519d71-5839-49a8-a9b3-427ef59bfe73
14762024-12-14T01:15:20.264ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = ec66f35d-9dc5-46c1-80a1-ebaa91a8212a
14772024-12-14T01:15:20.264ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = bc519d71-5839-49a8-a9b3-427ef59bfe73
14782024-12-14T01:15:20.347ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = ec66f35d-9dc5-46c1-80a1-ebaa91a8212a
14792024-12-14T01:15:20.347ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"V3": Object {"region_snapshots": Array [], "regions": Array [String("d538f9f1-2834-4e2a-ad67-7e30be6568a8"), String("6d9e3caf-eaa9-4ef0-acbe-4e90df20205b"), String("c89aca07-3545-4f31-8773-b9e0bb002831")]}}) node_id = 4 saga_id = bc519d71-5839-49a8-a9b3-427ef59bfe73
14802024-12-14T01:15:20.350ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = ec66f35d-9dc5-46c1-80a1-ebaa91a8212a
14812024-12-14T01:15:20.350ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = bc519d71-5839-49a8-a9b3-427ef59bfe73
14822024-12-14T01:15:20.356ZDEBGnexus (SEC): saga log event new_state = N006 started sec_id = ec66f35d-9dc5-46c1-80a1-ebaa91a8212a
14832024-12-14T01:15:20.356ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 6 saga_id = bc519d71-5839-49a8-a9b3-427ef59bfe73
14842024-12-14T01:15:20.361ZDEBGnexus (SEC): saga log event new_state = N006 succeeded sec_id = ec66f35d-9dc5-46c1-80a1-ebaa91a8212a
14852024-12-14T01:15:20.361ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 6 saga_id = bc519d71-5839-49a8-a9b3-427ef59bfe73
14862024-12-14T01:15:20.391ZINFOnexus (SagaExecutor): Transient(region not deleted yet), trying again in 105.619746ms file = nexus/src/app/crucible.rs:828 region_id = c89aca07-3545-4f31-8773-b9e0bb002831 saga_id = bc519d71-5839-49a8-a9b3-427ef59bfe73 saga_name = disk-delete
14872024-12-14T01:15:20.395ZINFOnexus (SagaExecutor): Transient(region not deleted yet), trying again in 127.030418ms file = nexus/src/app/crucible.rs:828 region_id = 6d9e3caf-eaa9-4ef0-acbe-4e90df20205b saga_id = bc519d71-5839-49a8-a9b3-427ef59bfe73 saga_name = disk-delete
14882024-12-14T01:15:20.396ZINFOnexus (SagaExecutor): Transient(region not deleted yet), trying again in 89.694097ms file = nexus/src/app/crucible.rs:828 region_id = d538f9f1-2834-4e2a-ad67-7e30be6568a8 saga_id = bc519d71-5839-49a8-a9b3-427ef59bfe73 saga_name = disk-delete
14892024-12-14T01:15:20.490ZINFOnexus (SagaExecutor): region deleted file = nexus/src/app/crucible.rs:813 region_id = d538f9f1-2834-4e2a-ad67-7e30be6568a8 saga_id = bc519d71-5839-49a8-a9b3-427ef59bfe73 saga_name = disk-delete
14902024-12-14T01:15:20.503ZINFOnexus (SagaExecutor): region deleted file = nexus/src/app/crucible.rs:813 region_id = c89aca07-3545-4f31-8773-b9e0bb002831 saga_id = bc519d71-5839-49a8-a9b3-427ef59bfe73 saga_name = disk-delete
14912024-12-14T01:15:20.527ZINFOnexus (SagaExecutor): region deleted file = nexus/src/app/crucible.rs:813 region_id = 6d9e3caf-eaa9-4ef0-acbe-4e90df20205b saga_id = bc519d71-5839-49a8-a9b3-427ef59bfe73 saga_name = disk-delete
14922024-12-14T01:15:20.555ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = ec66f35d-9dc5-46c1-80a1-ebaa91a8212a
14932024-12-14T01:15:20.555ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = bc519d71-5839-49a8-a9b3-427ef59bfe73
14942024-12-14T01:15:20.559ZDEBGnexus (SEC): saga log event new_state = N007 started sec_id = ec66f35d-9dc5-46c1-80a1-ebaa91a8212a
14952024-12-14T01:15:20.559ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 7 saga_id = bc519d71-5839-49a8-a9b3-427ef59bfe73
14962024-12-14T01:15:20.563ZDEBGnexus (SEC): saga log event new_state = N007 succeeded sec_id = ec66f35d-9dc5-46c1-80a1-ebaa91a8212a
14972024-12-14T01:15:20.563ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 7 saga_id = bc519d71-5839-49a8-a9b3-427ef59bfe73
14982024-12-14T01:15:20.567ZDEBGnexus (SEC): saga log event new_state = N008 started sec_id = ec66f35d-9dc5-46c1-80a1-ebaa91a8212a
14992024-12-14T01:15:20.567ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 8 saga_id = bc519d71-5839-49a8-a9b3-427ef59bfe73
15002024-12-14T01:15:20.571ZDEBGnexus (SEC): saga log event new_state = N008 succeeded sec_id = ec66f35d-9dc5-46c1-80a1-ebaa91a8212a
15012024-12-14T01:15:20.571ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 8 saga_id = bc519d71-5839-49a8-a9b3-427ef59bfe73
15022024-12-14T01:15:20.574ZDEBGnexus (SEC): saga log event new_state = N009 started sec_id = ec66f35d-9dc5-46c1-80a1-ebaa91a8212a
15032024-12-14T01:15:20.574ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 9 saga_id = bc519d71-5839-49a8-a9b3-427ef59bfe73
15042024-12-14T01:15:20.583ZDEBGnexus (SEC): saga log event new_state = N009 succeeded sec_id = ec66f35d-9dc5-46c1-80a1-ebaa91a8212a
15052024-12-14T01:15:20.583ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Array []) node_id = 9 saga_id = bc519d71-5839-49a8-a9b3-427ef59bfe73
15062024-12-14T01:15:20.586ZDEBGnexus (SEC): saga log event new_state = N010 started sec_id = ec66f35d-9dc5-46c1-80a1-ebaa91a8212a
15072024-12-14T01:15:20.586ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 10 saga_id = bc519d71-5839-49a8-a9b3-427ef59bfe73
15082024-12-14T01:15:20.591ZDEBGnexus (SEC): saga log event new_state = N010 succeeded sec_id = ec66f35d-9dc5-46c1-80a1-ebaa91a8212a
15092024-12-14T01:15:20.591ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = bc519d71-5839-49a8-a9b3-427ef59bfe73
15102024-12-14T01:15:20.595ZDEBGnexus (SEC): saga log event new_state = N011 started sec_id = ec66f35d-9dc5-46c1-80a1-ebaa91a8212a
15112024-12-14T01:15:20.595ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 11 saga_id = bc519d71-5839-49a8-a9b3-427ef59bfe73
15122024-12-14T01:15:20.599ZINFOnexus (SagaExecutor): allocated regions for e5fa68ba-b69f-4421-98bb-c8880cb66b6c is empty, calling volume_hard_delete file = nexus/src/app/sagas/volume_delete.rs:531 saga_id = bc519d71-5839-49a8-a9b3-427ef59bfe73 saga_name = disk-delete
15132024-12-14T01:15:20.606ZDEBGnexus (SEC): saga log event new_state = N011 succeeded sec_id = ec66f35d-9dc5-46c1-80a1-ebaa91a8212a
15142024-12-14T01:15:20.606ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Bool(true)) node_id = 11 saga_id = bc519d71-5839-49a8-a9b3-427ef59bfe73
15152024-12-14T01:15:20.609ZDEBGnexus (SEC): saga log event new_state = N012 started sec_id = ec66f35d-9dc5-46c1-80a1-ebaa91a8212a
15162024-12-14T01:15:20.609ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 12 saga_id = bc519d71-5839-49a8-a9b3-427ef59bfe73
15172024-12-14T01:15:20.612ZDEBGnexus (SEC): saga log event new_state = N012 succeeded sec_id = ec66f35d-9dc5-46c1-80a1-ebaa91a8212a
15182024-12-14T01:15:20.612ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Bool(true)) node_id = 12 saga_id = bc519d71-5839-49a8-a9b3-427ef59bfe73
15192024-12-14T01:15:20.614ZDEBGnexus (SEC): saga log event new_state = N014 started sec_id = ec66f35d-9dc5-46c1-80a1-ebaa91a8212a
15202024-12-14T01:15:20.614ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 14 saga_id = bc519d71-5839-49a8-a9b3-427ef59bfe73
15212024-12-14T01:15:20.617ZDEBGnexus (SEC): saga log event new_state = N014 succeeded sec_id = ec66f35d-9dc5-46c1-80a1-ebaa91a8212a
15222024-12-14T01:15:20.617ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 14 saga_id = bc519d71-5839-49a8-a9b3-427ef59bfe73
15232024-12-14T01:15:20.620ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = bc519d71-5839-49a8-a9b3-427ef59bfe73 sec_id = ec66f35d-9dc5-46c1-80a1-ebaa91a8212a
15242024-12-14T01:15:20.620ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = bc519d71-5839-49a8-a9b3-427ef59bfe73
15252024-12-14T01:15:20.627ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = bc519d71-5839-49a8-a9b3-427ef59bfe73 saga_name = disk-delete sec_id = ec66f35d-9dc5-46c1-80a1-ebaa91a8212a
15262024-12-14T01:15:20.627ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = bc519d71-5839-49a8-a9b3-427ef59bfe73 saga_name = disk-delete saga_result = SagaResult { saga_id: bc519d71-5839-49a8-a9b3-427ef59bfe73, saga_log: SagaLog { saga_id: bc519d71-5839-49a8-a9b3-427ef59bfe73, unwinding: false, events: [N013 started, N013 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N006 started, N006 succeeded, N005 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N009 started, N009 succeeded, N010 started, N010 succeeded, N011 started, N011 succeeded, N012 started, N012 succeeded, N014 started, N014 succeeded], node_status: {0: Succeeded(Object {"block_size": String("Traditional"), "create_image_id": String("69e9eb03-3dc0-4220-9d21-3e637de439be"), "create_snapshot_id": Null, "identity": Object {"description": String(""), "id": String("03cca168-b332-42b3-bd85-e17bd7884c8f"), "name": String("disk-e45a2f373a8"), "time_created": String("2024-12-14T01:14:54.048548Z"), "time_deleted": Null, "time_modified": String("2024-12-14T01:14:54.048548Z")}, "pantry_address": Null, "project_id": String("776ccd20-a853-4c93-af22-41ffed980f3e"), "rcgen": Number(1), "runtime_state": Object {"attach_instance_id": Null, "disk_state": String("detached"), "gen": Number(2), "time_updated": String("2024-12-14T01:14:55.026216Z")}, "size": Number(2147483648), "slot": Null, "volume_id": String("e5fa68ba-b69f-4421-98bb-c8880cb66b6c")}), 1: Succeeded(Null), 2: Succeeded(Object {"serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"SiloUser": Object {"silo_id": String("2c668072-a9a1-4a69-928c-e118c99521be"), "silo_user_id": String("2896dd1a-5f1e-476b-86bb-db6c90fa385e")}}}, Object {"mapped_fleet_roles": Object {"admin": Array [String("admin")]}}]}}, "volume_id": String("e5fa68ba-b69f-4421-98bb-c8880cb66b6c")}), 3: Succeeded(Null), 4: Succeeded(Object {"V3": Object {"region_snapshots": Array [], "regions": Array [String("d538f9f1-2834-4e2a-ad67-7e30be6568a8"), String("6d9e3caf-eaa9-4ef0-acbe-4e90df20205b"), String("c89aca07-3545-4f31-8773-b9e0bb002831")]}}), 5: Succeeded(Null), 6: Succeeded(Null), 7: Succeeded(Null), 8: Succeeded(Null), 9: Succeeded(Array []), 10: Succeeded(Null), 11: Succeeded(Bool(true)), 12: Succeeded(Bool(true)), 13: Succeeded(Null), 14: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Bool(true), node_outputs: {"crucible_resources_to_delete": Object {"V3": Object {"region_snapshots": Array [], "regions": Array [String("d538f9f1-2834-4e2a-ad67-7e30be6568a8"), String("6d9e3caf-eaa9-4ef0-acbe-4e90df20205b"), String("c89aca07-3545-4f31-8773-b9e0bb002831")]}}, "deleted_disk": Object {"block_size": String("Traditional"), "create_image_id": String("69e9eb03-3dc0-4220-9d21-3e637de439be"), "create_snapshot_id": Null, "identity": Object {"description": String(""), "id": String("03cca168-b332-42b3-bd85-e17bd7884c8f"), "name": String("disk-e45a2f373a8"), "time_created": String("2024-12-14T01:14:54.048548Z"), "time_deleted": Null, "time_modified": String("2024-12-14T01:14:54.048548Z")}, "pantry_address": Null, "project_id": String("776ccd20-a853-4c93-af22-41ffed980f3e"), "rcgen": Number(1), "runtime_state": Object {"attach_instance_id": Null, "disk_state": String("detached"), "gen": Number(2), "time_updated": String("2024-12-14T01:14:55.026216Z")}, "size": Number(2147483648), "slot": Null, "volume_id": String("e5fa68ba-b69f-4421-98bb-c8880cb66b6c")}, "freed_crucible_regions": Array [], "no_result1": Null, "no_result_1": Null, "no_result_2": Null, "no_result_3": Null, "no_result_4": Null, "no_result_5": Null, "params_for_volume_delete_subsaga": Object {"serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"SiloUser": Object {"silo_id": String("2c668072-a9a1-4a69-928c-e118c99521be"), "silo_user_id": String("2896dd1a-5f1e-476b-86bb-db6c90fa385e")}}}, Object {"mapped_fleet_roles": Object {"admin": Array [String("admin")]}}]}}, "volume_id": String("e5fa68ba-b69f-4421-98bb-c8880cb66b6c")}, "volume_delete_subsaga_no_result": Bool(true), "volume_hard_deleted": Bool(true)} }) }
15272024-12-14T01:15:20.627ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 521028 local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 28f7a3b6-9044-4fdc-b545-f0a8971d37fe response_code = 204 uri = /v1/disks/disk-e45a2f373a8?project=proj-76656375e39
15282024-12-14T01:15:20.628ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
15292024-12-14T01:15:20.629ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
15302024-12-14T01:15:20.630ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
15312024-12-14T01:15:20.630ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
15322024-12-14T01:15:20.631ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
15332024-12-14T01:15:20.633ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "4c27b5375e7db4012b4e50525f017d0aef13b0d1", lookup_type: ByCompositeId("token = \\"4c27b5375e7db4012b4e50525f017d0aef13b0d1\\"") } result = Ok(())
15342024-12-14T01:15:20.633ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
15352024-12-14T01:15:20.633ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
15362024-12-14T01:15:20.634ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
15372024-12-14T01:15:20.634ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
15382024-12-14T01:15:20.636ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
15392024-12-14T01:15:20.636ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
15402024-12-14T01:15:20.637ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
15412024-12-14T01:15:20.638ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
15422024-12-14T01:15:20.639ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
15432024-12-14T01:15:20.640ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 2c668072-a9a1-4a69-928c-e118c99521be, lookup_type: ById(2c668072-a9a1-4a69-928c-e118c99521be) }, key: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, lookup_type: ById(2896dd1a-5f1e-476b-86bb-db6c90fa385e) } result = Ok(())
15442024-12-14T01:15:20.640ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
15452024-12-14T01:15:20.641ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
15462024-12-14T01:15:20.641ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
15472024-12-14T01:15:20.643ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "4c27b5375e7db4012b4e50525f017d0aef13b0d1", lookup_type: ByCompositeId("4c27b5375e7db4012b4e50525f017d0aef13b0d1") } result = Ok(())
15482024-12-14T01:15:20.643ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
15492024-12-14T01:15:20.643ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
15502024-12-14T01:15:20.646ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
15512024-12-14T01:15:20.647ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
15522024-12-14T01:15:20.648ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
15532024-12-14T01:15:20.648ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
15542024-12-14T01:15:20.649ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
15552024-12-14T01:15:20.649ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
15562024-12-14T01:15:20.651ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
15572024-12-14T01:15:20.651ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
15582024-12-14T01:15:20.652ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
15592024-12-14T01:15:20.653ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 2c668072-a9a1-4a69-928c-e118c99521be, lookup_type: ById(2c668072-a9a1-4a69-928c-e118c99521be) }, key: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, lookup_type: ById(2896dd1a-5f1e-476b-86bb-db6c90fa385e) } result = Ok(())
15602024-12-14T01:15:20.653ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
15612024-12-14T01:15:20.653ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
15622024-12-14T01:15:20.655ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
15632024-12-14T01:15:20.655ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
15642024-12-14T01:15:20.656ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
15652024-12-14T01:15:20.656ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
15662024-12-14T01:15:20.657ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
15672024-12-14T01:15:20.659ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 2c668072-a9a1-4a69-928c-e118c99521be, lookup_type: ById(2c668072-a9a1-4a69-928c-e118c99521be) } result = Ok(())
15682024-12-14T01:15:20.663ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 2a85e01a-c10b-4893-84ca-e9b012b311ba roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-76656375e39&vpc=default
15692024-12-14T01:15:20.663ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 2a85e01a-c10b-4893-84ca-e9b012b311ba resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-76656375e39&vpc=default
15702024-12-14T01:15:20.664ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 2a85e01a-c10b-4893-84ca-e9b012b311ba roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-76656375e39&vpc=default
15712024-12-14T01:15:20.664ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 2a85e01a-c10b-4893-84ca-e9b012b311ba resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-76656375e39&vpc=default
15722024-12-14T01:15:20.665ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 2a85e01a-c10b-4893-84ca-e9b012b311ba roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-76656375e39&vpc=default
15732024-12-14T01:15:20.666ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 2a85e01a-c10b-4893-84ca-e9b012b311ba resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-76656375e39&vpc=default
15742024-12-14T01:15:20.667ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 2a85e01a-c10b-4893-84ca-e9b012b311ba roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-76656375e39&vpc=default
15752024-12-14T01:15:20.667ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 2a85e01a-c10b-4893-84ca-e9b012b311ba resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-76656375e39&vpc=default
15762024-12-14T01:15:20.669ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 2a85e01a-c10b-4893-84ca-e9b012b311ba roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-76656375e39&vpc=default
15772024-12-14T01:15:20.669ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 2a85e01a-c10b-4893-84ca-e9b012b311ba resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-76656375e39&vpc=default
15782024-12-14T01:15:20.671ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 2a85e01a-c10b-4893-84ca-e9b012b311ba roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-76656375e39&vpc=default
15792024-12-14T01:15:20.671ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 2a85e01a-c10b-4893-84ca-e9b012b311ba resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-76656375e39&vpc=default
15802024-12-14T01:15:20.676ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 2a85e01a-c10b-4893-84ca-e9b012b311ba roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-76656375e39&vpc=default
15812024-12-14T01:15:20.676ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 2a85e01a-c10b-4893-84ca-e9b012b311ba resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-76656375e39&vpc=default
15822024-12-14T01:15:20.678ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 2a85e01a-c10b-4893-84ca-e9b012b311ba roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-76656375e39&vpc=default
15832024-12-14T01:15:20.678ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 2a85e01a-c10b-4893-84ca-e9b012b311ba resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-76656375e39&vpc=default
15842024-12-14T01:15:20.680ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 2a85e01a-c10b-4893-84ca-e9b012b311ba roles = RoleSet { roles: {(Silo, 2c668072-a9a1-4a69-928c-e118c99521be, "admin")} } uri = /v1/vpc-subnets/default?project=proj-76656375e39&vpc=default
15852024-12-14T01:15:20.684ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 2a85e01a-c10b-4893-84ca-e9b012b311ba resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 2c668072-a9a1-4a69-928c-e118c99521be, lookup_type: ById(2c668072-a9a1-4a69-928c-e118c99521be) }, key: 776ccd20-a853-4c93-af22-41ffed980f3e, lookup_type: ByName("proj-76656375e39") }, key: 7a393832-8e01-47ce-b5bb-84ec744aa10a, lookup_type: ByName("default") }, key: 067dcdd2-984b-4194-bd71-ef32c85fb67b, lookup_type: ByName("default") } result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-76656375e39&vpc=default
15862024-12-14T01:15:20.684ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 2a85e01a-c10b-4893-84ca-e9b012b311ba roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-76656375e39&vpc=default
15872024-12-14T01:15:20.684ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 2a85e01a-c10b-4893-84ca-e9b012b311ba resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-76656375e39&vpc=default
15882024-12-14T01:15:20.686ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 2a85e01a-c10b-4893-84ca-e9b012b311ba roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-76656375e39&vpc=default
15892024-12-14T01:15:20.686ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 2a85e01a-c10b-4893-84ca-e9b012b311ba resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-76656375e39&vpc=default
15902024-12-14T01:15:20.688ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 2a85e01a-c10b-4893-84ca-e9b012b311ba roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-76656375e39&vpc=default
15912024-12-14T01:15:20.688ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 2a85e01a-c10b-4893-84ca-e9b012b311ba resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-76656375e39&vpc=default
15922024-12-14T01:15:20.690ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 2a85e01a-c10b-4893-84ca-e9b012b311ba roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-76656375e39&vpc=default
15932024-12-14T01:15:20.691ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 2a85e01a-c10b-4893-84ca-e9b012b311ba resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-76656375e39&vpc=default
15942024-12-14T01:15:20.692ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 2a85e01a-c10b-4893-84ca-e9b012b311ba roles = RoleSet { roles: {(Silo, 2c668072-a9a1-4a69-928c-e118c99521be, "admin")} } uri = /v1/vpc-subnets/default?project=proj-76656375e39&vpc=default
15952024-12-14T01:15:20.695ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 2a85e01a-c10b-4893-84ca-e9b012b311ba resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 2c668072-a9a1-4a69-928c-e118c99521be, lookup_type: ById(2c668072-a9a1-4a69-928c-e118c99521be) }, key: 776ccd20-a853-4c93-af22-41ffed980f3e, lookup_type: ByName("proj-76656375e39") }, key: 7a393832-8e01-47ce-b5bb-84ec744aa10a, lookup_type: ByName("default") }, key: 067dcdd2-984b-4194-bd71-ef32c85fb67b, lookup_type: ByName("default") } result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-76656375e39&vpc=default
15962024-12-14T01:15:20.695ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 2a85e01a-c10b-4893-84ca-e9b012b311ba roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-76656375e39&vpc=default
15972024-12-14T01:15:20.696ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 2a85e01a-c10b-4893-84ca-e9b012b311ba resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-76656375e39&vpc=default
15982024-12-14T01:15:20.698ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 2a85e01a-c10b-4893-84ca-e9b012b311ba roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-76656375e39&vpc=default
15992024-12-14T01:15:20.698ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 2a85e01a-c10b-4893-84ca-e9b012b311ba resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-76656375e39&vpc=default
16002024-12-14T01:15:20.702ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 2a85e01a-c10b-4893-84ca-e9b012b311ba roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-76656375e39&vpc=default
16012024-12-14T01:15:20.702ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 2a85e01a-c10b-4893-84ca-e9b012b311ba resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-76656375e39&vpc=default
16022024-12-14T01:15:20.740ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 2a85e01a-c10b-4893-84ca-e9b012b311ba roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-76656375e39&vpc=default
16032024-12-14T01:15:20.740ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 2a85e01a-c10b-4893-84ca-e9b012b311ba resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-76656375e39&vpc=default
16042024-12-14T01:15:20.745ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 117018 local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 2a85e01a-c10b-4893-84ca-e9b012b311ba response_code = 204 uri = /v1/vpc-subnets/default?project=proj-76656375e39&vpc=default
16052024-12-14T01:15:20.745ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 27 reason = Signaled
16062024-12-14T01:15:20.745ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
16072024-12-14T01:15:20.745ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16082024-12-14T01:15:20.746ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16092024-12-14T01:15:20.747ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16102024-12-14T01:15:20.748ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
16112024-12-14T01:15:20.749ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
16122024-12-14T01:15:20.749ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16132024-12-14T01:15:20.749ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
16142024-12-14T01:15:20.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16152024-12-14T01:15:20.750ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
16162024-12-14T01:15:20.750ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
16172024-12-14T01:15:20.750ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16182024-12-14T01:15:20.751ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
16192024-12-14T01:15:20.753ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
16202024-12-14T01:15:20.753ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16212024-12-14T01:15:20.753ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16222024-12-14T01:15:20.753ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "4c27b5375e7db4012b4e50525f017d0aef13b0d1", lookup_type: ByCompositeId("token = \\"4c27b5375e7db4012b4e50525f017d0aef13b0d1\\"") } result = Ok(())
16232024-12-14T01:15:20.753ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
16242024-12-14T01:15:20.753ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
16252024-12-14T01:15:20.755ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
16262024-12-14T01:15:20.755ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
16272024-12-14T01:15:20.756ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
16282024-12-14T01:15:20.757ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
16292024-12-14T01:15:20.758ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
16302024-12-14T01:15:20.758ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
16312024-12-14T01:15:20.760ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
16322024-12-14T01:15:20.761ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 2c668072-a9a1-4a69-928c-e118c99521be, lookup_type: ById(2c668072-a9a1-4a69-928c-e118c99521be) }, key: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, lookup_type: ById(2896dd1a-5f1e-476b-86bb-db6c90fa385e) } result = Ok(())
16332024-12-14T01:15:20.761ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
16342024-12-14T01:15:20.761ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
16352024-12-14T01:15:20.786ZINFOnexus (BackgroundTasks): VPC route manager sled 7e423e95-464a-471f-a0d9-4799977f0b0f background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
16362024-12-14T01:15:20.786ZDEBGnexus (BackgroundTasks): client request SledAgent = 7e423e95-464a-471f-a0d9-4799977f0b0f background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
16372024-12-14T01:15:20.787ZDEBGnexus (BackgroundTasks): client response SledAgent = 7e423e95-464a-471f-a0d9-4799977f0b0f background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "a89d2902-3f83-4adc-82ee-829267341548", "content-length": "372", "date": "Sat, 14 Dec 2024 01:15:20 GMT"} })
16382024-12-14T01:15:20.787ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16392024-12-14T01:15:20.787ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16402024-12-14T01:15:20.788ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
16412024-12-14T01:15:20.789ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "4c27b5375e7db4012b4e50525f017d0aef13b0d1", lookup_type: ByCompositeId("4c27b5375e7db4012b4e50525f017d0aef13b0d1") } result = Ok(())
16422024-12-14T01:15:20.789ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
16432024-12-14T01:15:20.789ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
16442024-12-14T01:15:20.793ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
16452024-12-14T01:15:20.793ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
16462024-12-14T01:15:20.794ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
16472024-12-14T01:15:20.794ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
16482024-12-14T01:15:20.796ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
16492024-12-14T01:15:20.796ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
16502024-12-14T01:15:20.798ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
16512024-12-14T01:15:20.798ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
16522024-12-14T01:15:20.799ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
16532024-12-14T01:15:20.800ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
16542024-12-14T01:15:20.800ZDEBGnexus (BackgroundTasks): client request SledAgent = 7e423e95-464a-471f-a0d9-4799977f0b0f background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
16552024-12-14T01:15:20.800ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 2c668072-a9a1-4a69-928c-e118c99521be, lookup_type: ById(2c668072-a9a1-4a69-928c-e118c99521be) }, key: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, lookup_type: ById(2896dd1a-5f1e-476b-86bb-db6c90fa385e) } result = Ok(())
16562024-12-14T01:15:20.800ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
16572024-12-14T01:15:20.800ZDEBGnexus (BackgroundTasks): client response SledAgent = 7e423e95-464a-471f-a0d9-4799977f0b0f background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "3be32e0f-d91a-48f3-867d-ddfae8505644", "date": "Sat, 14 Dec 2024 01:15:20 GMT"} })
16582024-12-14T01:15:20.801ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16592024-12-14T01:15:20.801ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
16602024-12-14T01:15:20.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16612024-12-14T01:15:20.802ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
16622024-12-14T01:15:20.802ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
16632024-12-14T01:15:20.803ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16642024-12-14T01:15:20.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16652024-12-14T01:15:20.803ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
16662024-12-14T01:15:20.804ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
16672024-12-14T01:15:20.805ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
16682024-12-14T01:15:20.805ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16692024-12-14T01:15:20.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16702024-12-14T01:15:20.806ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 2c668072-a9a1-4a69-928c-e118c99521be, lookup_type: ById(2c668072-a9a1-4a69-928c-e118c99521be) } result = Ok(())
16712024-12-14T01:15:20.806ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 9239c883-1063-4a24-86e6-c14928205335 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-76656375e39
16722024-12-14T01:15:20.806ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 9239c883-1063-4a24-86e6-c14928205335 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-76656375e39
16732024-12-14T01:15:20.808ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 9239c883-1063-4a24-86e6-c14928205335 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-76656375e39
16742024-12-14T01:15:20.808ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 9239c883-1063-4a24-86e6-c14928205335 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-76656375e39
16752024-12-14T01:15:20.809ZINFOnexus (BackgroundTasks): VPC route manager sled 7e423e95-464a-471f-a0d9-4799977f0b0f push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
16762024-12-14T01:15:20.809ZDEBGnexus (BackgroundTasks): client request SledAgent = 7e423e95-464a-471f-a0d9-4799977f0b0f background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
16772024-12-14T01:15:20.809ZDEBGnexus (BackgroundTasks): client response SledAgent = 7e423e95-464a-471f-a0d9-4799977f0b0f background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "f54bf6f4-839c-493c-97d0-8276562ceb0c", "date": "Sat, 14 Dec 2024 01:15:20 GMT"} })
16782024-12-14T01:15:20.809ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 9239c883-1063-4a24-86e6-c14928205335 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-76656375e39
16792024-12-14T01:15:20.810ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 9239c883-1063-4a24-86e6-c14928205335 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-76656375e39
16802024-12-14T01:15:20.811ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 65.446454ms iteration = 27 status = {}
16812024-12-14T01:15:20.811ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 9239c883-1063-4a24-86e6-c14928205335 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-76656375e39
16822024-12-14T01:15:20.812ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 9239c883-1063-4a24-86e6-c14928205335 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-76656375e39
16832024-12-14T01:15:20.813ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 9239c883-1063-4a24-86e6-c14928205335 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-76656375e39
16842024-12-14T01:15:20.814ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 9239c883-1063-4a24-86e6-c14928205335 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-76656375e39
16852024-12-14T01:15:20.816ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 9239c883-1063-4a24-86e6-c14928205335 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-76656375e39
16862024-12-14T01:15:20.816ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 9239c883-1063-4a24-86e6-c14928205335 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-76656375e39
16872024-12-14T01:15:20.818ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 9239c883-1063-4a24-86e6-c14928205335 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-76656375e39
16882024-12-14T01:15:20.818ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 9239c883-1063-4a24-86e6-c14928205335 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-76656375e39
16892024-12-14T01:15:20.821ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 9239c883-1063-4a24-86e6-c14928205335 roles = RoleSet { roles: {(Silo, 2c668072-a9a1-4a69-928c-e118c99521be, "admin")} } uri = /v1/vpcs/default?project=proj-76656375e39
16902024-12-14T01:15:20.824ZDEBGnexus (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 9239c883-1063-4a24-86e6-c14928205335 resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 2c668072-a9a1-4a69-928c-e118c99521be, lookup_type: ById(2c668072-a9a1-4a69-928c-e118c99521be) }, key: 776ccd20-a853-4c93-af22-41ffed980f3e, lookup_type: ByName("proj-76656375e39") }, key: 7a393832-8e01-47ce-b5bb-84ec744aa10a, lookup_type: ByName("default") } result = Ok(()) uri = /v1/vpcs/default?project=proj-76656375e39
16912024-12-14T01:15:20.824ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 9239c883-1063-4a24-86e6-c14928205335 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-76656375e39
16922024-12-14T01:15:20.824ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 9239c883-1063-4a24-86e6-c14928205335 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-76656375e39
16932024-12-14T01:15:20.826ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 9239c883-1063-4a24-86e6-c14928205335 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-76656375e39
16942024-12-14T01:15:20.826ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 9239c883-1063-4a24-86e6-c14928205335 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-76656375e39
16952024-12-14T01:15:20.828ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 9239c883-1063-4a24-86e6-c14928205335 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-76656375e39
16962024-12-14T01:15:20.828ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 9239c883-1063-4a24-86e6-c14928205335 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-76656375e39
16972024-12-14T01:15:20.830ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 9239c883-1063-4a24-86e6-c14928205335 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-76656375e39
16982024-12-14T01:15:20.830ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 9239c883-1063-4a24-86e6-c14928205335 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-76656375e39
16992024-12-14T01:15:20.832ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 9239c883-1063-4a24-86e6-c14928205335 roles = RoleSet { roles: {(Silo, 2c668072-a9a1-4a69-928c-e118c99521be, "admin")} } uri = /v1/vpcs/default?project=proj-76656375e39
17002024-12-14T01:15:20.835ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 9239c883-1063-4a24-86e6-c14928205335 resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 2c668072-a9a1-4a69-928c-e118c99521be, lookup_type: ById(2c668072-a9a1-4a69-928c-e118c99521be) }, key: 776ccd20-a853-4c93-af22-41ffed980f3e, lookup_type: ByName("proj-76656375e39") }, key: 7a393832-8e01-47ce-b5bb-84ec744aa10a, lookup_type: ByName("default") } result = Ok(()) uri = /v1/vpcs/default?project=proj-76656375e39
17012024-12-14T01:15:20.835ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 9239c883-1063-4a24-86e6-c14928205335 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-76656375e39
17022024-12-14T01:15:20.835ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 9239c883-1063-4a24-86e6-c14928205335 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-76656375e39
17032024-12-14T01:15:20.839ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 9239c883-1063-4a24-86e6-c14928205335 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-76656375e39
17042024-12-14T01:15:20.839ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 9239c883-1063-4a24-86e6-c14928205335 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-76656375e39
17052024-12-14T01:15:20.843ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 9239c883-1063-4a24-86e6-c14928205335 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-76656375e39
17062024-12-14T01:15:20.844ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 9239c883-1063-4a24-86e6-c14928205335 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-76656375e39
17072024-12-14T01:15:20.846ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 9239c883-1063-4a24-86e6-c14928205335 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-76656375e39
17082024-12-14T01:15:20.846ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 9239c883-1063-4a24-86e6-c14928205335 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-76656375e39
17092024-12-14T01:15:20.852ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 9239c883-1063-4a24-86e6-c14928205335 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-76656375e39
17102024-12-14T01:15:20.852ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 9239c883-1063-4a24-86e6-c14928205335 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-76656375e39
17112024-12-14T01:15:20.854ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 9239c883-1063-4a24-86e6-c14928205335 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-76656375e39
17122024-12-14T01:15:20.855ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 9239c883-1063-4a24-86e6-c14928205335 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-76656375e39
17132024-12-14T01:15:20.857ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 9239c883-1063-4a24-86e6-c14928205335 roles = RoleSet { roles: {(Silo, 2c668072-a9a1-4a69-928c-e118c99521be, "admin")} } uri = /v1/vpcs/default?project=proj-76656375e39
17142024-12-14T01:15:20.860ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 9239c883-1063-4a24-86e6-c14928205335 resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 2c668072-a9a1-4a69-928c-e118c99521be, lookup_type: ById(2c668072-a9a1-4a69-928c-e118c99521be) }, key: 776ccd20-a853-4c93-af22-41ffed980f3e, lookup_type: ByName("proj-76656375e39") }, key: 7a393832-8e01-47ce-b5bb-84ec744aa10a, lookup_type: ByName("default") }, key: e31d5738-2b7d-4ad9-b432-e937efa769c3, lookup_type: ById(e31d5738-2b7d-4ad9-b432-e937efa769c3) } result = Ok(()) uri = /v1/vpcs/default?project=proj-76656375e39
17152024-12-14T01:15:20.860ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 9239c883-1063-4a24-86e6-c14928205335 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-76656375e39
17162024-12-14T01:15:20.860ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 9239c883-1063-4a24-86e6-c14928205335 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-76656375e39
17172024-12-14T01:15:20.864ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 9239c883-1063-4a24-86e6-c14928205335 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-76656375e39
17182024-12-14T01:15:20.864ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 9239c883-1063-4a24-86e6-c14928205335 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-76656375e39
17192024-12-14T01:15:20.868ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 9239c883-1063-4a24-86e6-c14928205335 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-76656375e39
17202024-12-14T01:15:20.869ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 9239c883-1063-4a24-86e6-c14928205335 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-76656375e39
17212024-12-14T01:15:20.871ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 9239c883-1063-4a24-86e6-c14928205335 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-76656375e39
17222024-12-14T01:15:20.871ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 9239c883-1063-4a24-86e6-c14928205335 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-76656375e39
17232024-12-14T01:15:20.873ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 72 reason = Timeout
17242024-12-14T01:15:20.873ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 72 reason = Timeout
17252024-12-14T01:15:20.873ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17262024-12-14T01:15:20.873ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17272024-12-14T01:15:20.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17282024-12-14T01:15:20.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17292024-12-14T01:15:20.873ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 9239c883-1063-4a24-86e6-c14928205335 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-76656375e39
17302024-12-14T01:15:20.873ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 9239c883-1063-4a24-86e6-c14928205335 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-76656375e39
17312024-12-14T01:15:20.874ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17322024-12-14T01:15:20.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17332024-12-14T01:15:20.875ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17342024-12-14T01:15:20.876ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 9239c883-1063-4a24-86e6-c14928205335 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-76656375e39
17352024-12-14T01:15:20.876ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 2.996397ms iteration = 72 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
17362024-12-14T01:15:20.876ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 9239c883-1063-4a24-86e6-c14928205335 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-76656375e39
17372024-12-14T01:15:20.878ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
17382024-12-14T01:15:20.878ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17392024-12-14T01:15:20.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17402024-12-14T01:15:20.878ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 9239c883-1063-4a24-86e6-c14928205335 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-76656375e39
17412024-12-14T01:15:20.879ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 9239c883-1063-4a24-86e6-c14928205335 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-76656375e39
17422024-12-14T01:15:20.880ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17432024-12-14T01:15:20.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17442024-12-14T01:15:20.881ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 9239c883-1063-4a24-86e6-c14928205335 roles = RoleSet { roles: {(Silo, 2c668072-a9a1-4a69-928c-e118c99521be, "admin")} } uri = /v1/vpcs/default?project=proj-76656375e39
17452024-12-14T01:15:20.881ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17462024-12-14T01:15:20.884ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8770bfcc-3a71-4738-a6b0-91008cadcb0f, lookup_type: ById(8770bfcc-3a71-4738-a6b0-91008cadcb0f) } result = Ok(())
17472024-12-14T01:15:20.884ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17482024-12-14T01:15:20.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17492024-12-14T01:15:20.884ZDEBGnexus (dropshot_external): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 9239c883-1063-4a24-86e6-c14928205335 resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 2c668072-a9a1-4a69-928c-e118c99521be, lookup_type: ById(2c668072-a9a1-4a69-928c-e118c99521be) }, key: 776ccd20-a853-4c93-af22-41ffed980f3e, lookup_type: ByName("proj-76656375e39") }, key: 7a393832-8e01-47ce-b5bb-84ec744aa10a, lookup_type: ByName("default") } result = Ok(()) uri = /v1/vpcs/default?project=proj-76656375e39
17502024-12-14T01:15:20.884ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 9239c883-1063-4a24-86e6-c14928205335 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-76656375e39
17512024-12-14T01:15:20.884ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 9239c883-1063-4a24-86e6-c14928205335 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-76656375e39
17522024-12-14T01:15:20.889ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 142868 local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 9239c883-1063-4a24-86e6-c14928205335 response_code = 204 uri = /v1/vpcs/default?project=proj-76656375e39
17532024-12-14T01:15:20.894ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
17542024-12-14T01:15:20.895ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
17552024-12-14T01:15:20.895ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8770bfcc-3a71-4738-a6b0-91008cadcb0f original_time_created = 2024-12-14 01:03:15.378067 UTC target_id = 8770bfcc-3a71-4738-a6b0-91008cadcb0f time_created = 2024-12-14 01:03:15.378067 UTC
17562024-12-14T01:15:20.896ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.625935ms iteration = 72 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8770bfcc-3a71-4738-a6b0-91008cadcb0f","time_created":"2024-12-14T01:03:15.378067Z"}
17572024-12-14T01:15:20.896ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
17582024-12-14T01:15:20.896ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
17592024-12-14T01:15:20.897ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
17602024-12-14T01:15:20.899ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "4c27b5375e7db4012b4e50525f017d0aef13b0d1", lookup_type: ByCompositeId("token = \\"4c27b5375e7db4012b4e50525f017d0aef13b0d1\\"") } result = Ok(())
17612024-12-14T01:15:20.899ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
17622024-12-14T01:15:20.899ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
17632024-12-14T01:15:20.900ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
17642024-12-14T01:15:20.900ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
17652024-12-14T01:15:20.901ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
17662024-12-14T01:15:20.902ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
17672024-12-14T01:15:20.903ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
17682024-12-14T01:15:20.903ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
17692024-12-14T01:15:20.904ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
17702024-12-14T01:15:20.905ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 2c668072-a9a1-4a69-928c-e118c99521be, lookup_type: ById(2c668072-a9a1-4a69-928c-e118c99521be) }, key: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, lookup_type: ById(2896dd1a-5f1e-476b-86bb-db6c90fa385e) } result = Ok(())
17712024-12-14T01:15:20.906ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
17722024-12-14T01:15:20.906ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
17732024-12-14T01:15:20.907ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
17742024-12-14T01:15:20.908ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "4c27b5375e7db4012b4e50525f017d0aef13b0d1", lookup_type: ByCompositeId("4c27b5375e7db4012b4e50525f017d0aef13b0d1") } result = Ok(())
17752024-12-14T01:15:20.908ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
17762024-12-14T01:15:20.908ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
17772024-12-14T01:15:20.912ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
17782024-12-14T01:15:20.912ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
17792024-12-14T01:15:20.913ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
17802024-12-14T01:15:20.913ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
17812024-12-14T01:15:20.915ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
17822024-12-14T01:15:20.915ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
17832024-12-14T01:15:20.916ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
17842024-12-14T01:15:20.916ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
17852024-12-14T01:15:20.918ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
17862024-12-14T01:15:20.919ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 2c668072-a9a1-4a69-928c-e118c99521be, lookup_type: ById(2c668072-a9a1-4a69-928c-e118c99521be) }, key: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, lookup_type: ById(2896dd1a-5f1e-476b-86bb-db6c90fa385e) } result = Ok(())
17872024-12-14T01:15:20.919ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
17882024-12-14T01:15:20.919ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
17892024-12-14T01:15:20.920ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
17902024-12-14T01:15:20.920ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
17912024-12-14T01:15:20.922ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
17922024-12-14T01:15:20.922ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
17932024-12-14T01:15:20.923ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
17942024-12-14T01:15:20.924ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 2c668072-a9a1-4a69-928c-e118c99521be, lookup_type: ById(2c668072-a9a1-4a69-928c-e118c99521be) } result = Ok(())
17952024-12-14T01:15:20.924ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 5f21e749-165e-445d-9150-ad5bb7e92faa roles = RoleSet { roles: {} } uri = /v1/projects/proj-76656375e39
17962024-12-14T01:15:20.924ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 5f21e749-165e-445d-9150-ad5bb7e92faa resource = Database result = Ok(()) uri = /v1/projects/proj-76656375e39
17972024-12-14T01:15:20.926ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 5f21e749-165e-445d-9150-ad5bb7e92faa roles = RoleSet { roles: {} } uri = /v1/projects/proj-76656375e39
17982024-12-14T01:15:20.926ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 5f21e749-165e-445d-9150-ad5bb7e92faa resource = Database result = Ok(()) uri = /v1/projects/proj-76656375e39
17992024-12-14T01:15:20.928ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 5f21e749-165e-445d-9150-ad5bb7e92faa roles = RoleSet { roles: {} } uri = /v1/projects/proj-76656375e39
18002024-12-14T01:15:20.928ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 5f21e749-165e-445d-9150-ad5bb7e92faa resource = Database result = Ok(()) uri = /v1/projects/proj-76656375e39
18012024-12-14T01:15:20.929ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 5f21e749-165e-445d-9150-ad5bb7e92faa roles = RoleSet { roles: {} } uri = /v1/projects/proj-76656375e39
18022024-12-14T01:15:20.929ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 5f21e749-165e-445d-9150-ad5bb7e92faa resource = Database result = Ok(()) uri = /v1/projects/proj-76656375e39
18032024-12-14T01:15:20.932ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 5f21e749-165e-445d-9150-ad5bb7e92faa roles = RoleSet { roles: {} } uri = /v1/projects/proj-76656375e39
18042024-12-14T01:15:20.932ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 5f21e749-165e-445d-9150-ad5bb7e92faa resource = Database result = Ok(()) uri = /v1/projects/proj-76656375e39
18052024-12-14T01:15:20.934ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 5f21e749-165e-445d-9150-ad5bb7e92faa roles = RoleSet { roles: {} } uri = /v1/projects/proj-76656375e39
18062024-12-14T01:15:20.934ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 5f21e749-165e-445d-9150-ad5bb7e92faa resource = Database result = Ok(()) uri = /v1/projects/proj-76656375e39
18072024-12-14T01:15:20.937ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 5f21e749-165e-445d-9150-ad5bb7e92faa roles = RoleSet { roles: {(Silo, 2c668072-a9a1-4a69-928c-e118c99521be, "admin")} } uri = /v1/projects/proj-76656375e39
18082024-12-14T01:15:20.939ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 5f21e749-165e-445d-9150-ad5bb7e92faa resource = Project { parent: Silo { parent: Fleet, key: 2c668072-a9a1-4a69-928c-e118c99521be, lookup_type: ById(2c668072-a9a1-4a69-928c-e118c99521be) }, key: 776ccd20-a853-4c93-af22-41ffed980f3e, lookup_type: ByName("proj-76656375e39") } result = Ok(()) uri = /v1/projects/proj-76656375e39
18092024-12-14T01:15:20.939ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 5f21e749-165e-445d-9150-ad5bb7e92faa roles = RoleSet { roles: {} } uri = /v1/projects/proj-76656375e39
18102024-12-14T01:15:20.939ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 5f21e749-165e-445d-9150-ad5bb7e92faa resource = Database result = Ok(()) uri = /v1/projects/proj-76656375e39
18112024-12-14T01:15:20.941ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 5f21e749-165e-445d-9150-ad5bb7e92faa roles = RoleSet { roles: {} } uri = /v1/projects/proj-76656375e39
18122024-12-14T01:15:20.941ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 5f21e749-165e-445d-9150-ad5bb7e92faa resource = Database result = Ok(()) uri = /v1/projects/proj-76656375e39
18132024-12-14T01:15:20.943ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 5f21e749-165e-445d-9150-ad5bb7e92faa roles = RoleSet { roles: {} } uri = /v1/projects/proj-76656375e39
18142024-12-14T01:15:20.943ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 5f21e749-165e-445d-9150-ad5bb7e92faa resource = Database result = Ok(()) uri = /v1/projects/proj-76656375e39
18152024-12-14T01:15:20.945ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 5f21e749-165e-445d-9150-ad5bb7e92faa roles = RoleSet { roles: {} } uri = /v1/projects/proj-76656375e39
18162024-12-14T01:15:20.945ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 5f21e749-165e-445d-9150-ad5bb7e92faa resource = Database result = Ok(()) uri = /v1/projects/proj-76656375e39
18172024-12-14T01:15:20.947ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 5f21e749-165e-445d-9150-ad5bb7e92faa roles = RoleSet { roles: {(Silo, 2c668072-a9a1-4a69-928c-e118c99521be, "admin")} } uri = /v1/projects/proj-76656375e39
18182024-12-14T01:15:20.950ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 5f21e749-165e-445d-9150-ad5bb7e92faa resource = Project { parent: Silo { parent: Fleet, key: 2c668072-a9a1-4a69-928c-e118c99521be, lookup_type: ById(2c668072-a9a1-4a69-928c-e118c99521be) }, key: 776ccd20-a853-4c93-af22-41ffed980f3e, lookup_type: ByName("proj-76656375e39") } result = Ok(()) uri = /v1/projects/proj-76656375e39
18192024-12-14T01:15:20.950ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 5f21e749-165e-445d-9150-ad5bb7e92faa roles = RoleSet { roles: {} } uri = /v1/projects/proj-76656375e39
18202024-12-14T01:15:20.950ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 5f21e749-165e-445d-9150-ad5bb7e92faa resource = Database result = Ok(()) uri = /v1/projects/proj-76656375e39
18212024-12-14T01:15:20.952ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 5f21e749-165e-445d-9150-ad5bb7e92faa roles = RoleSet { roles: {} } uri = /v1/projects/proj-76656375e39
18222024-12-14T01:15:20.952ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 5f21e749-165e-445d-9150-ad5bb7e92faa resource = Database result = Ok(()) uri = /v1/projects/proj-76656375e39
18232024-12-14T01:15:20.954ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 5f21e749-165e-445d-9150-ad5bb7e92faa roles = RoleSet { roles: {} } uri = /v1/projects/proj-76656375e39
18242024-12-14T01:15:20.954ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 5f21e749-165e-445d-9150-ad5bb7e92faa resource = Database result = Ok(()) uri = /v1/projects/proj-76656375e39
18252024-12-14T01:15:20.964ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 5f21e749-165e-445d-9150-ad5bb7e92faa roles = RoleSet { roles: {} } uri = /v1/projects/proj-76656375e39
18262024-12-14T01:15:20.964ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 5f21e749-165e-445d-9150-ad5bb7e92faa resource = Database result = Ok(()) uri = /v1/projects/proj-76656375e39
18272024-12-14T01:15:20.971ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 5f21e749-165e-445d-9150-ad5bb7e92faa roles = RoleSet { roles: {} } uri = /v1/projects/proj-76656375e39
18282024-12-14T01:15:20.971ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 5f21e749-165e-445d-9150-ad5bb7e92faa resource = Database result = Ok(()) uri = /v1/projects/proj-76656375e39
18292024-12-14T01:15:20.973ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 5f21e749-165e-445d-9150-ad5bb7e92faa roles = RoleSet { roles: {} } uri = /v1/projects/proj-76656375e39
18302024-12-14T01:15:20.974ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 5f21e749-165e-445d-9150-ad5bb7e92faa resource = Database result = Ok(()) uri = /v1/projects/proj-76656375e39
18312024-12-14T01:15:20.975ZDEBGnexus (dropshot_external): roles actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 5f21e749-165e-445d-9150-ad5bb7e92faa roles = RoleSet { roles: {} } uri = /v1/projects/proj-76656375e39
18322024-12-14T01:15:20.976ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2896dd1a-5f1e-476b-86bb-db6c90fa385e, silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, .. }) actor_id = 2896dd1a-5f1e-476b-86bb-db6c90fa385e authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 5f21e749-165e-445d-9150-ad5bb7e92faa resource = Database result = Ok(()) uri = /v1/projects/proj-76656375e39
18332024-12-14T01:15:20.996ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106325 local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:38889 req_id = 5f21e749-165e-445d-9150-ad5bb7e92faa response_code = 204 uri = /v1/projects/proj-76656375e39
18342024-12-14T01:15:23.461ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1710 local_addr = [fd00:1122:3344:101::a]:59823 method = GET remote_addr = [fd00:1122:3344:101::d]:36065 req_id = 20d2fd04-2dca-4981-84b6-244aca96eefe response_code = 200 uri = /ec66f35d-9dc5-46c1-80a1-ebaa91a8212a
18352024-12-14T01:15:30.873ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 73 reason = Timeout
18362024-12-14T01:15:30.873ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 25 reason = Timeout
18372024-12-14T01:15:30.873ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18382024-12-14T01:15:30.873ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
18392024-12-14T01:15:30.873ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 25 reason = Timeout
18402024-12-14T01:15:30.873ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 25 reason = Timeout
18412024-12-14T01:15:30.873ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
18422024-12-14T01:15:30.873ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
18432024-12-14T01:15:30.874ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 25 reason = Timeout
18442024-12-14T01:15:30.874ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
18452024-12-14T01:15:30.874ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 27 reason = Timeout
18462024-12-14T01:15:30.874ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 13 reason = Timeout
18472024-12-14T01:15:30.874ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
18482024-12-14T01:15:30.874ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 25 reason = Timeout
18492024-12-14T01:15:30.874ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 25 reason = Timeout
18502024-12-14T01:15:30.874ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18512024-12-14T01:15:30.874ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 13 reason = Timeout
18522024-12-14T01:15:30.874ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 25 reason = Timeout
18532024-12-14T01:15:30.874ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
18542024-12-14T01:15:30.874ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
18552024-12-14T01:15:30.874ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
18562024-12-14T01:15:30.874ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 27 reason = Timeout
18572024-12-14T01:15:30.874ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
18582024-12-14T01:15:30.874ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 14 reason = Timeout
18592024-12-14T01:15:30.874ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 8770bfcc-3a71-4738-a6b0-91008cadcb0f
18602024-12-14T01:15:30.874ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 25 reason = Timeout
18612024-12-14T01:15:30.874ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 16.28\u{b5}s iteration = 14 status = {"enabled":false,"target_id":"8770bfcc-3a71-4738-a6b0-91008cadcb0f"}
18622024-12-14T01:15:30.874ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
18632024-12-14T01:15:30.874ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 6 reason = Timeout
18642024-12-14T01:15:30.874ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 13 reason = Timeout
18652024-12-14T01:15:30.874ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
18662024-12-14T01:15:30.874ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 13 reason = Timeout
18672024-12-14T01:15:30.874ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
18682024-12-14T01:15:30.874ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 73 reason = Timeout
18692024-12-14T01:15:30.874ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
18702024-12-14T01:15:30.874ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
18712024-12-14T01:15:30.874ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18722024-12-14T01:15:30.874ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 25 reason = Timeout
18732024-12-14T01:15:30.874ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
18742024-12-14T01:15:30.874ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 13 reason = Timeout
18752024-12-14T01:15:30.874ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
18762024-12-14T01:15:30.874ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 13 reason = Timeout
18772024-12-14T01:15:30.874ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
18782024-12-14T01:15:30.874ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 25 reason = Timeout
18792024-12-14T01:15:30.874ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
18802024-12-14T01:15:30.874ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
18812024-12-14T01:15:30.874ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 13 reason = Timeout
18822024-12-14T01:15:30.874ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-14 01:05:30.874204532 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
18832024-12-14T01:15:30.874ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
18842024-12-14T01:15:30.874ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 13 reason = Timeout
18852024-12-14T01:15:30.874ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 25 reason = Timeout
18862024-12-14T01:15:30.874ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
18872024-12-14T01:15:30.874ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 13 reason = Timeout
18882024-12-14T01:15:30.874ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
18892024-12-14T01:15:30.874ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
18902024-12-14T01:15:30.874ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 15 reason = Timeout
18912024-12-14T01:15:30.874ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 25 reason = Timeout
18922024-12-14T01:15:30.874ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
18932024-12-14T01:15:30.874ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 13 reason = Timeout
18942024-12-14T01:15:30.874ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
18952024-12-14T01:15:30.874ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 15 reason = Timeout
18962024-12-14T01:15:30.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18972024-12-14T01:15:30.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
18982024-12-14T01:15:30.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
18992024-12-14T01:15:30.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
19002024-12-14T01:15:30.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
19012024-12-14T01:15:30.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
19022024-12-14T01:15:30.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
19032024-12-14T01:15:30.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
19042024-12-14T01:15:30.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
19052024-12-14T01:15:30.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
19062024-12-14T01:15:30.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
19072024-12-14T01:15:30.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
19082024-12-14T01:15:30.874ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("381b8112-f609-4c4d-ac80-0170ad8fc4bd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("795aee12-3394-49fa-9cb5-487c97a85b2d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("795aee12-3394-49fa-9cb5-487c97a85b2d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1493, tv_nsec: 703651809 } })
19092024-12-14T01:15:30.874ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
19102024-12-14T01:15:30.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
19112024-12-14T01:15:30.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
19122024-12-14T01:15:30.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
19132024-12-14T01:15:30.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
19142024-12-14T01:15:30.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
19152024-12-14T01:15:30.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
19162024-12-14T01:15:30.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19172024-12-14T01:15:30.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
19182024-12-14T01:15:30.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
19192024-12-14T01:15:30.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
19202024-12-14T01:15:30.874ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1b585a7c-7eb0-4894-b8b3-3ef1983891e5.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("36100ee5-fa9a-4857-a844-70bec0e8601f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("830b88b6-26da-4988-83b1-cf4193531cd5.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("830b88b6-26da-4988-83b1-cf4193531cd5.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1493, tv_nsec: 703772992 } })
19212024-12-14T01:15:30.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
19222024-12-14T01:15:30.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
19232024-12-14T01:15:30.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
19242024-12-14T01:15:30.875ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
19252024-12-14T01:15:30.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
19262024-12-14T01:15:30.875ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
19272024-12-14T01:15:30.875ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
19282024-12-14T01:15:30.875ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.228885ms iteration = 13 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
19292024-12-14T01:15:30.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
19302024-12-14T01:15:30.875ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
19312024-12-14T01:15:30.875ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
19322024-12-14T01:15:30.875ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.231175ms iteration = 13 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
19332024-12-14T01:15:30.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
19342024-12-14T01:15:30.876ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19352024-12-14T01:15:30.878ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-7e423e95-464a-471f-a0d9-4799977f0b0f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-7e423e95-464a-471f-a0d9-4799977f0b0f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1493, tv_nsec: 707162621 } })
19362024-12-14T01:15:30.878ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
19372024-12-14T01:15:30.878ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.85077ms iteration = 25 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
19382024-12-14T01:15:30.879ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
19392024-12-14T01:15:30.879ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19402024-12-14T01:15:30.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19412024-12-14T01:15:30.880ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
19422024-12-14T01:15:30.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
19432024-12-14T01:15:30.881ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19442024-12-14T01:15:30.882ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19452024-12-14T01:15:30.883ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
19462024-12-14T01:15:30.883ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
19472024-12-14T01:15:30.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
19482024-12-14T01:15:30.884ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
19492024-12-14T01:15:30.884ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
19502024-12-14T01:15:30.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
19512024-12-14T01:15:30.884ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19522024-12-14T01:15:30.885ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-7e423e95-464a-471f-a0d9-4799977f0b0f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-7e423e95-464a-471f-a0d9-4799977f0b0f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1493, tv_nsec: 714728880 } })
19532024-12-14T01:15:30.886ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
19542024-12-14T01:15:30.886ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
19552024-12-14T01:15:30.886ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
19562024-12-14T01:15:30.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
19572024-12-14T01:15:30.887ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
19582024-12-14T01:15:30.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
19592024-12-14T01:15:30.888ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-14 01:05:30.874204532 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
19602024-12-14T01:15:30.888ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 14.743047ms iteration = 13 status = {"expiration":"2024-12-14T01:05:30.874204532Z","pruned":[]}
19612024-12-14T01:15:30.889ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
19622024-12-14T01:15:30.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
19632024-12-14T01:15:30.889ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19642024-12-14T01:15:30.890ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
19652024-12-14T01:15:30.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
19662024-12-14T01:15:30.891ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19672024-12-14T01:15:30.891ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 16.992052ms iteration = 13 status = {"errors":[],"found_port_ok":[]}
19682024-12-14T01:15:30.892ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19692024-12-14T01:15:30.892ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
19702024-12-14T01:15:30.892ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19712024-12-14T01:15:30.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19722024-12-14T01:15:30.893ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
19732024-12-14T01:15:30.893ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
19742024-12-14T01:15:30.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
19752024-12-14T01:15:30.893ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
19762024-12-14T01:15:30.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
19772024-12-14T01:15:30.894ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19782024-12-14T01:15:30.894ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
19792024-12-14T01:15:30.895ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
19802024-12-14T01:15:30.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
19812024-12-14T01:15:30.896ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19822024-12-14T01:15:30.896ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19832024-12-14T01:15:30.896ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
19842024-12-14T01:15:30.896ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
19852024-12-14T01:15:30.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19862024-12-14T01:15:30.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
19872024-12-14T01:15:30.896ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19882024-12-14T01:15:30.898ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-7e423e95-464a-471f-a0d9-4799977f0b0f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-7e423e95-464a-471f-a0d9-4799977f0b0f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1493, tv_nsec: 727025415 } })
19892024-12-14T01:15:30.898ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09
19902024-12-14T01:15:30.898ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
19912024-12-14T01:15:30.899ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
19922024-12-14T01:15:30.899ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
19932024-12-14T01:15:30.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
19942024-12-14T01:15:30.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
19952024-12-14T01:15:30.899ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19962024-12-14T01:15:30.900ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
19972024-12-14T01:15:30.901ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
19982024-12-14T01:15:30.901ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
19992024-12-14T01:15:30.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
20002024-12-14T01:15:30.901ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20012024-12-14T01:15:30.904ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
20022024-12-14T01:15:30.904ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
20032024-12-14T01:15:30.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
20042024-12-14T01:15:30.906ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 32.333756ms iteration = 25 status = {"errors":[],"garbage_collect_requested":[]}
20052024-12-14T01:15:30.907ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20062024-12-14T01:15:30.907ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
20072024-12-14T01:15:30.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
20082024-12-14T01:15:30.912ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
20092024-12-14T01:15:30.912ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 38.169485ms iteration = 25 status = {"errors":[],"records_set_to_done":[]}
20102024-12-14T01:15:30.914ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
20112024-12-14T01:15:30.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
20122024-12-14T01:15:30.914ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
20132024-12-14T01:15:30.914ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20142024-12-14T01:15:30.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
20152024-12-14T01:15:30.916ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
20162024-12-14T01:15:30.916ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
20172024-12-14T01:15:30.916ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
20182024-12-14T01:15:30.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
20192024-12-14T01:15:30.918ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
20202024-12-14T01:15:30.918ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
20212024-12-14T01:15:30.919ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8770bfcc-3a71-4738-a6b0-91008cadcb0f, lookup_type: ById(8770bfcc-3a71-4738-a6b0-91008cadcb0f) } result = Ok(())
20222024-12-14T01:15:30.919ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20232024-12-14T01:15:30.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20242024-12-14T01:15:30.924ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 50.700558ms iteration = 6 status = {"nsuccess":5}
20252024-12-14T01:15:30.926ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20262024-12-14T01:15:30.927ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
20272024-12-14T01:15:30.927ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
20282024-12-14T01:15:30.927ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
20292024-12-14T01:15:30.927ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
20302024-12-14T01:15:30.927ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
20312024-12-14T01:15:30.927ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
20322024-12-14T01:15:30.927ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 54.033684ms iteration = 25 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
20332024-12-14T01:15:30.929ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
20342024-12-14T01:15:30.929ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
20352024-12-14T01:15:30.929ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
20362024-12-14T01:15:30.930ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
20372024-12-14T01:15:30.930ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
20382024-12-14T01:15:30.930ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 55.842527ms iteration = 13 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
20392024-12-14T01:15:30.931ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20402024-12-14T01:15:30.933ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
20412024-12-14T01:15:30.933ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
20422024-12-14T01:15:30.933ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
20432024-12-14T01:15:30.933ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
20442024-12-14T01:15:30.933ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
20452024-12-14T01:15:30.935ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20462024-12-14T01:15:30.937ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8770bfcc-3a71-4738-a6b0-91008cadcb0f original_time_created = 2024-12-14 01:03:15.378067 UTC target_id = 8770bfcc-3a71-4738-a6b0-91008cadcb0f time_created = 2024-12-14 01:03:15.378067 UTC
20472024-12-14T01:15:30.937ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 63.325212ms iteration = 73 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8770bfcc-3a71-4738-a6b0-91008cadcb0f","time_created":"2024-12-14T01:03:15.378067Z"}
20482024-12-14T01:15:30.937ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
20492024-12-14T01:15:30.937ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
20502024-12-14T01:15:30.937ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
20512024-12-14T01:15:30.945ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
20522024-12-14T01:15:30.945ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
20532024-12-14T01:15:30.945ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
20542024-12-14T01:15:30.945ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
20552024-12-14T01:15:30.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
20562024-12-14T01:15:30.946ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
20572024-12-14T01:15:30.947ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 73.147527ms iteration = 73 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
20582024-12-14T01:15:30.947ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
20592024-12-14T01:15:30.948ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20602024-12-14T01:15:30.949ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
20612024-12-14T01:15:30.950ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
20622024-12-14T01:15:30.951ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
20632024-12-14T01:15:30.951ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
20642024-12-14T01:15:30.951ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
20652024-12-14T01:15:30.951ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
20662024-12-14T01:15:30.951ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
20672024-12-14T01:15:30.951ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
20682024-12-14T01:15:30.951ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
20692024-12-14T01:15:30.951ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
20702024-12-14T01:15:30.952ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
20712024-12-14T01:15:30.952ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
20722024-12-14T01:15:30.952ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 77.801681ms iteration = 13 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
20732024-12-14T01:15:30.953ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20742024-12-14T01:15:30.954ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20752024-12-14T01:15:30.955ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20762024-12-14T01:15:30.957ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
20772024-12-14T01:15:30.957ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 83.358383ms iteration = 13 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
20782024-12-14T01:15:30.957ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
20792024-12-14T01:15:30.957ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
20802024-12-14T01:15:30.957ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
20812024-12-14T01:15:30.957ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
20822024-12-14T01:15:30.958ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
20832024-12-14T01:15:30.958ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
20842024-12-14T01:15:30.959ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 7e423e95-464a-471f-a0d9-4799977f0b0f, lookup_type: ById(7e423e95-464a-471f-a0d9-4799977f0b0f) } result = Ok(())
20852024-12-14T01:15:30.959ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
20862024-12-14T01:15:30.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
20872024-12-14T01:15:30.961ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 86.674688ms iteration = 25 status = 0
20882024-12-14T01:15:30.964ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 90.266122ms iteration = 25 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
20892024-12-14T01:15:30.966ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
20902024-12-14T01:15:30.966ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
20912024-12-14T01:15:30.966ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 92.228209ms iteration = 25 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
20922024-12-14T01:15:30.974ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-14T01:03:19.260831Z, time_modified: 2024-12-14T01:03:19.260831Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, db_silo: Silo { identity: SiloIdentity { id: 2c668072-a9a1-4a69-928c-e118c99521be, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-14T01:03:52.950638Z, time_modified: 2024-12-14T01:03:52.950638Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "ad8fd43e0fc4f6284dc5e0b0d0f2e6a6e8d979d13f86a71c9b81d6817e439efd" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, db_silo: Silo { identity: SiloIdentity { id: 2c668072-a9a1-4a69-928c-e118c99521be, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-14T01:03:52.950638Z, time_modified: 2024-12-14T01:03:52.950638Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "ad8fd43e0fc4f6284dc5e0b0d0f2e6a6e8d979d13f86a71c9b81d6817e439efd" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
20932024-12-14T01:15:30.974ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 99.735426ms iteration = 13 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"2c668072-a9a1-4a69-928c-e118c99521be","tls_certs":["ad8fd43e0fc4f6284dc5e0b0d0f2e6a6e8d979d13f86a71c9b81d6817e439efd"]}},"default_endpoint":{"silo_id":"2c668072-a9a1-4a69-928c-e118c99521be","tls_certs":["ad8fd43e0fc4f6284dc5e0b0d0f2e6a6e8d979d13f86a71c9b81d6817e439efd"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
20942024-12-14T01:15:30.976ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
20952024-12-14T01:15:30.977ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
20962024-12-14T01:15:30.979ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 1 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
20972024-12-14T01:15:30.979ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 105.479853ms iteration = 25 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":1,"total_instances":0,"update_sagas_queued":0}
20982024-12-14T01:15:30.983ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
20992024-12-14T01:15:30.983ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = d9c36d0c-d7d2-439f-a748-798b6d8dea0c dns_zone_name = oxide.test found_so_far = 0 version = 2
21002024-12-14T01:15:30.983ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
21012024-12-14T01:15:30.983ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
21022024-12-14T01:15:30.985ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21032024-12-14T01:15:30.986ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
21042024-12-14T01:15:30.986ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 866c9448-c447-4b92-96b6-611d51967e09 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
21052024-12-14T01:15:30.986ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
21062024-12-14T01:15:30.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
21072024-12-14T01:15:30.988ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21082024-12-14T01:15:30.988ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
21092024-12-14T01:15:30.988ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
21102024-12-14T01:15:30.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
21112024-12-14T01:15:30.990ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = d9c36d0c-d7d2-439f-a748-798b6d8dea0c dns_zone_name = oxide.test found_so_far = 1 version = 2
21122024-12-14T01:15:30.990ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
21132024-12-14T01:15:30.990ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-14 01:03:53.017536 UTC dns_group = external generation = 2
21142024-12-14T01:15:30.990ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 116.432539ms iteration = 13 status = {"generation":2}
21152024-12-14T01:15:30.990ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
21162024-12-14T01:15:30.990ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
21172024-12-14T01:15:30.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
21182024-12-14T01:15:30.992ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 866c9448-c447-4b92-96b6-611d51967e09 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
21192024-12-14T01:15:30.992ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
21202024-12-14T01:15:30.992ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-14 01:03:51.993091 UTC dns_group = internal generation = 1
21212024-12-14T01:15:30.992ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 118.54212ms iteration = 13 status = {"generation":1}
21222024-12-14T01:15:30.996ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 122.175966ms iteration = 27 status = {"physical_disks_added":0}
21232024-12-14T01:15:31.008ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
21242024-12-14T01:15:31.008ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
21252024-12-14T01:15:31.009ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 134.880084ms iteration = 25 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
21262024-12-14T01:15:31.010ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21272024-12-14T01:15:31.011ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
21282024-12-14T01:15:31.011ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
21292024-12-14T01:15:31.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
21302024-12-14T01:15:31.013ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21312024-12-14T01:15:31.015ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
21322024-12-14T01:15:31.015ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
21332024-12-14T01:15:31.015ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
21342024-12-14T01:15:31.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
21352024-12-14T01:15:31.036ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
21362024-12-14T01:15:31.036ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
21372024-12-14T01:15:31.036ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b4f02116-2ec3-45e5-93fe-f5a64320c794", "content-length": "26", "date": "Sat, 14 Dec 2024 01:15:31 GMT"} })
21382024-12-14T01:15:31.036ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
21392024-12-14T01:15:31.038ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
21402024-12-14T01:15:31.074ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 zone_address = fd00:1122:3344:101::2
21412024-12-14T01:15:31.074ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
21422024-12-14T01:15:31.074ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0d351cbe-3d03-4682-9b23-eed86e229363", "content-length": "26", "date": "Sat, 14 Dec 2024 01:15:31 GMT"} })
21432024-12-14T01:15:31.074ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
21442024-12-14T01:15:31.075ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09
21452024-12-14T01:15:31.130ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
21462024-12-14T01:15:31.201ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
21472024-12-14T01:15:31.206ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
21482024-12-14T01:15:31.206ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
21492024-12-14T01:15:31.206ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c6fb6bb6-36b4-4d35-a53e-11d1d583955a", "content-length": "26", "date": "Sat, 14 Dec 2024 01:15:31 GMT"} })
21502024-12-14T01:15:31.206ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
21512024-12-14T01:15:31.207ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
21522024-12-14T01:15:31.316ZDEBGnexus (BackgroundTasks): client request SledAgent = 7e423e95-464a-471f-a0d9-4799977f0b0f background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
21532024-12-14T01:15:31.317ZDEBGnexus (BackgroundTasks): client response SledAgent = 7e423e95-464a-471f-a0d9-4799977f0b0f background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "c98040da-e11b-4879-a7e7-5506cde7ed23", "content-length": "691", "date": "Sat, 14 Dec 2024 01:15:31 GMT"} })
21542024-12-14T01:15:31.317ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
21552024-12-14T01:15:31.317ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
21562024-12-14T01:15:31.317ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
21572024-12-14T01:15:31.318ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 444.923626ms iteration = 27 status = {}
21582024-12-14T01:15:31.326ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
21592024-12-14T01:15:31.327ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "7457a0ff-a0a6-4284-baba-d958edb6cd73", "date": "Sat, 14 Dec 2024 01:15:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
21602024-12-14T01:15:31.327ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
21612024-12-14T01:15:31.329ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "c9b1ee58-d897-4a9b-acdc-899d10dd8f2f", "date": "Sat, 14 Dec 2024 01:15:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
21622024-12-14T01:15:31.329ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
21632024-12-14T01:15:31.331ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
21642024-12-14T01:15:31.331ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 456.743577ms iteration = 15 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
21652024-12-14T01:15:31.337ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 463.176644ms iteration = 25 status = {}
21662024-12-14T01:15:31.344ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
21672024-12-14T01:15:31.345ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "6d7c9b58-618a-443a-a9fa-6d4a8b85d6e3", "date": "Sat, 14 Dec 2024 01:15:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
21682024-12-14T01:15:31.345ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
21692024-12-14T01:15:31.347ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
21702024-12-14T01:15:31.347ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "0e9f00c6-0bb7-47ab-b1f1-9e2440664986", "content-length": "2", "date": "Sat, 14 Dec 2024 01:15:31 GMT"} })
21712024-12-14T01:15:31.347ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "5ba5fd6c-daf1-4a91-8de7-0f1fe838524d", "date": "Sat, 14 Dec 2024 01:15:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
21722024-12-14T01:15:31.347ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
21732024-12-14T01:15:31.349ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
21742024-12-14T01:15:31.349ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "b4c9801d-b8a3-4282-8516-69163a5c8538", "date": "Sat, 14 Dec 2024 01:15:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
21752024-12-14T01:15:31.349ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
21762024-12-14T01:15:31.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
21772024-12-14T01:15:31.351ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
21782024-12-14T01:15:31.351ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 477.53904ms iteration = 15 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
21792024-12-14T01:15:31.352ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 477.930661ms iteration = 25 status = null
21802024-12-14T01:15:31.387ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
21812024-12-14T01:15:31.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
21822024-12-14T01:15:31.389ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: bb1a4b50-730e-48ee-a311-8a9b9d7bcb73, rack_id: f30fd360-30ae-4088-9821-aa98c2bc8c09, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(bb9f5a1a-5708-4d58-ba4f-c62102236426) } rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 switch_location = Switch0
21832024-12-14T01:15:31.389ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
21842024-12-14T01:15:31.389ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
21852024-12-14T01:15:31.399ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
21862024-12-14T01:15:31.399ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "8542b628-058c-48a3-b3c0-104c4fd86cb6", "content-length": "134", "date": "Sat, 14 Dec 2024 01:15:31 GMT"} })
21872024-12-14T01:15:31.399ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
21882024-12-14T01:15:31.399ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = bb9f5a1a-5708-4d58-ba4f-c62102236426
21892024-12-14T01:15:31.399ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
21902024-12-14T01:15:31.399ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
21912024-12-14T01:15:31.399ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
21922024-12-14T01:15:31.399ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
21932024-12-14T01:15:31.399ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
21942024-12-14T01:15:31.399ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
21952024-12-14T01:15:31.400ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
21962024-12-14T01:15:31.400ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
21972024-12-14T01:15:31.400ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09
21982024-12-14T01:15:31.400ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
21992024-12-14T01:15:31.400ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22002024-12-14T01:15:31.402ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
22012024-12-14T01:15:31.402ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "3914b4a6-9a90-4670-96e5-8c5be67e0fd5", "content-length": "2", "date": "Sat, 14 Dec 2024 01:15:31 GMT"} })
22022024-12-14T01:15:31.402ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
22032024-12-14T01:15:31.402ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "99743cb4-ecfe-4609-a071-4d804c9a73b6", "content-length": "52", "date": "Sat, 14 Dec 2024 01:15:31 GMT"} })
22042024-12-14T01:15:31.402ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 switch_location = Switch0
22052024-12-14T01:15:31.402ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
22062024-12-14T01:15:31.497ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "dcf08ca2-7580-47fd-a5af-81cd2cb7250d", "date": "Sat, 14 Dec 2024 01:15:31 GMT"} })
22072024-12-14T01:15:31.497ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 switch = Switch0
22082024-12-14T01:15:31.497ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
22092024-12-14T01:15:31.497ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "70c036e5-40a1-471e-bd4d-beca28a89fc0", "content-length": "682", "date": "Sat, 14 Dec 2024 01:15:31 GMT"} })
22102024-12-14T01:15:31.497ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22112024-12-14T01:15:31.497ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22122024-12-14T01:15:31.501ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22132024-12-14T01:15:31.501ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22142024-12-14T01:15:31.505ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22152024-12-14T01:15:31.505ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22162024-12-14T01:15:31.507ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22172024-12-14T01:15:31.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22182024-12-14T01:15:31.514ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 640.287679ms iteration = 25 status = {}
22192024-12-14T01:15:33.451ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:35184 req_id = 97a48fa7-af70-49dc-818b-ad40e8a76e4a roles = RoleSet { roles: {} } uri = /metrics/collectors/6e1e4a25-c6a7-49c5-bb1d-86638130bef7/producers?sort_by=id_ascending
22202024-12-14T01:15:33.452ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:35184 req_id = 97a48fa7-af70-49dc-818b-ad40e8a76e4a resource = Database result = Ok(()) uri = /metrics/collectors/6e1e4a25-c6a7-49c5-bb1d-86638130bef7/producers?sort_by=id_ascending
22212024-12-14T01:15:33.454ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3233 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:35184 req_id = 97a48fa7-af70-49dc-818b-ad40e8a76e4a response_code = 200 uri = /metrics/collectors/6e1e4a25-c6a7-49c5-bb1d-86638130bef7/producers?sort_by=id_ascending
22222024-12-14T01:15:33.455ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:35184 req_id = 4f17e0d5-d3ec-4b0b-b6e5-f420a66e2eb7 roles = RoleSet { roles: {} } uri = /metrics/collectors/6e1e4a25-c6a7-49c5-bb1d-86638130bef7/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNGM2ZGNlZi0yNTc3LTQxMmUtODNkMS0zNzkyZGNjMDQ2MWQifX0%3D
22232024-12-14T01:15:33.455ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:35184 req_id = 4f17e0d5-d3ec-4b0b-b6e5-f420a66e2eb7 resource = Database result = Ok(()) uri = /metrics/collectors/6e1e4a25-c6a7-49c5-bb1d-86638130bef7/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNGM2ZGNlZi0yNTc3LTQxMmUtODNkMS0zNzkyZGNjMDQ2MWQifX0%3D
22242024-12-14T01:15:33.457ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2421 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:35184 req_id = 4f17e0d5-d3ec-4b0b-b6e5-f420a66e2eb7 response_code = 200 uri = /metrics/collectors/6e1e4a25-c6a7-49c5-bb1d-86638130bef7/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNGM2ZGNlZi0yNTc3LTQxMmUtODNkMS0zNzkyZGNjMDQ2MWQifX0%3D
22252024-12-14T01:15:33.461ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1591 local_addr = [fd00:1122:3344:101::a]:59823 method = GET remote_addr = [fd00:1122:3344:101::d]:36065 req_id = 36a1f6b5-318e-4f85-8162-50ba17281def response_code = 200 uri = /ec66f35d-9dc5-46c1-80a1-ebaa91a8212a
22262024-12-14T01:15:37.182ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 28 reason = Timeout
22272024-12-14T01:15:37.182ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
22282024-12-14T01:15:37.182ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
22292024-12-14T01:15:37.182ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
22302024-12-14T01:15:37.184ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22312024-12-14T01:15:37.186ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
22322024-12-14T01:15:37.186ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
22332024-12-14T01:15:37.186ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
22342024-12-14T01:15:37.188ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22352024-12-14T01:15:37.190ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
22362024-12-14T01:15:37.190ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
22372024-12-14T01:15:37.190ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
22382024-12-14T01:15:37.222ZINFOnexus (BackgroundTasks): VPC route manager sled 7e423e95-464a-471f-a0d9-4799977f0b0f background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
22392024-12-14T01:15:37.222ZDEBGnexus (BackgroundTasks): client request SledAgent = 7e423e95-464a-471f-a0d9-4799977f0b0f background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
22402024-12-14T01:15:37.223ZDEBGnexus (BackgroundTasks): client response SledAgent = 7e423e95-464a-471f-a0d9-4799977f0b0f background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "04ef2ded-258d-41d2-83e8-f5ddee8becda", "content-length": "372", "date": "Sat, 14 Dec 2024 01:15:37 GMT"} })
22412024-12-14T01:15:37.223ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
22422024-12-14T01:15:37.223ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
22432024-12-14T01:15:37.236ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
22442024-12-14T01:15:37.236ZDEBGnexus (BackgroundTasks): client request SledAgent = 7e423e95-464a-471f-a0d9-4799977f0b0f background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
22452024-12-14T01:15:37.237ZDEBGnexus (BackgroundTasks): client response SledAgent = 7e423e95-464a-471f-a0d9-4799977f0b0f background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "cbd56162-6868-48df-ab05-28c5ecd79807", "date": "Sat, 14 Dec 2024 01:15:37 GMT"} })
22462024-12-14T01:15:37.237ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
22472024-12-14T01:15:37.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
22482024-12-14T01:15:37.239ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
22492024-12-14T01:15:37.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
22502024-12-14T01:15:37.241ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
22512024-12-14T01:15:37.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
22522024-12-14T01:15:37.244ZINFOnexus (BackgroundTasks): VPC route manager sled 7e423e95-464a-471f-a0d9-4799977f0b0f push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
22532024-12-14T01:15:37.244ZDEBGnexus (BackgroundTasks): client request SledAgent = 7e423e95-464a-471f-a0d9-4799977f0b0f background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
22542024-12-14T01:15:37.245ZDEBGnexus (BackgroundTasks): client response SledAgent = 7e423e95-464a-471f-a0d9-4799977f0b0f background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "4cb24def-7564-48bc-aeb3-0a624f091e3d", "date": "Sat, 14 Dec 2024 01:15:37 GMT"} })
22552024-12-14T01:15:37.246ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 64.463555ms iteration = 28 status = {}
22562024-12-14T01:15:40.873ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 74 reason = Timeout
22572024-12-14T01:15:40.873ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 74 reason = Timeout
22582024-12-14T01:15:40.873ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
22592024-12-14T01:15:40.873ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22602024-12-14T01:15:40.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
22612024-12-14T01:15:40.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22622024-12-14T01:15:40.876ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
22632024-12-14T01:15:40.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
22642024-12-14T01:15:40.876ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22652024-12-14T01:15:40.879ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
22662024-12-14T01:15:40.879ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22672024-12-14T01:15:40.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22682024-12-14T01:15:40.881ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22692024-12-14T01:15:40.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22702024-12-14T01:15:40.882ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22712024-12-14T01:15:40.885ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8770bfcc-3a71-4738-a6b0-91008cadcb0f, lookup_type: ById(8770bfcc-3a71-4738-a6b0-91008cadcb0f) } result = Ok(())
22722024-12-14T01:15:40.885ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22732024-12-14T01:15:40.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22742024-12-14T01:15:40.897ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8770bfcc-3a71-4738-a6b0-91008cadcb0f original_time_created = 2024-12-14 01:03:15.378067 UTC target_id = 8770bfcc-3a71-4738-a6b0-91008cadcb0f time_created = 2024-12-14 01:03:15.378067 UTC
22752024-12-14T01:15:40.897ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.83691ms iteration = 74 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8770bfcc-3a71-4738-a6b0-91008cadcb0f","time_created":"2024-12-14T01:03:15.378067Z"}
22762024-12-14T01:15:40.906ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 32.720707ms iteration = 74 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
22772024-12-14T01:15:43.461ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1573 local_addr = [fd00:1122:3344:101::a]:59823 method = GET remote_addr = [fd00:1122:3344:101::d]:36065 req_id = 55ee7394-2df5-4d81-b365-11e6ceaf6a7d response_code = 200 uri = /ec66f35d-9dc5-46c1-80a1-ebaa91a8212a
22782024-12-14T01:15:50.873ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 75 reason = Timeout
22792024-12-14T01:15:50.874ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 75 reason = Timeout
22802024-12-14T01:15:50.874ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22812024-12-14T01:15:50.874ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
22822024-12-14T01:15:50.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22832024-12-14T01:15:50.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
22842024-12-14T01:15:50.876ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22852024-12-14T01:15:50.877ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
22862024-12-14T01:15:50.877ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
22872024-12-14T01:15:50.878ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.775988ms iteration = 75 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
22882024-12-14T01:15:50.879ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
22892024-12-14T01:15:50.879ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22902024-12-14T01:15:50.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22912024-12-14T01:15:50.881ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22922024-12-14T01:15:50.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22932024-12-14T01:15:50.882ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22942024-12-14T01:15:50.885ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8770bfcc-3a71-4738-a6b0-91008cadcb0f, lookup_type: ById(8770bfcc-3a71-4738-a6b0-91008cadcb0f) } result = Ok(())
22952024-12-14T01:15:50.885ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22962024-12-14T01:15:50.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22972024-12-14T01:15:50.894ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8770bfcc-3a71-4738-a6b0-91008cadcb0f original_time_created = 2024-12-14 01:03:15.378067 UTC target_id = 8770bfcc-3a71-4738-a6b0-91008cadcb0f time_created = 2024-12-14 01:03:15.378067 UTC
22982024-12-14T01:15:50.894ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.461593ms iteration = 75 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8770bfcc-3a71-4738-a6b0-91008cadcb0f","time_created":"2024-12-14T01:03:15.378067Z"}
22992024-12-14T01:15:53.461ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1697 local_addr = [fd00:1122:3344:101::a]:59823 method = GET remote_addr = [fd00:1122:3344:101::d]:36065 req_id = ce1b2331-21e4-4e03-af88-5d9b4d4ea4f9 response_code = 200 uri = /ec66f35d-9dc5-46c1-80a1-ebaa91a8212a
23002024-12-14T01:16:00.873ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 76 reason = Timeout
23012024-12-14T01:16:00.873ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23022024-12-14T01:16:00.873ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 26 reason = Timeout
23032024-12-14T01:16:00.873ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
23042024-12-14T01:16:00.873ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 28 reason = Timeout
23052024-12-14T01:16:00.873ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
23062024-12-14T01:16:00.873ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 28 reason = Timeout
23072024-12-14T01:16:00.873ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
23082024-12-14T01:16:00.873ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
23092024-12-14T01:16:00.873ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 26 reason = Timeout
23102024-12-14T01:16:00.873ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 26 reason = Timeout
23112024-12-14T01:16:00.873ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
23122024-12-14T01:16:00.873ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
23132024-12-14T01:16:00.873ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 26 reason = Timeout
23142024-12-14T01:16:00.873ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
23152024-12-14T01:16:00.873ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 76 reason = Timeout
23162024-12-14T01:16:00.873ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
23172024-12-14T01:16:00.873ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 26 reason = Timeout
23182024-12-14T01:16:00.873ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 26 reason = Timeout
23192024-12-14T01:16:00.873ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
23202024-12-14T01:16:00.873ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
23212024-12-14T01:16:00.873ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 26 reason = Timeout
23222024-12-14T01:16:00.873ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
23232024-12-14T01:16:00.873ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 26 reason = Timeout
23242024-12-14T01:16:00.873ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
23252024-12-14T01:16:00.873ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 26 reason = Timeout
23262024-12-14T01:16:00.873ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
23272024-12-14T01:16:00.873ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 26 reason = Timeout
23282024-12-14T01:16:00.873ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 26 reason = Timeout
23292024-12-14T01:16:00.873ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
23302024-12-14T01:16:00.873ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 26 reason = Timeout
23312024-12-14T01:16:00.873ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
23322024-12-14T01:16:00.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23332024-12-14T01:16:00.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
23342024-12-14T01:16:00.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
23352024-12-14T01:16:00.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
23362024-12-14T01:16:00.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
23372024-12-14T01:16:00.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
23382024-12-14T01:16:00.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
23392024-12-14T01:16:00.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
23402024-12-14T01:16:00.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
23412024-12-14T01:16:00.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
23422024-12-14T01:16:00.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
23432024-12-14T01:16:00.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
23442024-12-14T01:16:00.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
23452024-12-14T01:16:00.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
23462024-12-14T01:16:00.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
23472024-12-14T01:16:00.876ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23482024-12-14T01:16:00.877ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.083908ms iteration = 26 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
23492024-12-14T01:16:00.877ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23502024-12-14T01:16:00.878ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
23512024-12-14T01:16:00.878ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
23522024-12-14T01:16:00.878ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
23532024-12-14T01:16:00.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
23542024-12-14T01:16:00.879ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
23552024-12-14T01:16:00.879ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23562024-12-14T01:16:00.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23572024-12-14T01:16:00.880ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
23582024-12-14T01:16:00.880ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
23592024-12-14T01:16:00.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
23602024-12-14T01:16:00.881ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
23612024-12-14T01:16:00.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
23622024-12-14T01:16:00.882ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-7e423e95-464a-471f-a0d9-4799977f0b0f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-7e423e95-464a-471f-a0d9-4799977f0b0f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1523, tv_nsec: 711275491 } })
23632024-12-14T01:16:00.882ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
23642024-12-14T01:16:00.882ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23652024-12-14T01:16:00.883ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-7e423e95-464a-471f-a0d9-4799977f0b0f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-7e423e95-464a-471f-a0d9-4799977f0b0f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1523, tv_nsec: 712462826 } })
23662024-12-14T01:16:00.883ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23672024-12-14T01:16:00.883ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
23682024-12-14T01:16:00.886ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
23692024-12-14T01:16:00.886ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
23702024-12-14T01:16:00.886ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
23712024-12-14T01:16:00.886ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
23722024-12-14T01:16:00.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
23732024-12-14T01:16:00.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
23742024-12-14T01:16:00.888ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23752024-12-14T01:16:00.889ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23762024-12-14T01:16:00.889ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
23772024-12-14T01:16:00.889ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
23782024-12-14T01:16:00.889ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
23792024-12-14T01:16:00.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23802024-12-14T01:16:00.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
23812024-12-14T01:16:00.890ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
23822024-12-14T01:16:00.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
23832024-12-14T01:16:00.890ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
23842024-12-14T01:16:00.890ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
23852024-12-14T01:16:00.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
23862024-12-14T01:16:00.891ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
23872024-12-14T01:16:00.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
23882024-12-14T01:16:00.892ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
23892024-12-14T01:16:00.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
23902024-12-14T01:16:00.895ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-7e423e95-464a-471f-a0d9-4799977f0b0f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-7e423e95-464a-471f-a0d9-4799977f0b0f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1523, tv_nsec: 724412102 } })
23912024-12-14T01:16:00.895ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09
23922024-12-14T01:16:00.897ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
23932024-12-14T01:16:00.897ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 24.54742ms iteration = 26 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
23942024-12-14T01:16:00.907ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 34.269902ms iteration = 26 status = {"errors":[],"garbage_collect_requested":[]}
23952024-12-14T01:16:00.908ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
23962024-12-14T01:16:00.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
23972024-12-14T01:16:00.910ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
23982024-12-14T01:16:00.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
23992024-12-14T01:16:00.910ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 37.31552ms iteration = 26 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
24002024-12-14T01:16:00.912ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
24012024-12-14T01:16:00.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
24022024-12-14T01:16:00.913ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
24032024-12-14T01:16:00.913ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24042024-12-14T01:16:00.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
24052024-12-14T01:16:00.916ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 7e423e95-464a-471f-a0d9-4799977f0b0f, lookup_type: ById(7e423e95-464a-471f-a0d9-4799977f0b0f) } result = Ok(())
24062024-12-14T01:16:00.916ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
24072024-12-14T01:16:00.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
24082024-12-14T01:16:00.917ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 44.113967ms iteration = 26 status = {"errors":[],"records_set_to_done":[]}
24092024-12-14T01:16:00.919ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 45.709332ms iteration = 26 status = 0
24102024-12-14T01:16:00.919ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 45.938389ms iteration = 76 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
24112024-12-14T01:16:00.921ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24122024-12-14T01:16:00.923ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
24132024-12-14T01:16:00.924ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
24142024-12-14T01:16:00.924ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
24152024-12-14T01:16:00.926ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
24162024-12-14T01:16:00.926ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
24172024-12-14T01:16:00.926ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 53.666553ms iteration = 26 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
24182024-12-14T01:16:00.926ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24192024-12-14T01:16:00.926ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
24202024-12-14T01:16:00.927ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
24212024-12-14T01:16:00.929ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 56.429533ms iteration = 26 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
24222024-12-14T01:16:00.930ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8770bfcc-3a71-4738-a6b0-91008cadcb0f, lookup_type: ById(8770bfcc-3a71-4738-a6b0-91008cadcb0f) } result = Ok(())
24232024-12-14T01:16:00.930ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24242024-12-14T01:16:00.931ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24252024-12-14T01:16:00.945ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8770bfcc-3a71-4738-a6b0-91008cadcb0f original_time_created = 2024-12-14 01:03:15.378067 UTC target_id = 8770bfcc-3a71-4738-a6b0-91008cadcb0f time_created = 2024-12-14 01:03:15.378067 UTC
24262024-12-14T01:16:00.945ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 72.55337ms iteration = 76 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8770bfcc-3a71-4738-a6b0-91008cadcb0f","time_created":"2024-12-14T01:03:15.378067Z"}
24272024-12-14T01:16:00.946ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
24282024-12-14T01:16:00.946ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
24292024-12-14T01:16:00.946ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d60fcb68-e7e3-407a-aeff-7b98591de2bf", "content-length": "26", "date": "Sat, 14 Dec 2024 01:16:00 GMT"} })
24302024-12-14T01:16:00.946ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
24312024-12-14T01:16:00.948ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
24322024-12-14T01:16:00.950ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
24332024-12-14T01:16:00.950ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
24342024-12-14T01:16:00.950ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a5fceaaa-dd21-48d8-9430-9b514273e142", "content-length": "26", "date": "Sat, 14 Dec 2024 01:16:00 GMT"} })
24352024-12-14T01:16:00.950ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
24362024-12-14T01:16:00.951ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
24372024-12-14T01:16:00.953ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
24382024-12-14T01:16:00.953ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
24392024-12-14T01:16:00.969ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 zone_address = fd00:1122:3344:101::2
24402024-12-14T01:16:00.969ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
24412024-12-14T01:16:00.969ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0b80a88f-7021-4428-8657-db2d3bf3098e", "content-length": "26", "date": "Sat, 14 Dec 2024 01:16:00 GMT"} })
24422024-12-14T01:16:00.969ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
24432024-12-14T01:16:00.972ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09
24442024-12-14T01:16:00.985ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 112.500835ms iteration = 26 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
24452024-12-14T01:16:00.996ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
24462024-12-14T01:16:00.997ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
24472024-12-14T01:16:00.998ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24482024-12-14T01:16:01.000ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
24492024-12-14T01:16:01.000ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
24502024-12-14T01:16:01.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
24512024-12-14T01:16:01.002ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24522024-12-14T01:16:01.004ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
24532024-12-14T01:16:01.004ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
24542024-12-14T01:16:01.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
24552024-12-14T01:16:01.021ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 148.020653ms iteration = 28 status = {"physical_disks_added":0}
24562024-12-14T01:16:01.032ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 159.356322ms iteration = 26 status = {}
24572024-12-14T01:16:01.039ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
24582024-12-14T01:16:01.040ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "da01730a-aba6-4af0-975f-2111913f1a79", "content-length": "2", "date": "Sat, 14 Dec 2024 01:16:00 GMT"} })
24592024-12-14T01:16:01.041ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
24602024-12-14T01:16:01.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
24612024-12-14T01:16:01.044ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 170.849534ms iteration = 26 status = null
24622024-12-14T01:16:01.083ZDEBGnexus (BackgroundTasks): client request SledAgent = 7e423e95-464a-471f-a0d9-4799977f0b0f background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
24632024-12-14T01:16:01.083ZDEBGnexus (BackgroundTasks): client response SledAgent = 7e423e95-464a-471f-a0d9-4799977f0b0f background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "f4f781b8-78e4-4acd-bb5a-eb43a1bf03f4", "content-length": "691", "date": "Sat, 14 Dec 2024 01:16:01 GMT"} })
24642024-12-14T01:16:01.083ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
24652024-12-14T01:16:01.083ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
24662024-12-14T01:16:01.083ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
24672024-12-14T01:16:01.085ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 212.769928ms iteration = 28 status = {}
24682024-12-14T01:16:01.132ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24692024-12-14T01:16:01.132ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24702024-12-14T01:16:01.134ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: bb1a4b50-730e-48ee-a311-8a9b9d7bcb73, rack_id: f30fd360-30ae-4088-9821-aa98c2bc8c09, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(bb9f5a1a-5708-4d58-ba4f-c62102236426) } rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 switch_location = Switch0
24712024-12-14T01:16:01.134ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24722024-12-14T01:16:01.134ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24732024-12-14T01:16:01.144ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
24742024-12-14T01:16:01.144ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "34d66633-033d-47e4-a485-739f219bb3a7", "content-length": "134", "date": "Sat, 14 Dec 2024 01:16:00 GMT"} })
24752024-12-14T01:16:01.144ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
24762024-12-14T01:16:01.144ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = bb9f5a1a-5708-4d58-ba4f-c62102236426
24772024-12-14T01:16:01.145ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
24782024-12-14T01:16:01.145ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
24792024-12-14T01:16:01.145ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
24802024-12-14T01:16:01.145ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
24812024-12-14T01:16:01.145ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
24822024-12-14T01:16:01.145ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
24832024-12-14T01:16:01.145ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
24842024-12-14T01:16:01.145ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
24852024-12-14T01:16:01.145ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09
24862024-12-14T01:16:01.145ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24872024-12-14T01:16:01.145ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24882024-12-14T01:16:01.146ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
24892024-12-14T01:16:01.147ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "ae27f19d-d4fd-48f7-ba9d-95685164bccf", "content-length": "2", "date": "Sat, 14 Dec 2024 01:16:00 GMT"} })
24902024-12-14T01:16:01.147ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
24912024-12-14T01:16:01.147ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "1c70517b-6645-4a11-9f26-46b832c3ffe9", "content-length": "52", "date": "Sat, 14 Dec 2024 01:16:00 GMT"} })
24922024-12-14T01:16:01.147ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 switch_location = Switch0
24932024-12-14T01:16:01.147ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
24942024-12-14T01:16:01.246ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "7ba27cd8-99f9-469e-9088-2f88c6abeb61", "date": "Sat, 14 Dec 2024 01:16:01 GMT"} })
24952024-12-14T01:16:01.246ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 switch = Switch0
24962024-12-14T01:16:01.246ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
24972024-12-14T01:16:01.246ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "60a30324-ee09-47ff-b95e-f9b78c5cbb35", "content-length": "682", "date": "Sat, 14 Dec 2024 01:16:01 GMT"} })
24982024-12-14T01:16:01.246ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24992024-12-14T01:16:01.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25002024-12-14T01:16:01.250ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25012024-12-14T01:16:01.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25022024-12-14T01:16:01.254ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25032024-12-14T01:16:01.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25042024-12-14T01:16:01.257ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25052024-12-14T01:16:01.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25062024-12-14T01:16:01.264ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 391.351955ms iteration = 26 status = {}
25072024-12-14T01:16:03.460ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1615 local_addr = [fd00:1122:3344:101::a]:59823 method = GET remote_addr = [fd00:1122:3344:101::d]:36065 req_id = 39059387-1c2c-405d-bebf-867e1ab83a2f response_code = 200 uri = /ec66f35d-9dc5-46c1-80a1-ebaa91a8212a
25082024-12-14T01:16:07.181ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 29 reason = Timeout
25092024-12-14T01:16:07.181ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
25102024-12-14T01:16:07.181ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25112024-12-14T01:16:07.181ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25122024-12-14T01:16:07.183ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25132024-12-14T01:16:07.185ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
25142024-12-14T01:16:07.185ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25152024-12-14T01:16:07.186ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25162024-12-14T01:16:07.188ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25172024-12-14T01:16:07.190ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
25182024-12-14T01:16:07.190ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25192024-12-14T01:16:07.190ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25202024-12-14T01:16:07.279ZINFOnexus (BackgroundTasks): VPC route manager sled 7e423e95-464a-471f-a0d9-4799977f0b0f background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
25212024-12-14T01:16:07.279ZDEBGnexus (BackgroundTasks): client request SledAgent = 7e423e95-464a-471f-a0d9-4799977f0b0f background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
25222024-12-14T01:16:07.280ZDEBGnexus (BackgroundTasks): client response SledAgent = 7e423e95-464a-471f-a0d9-4799977f0b0f background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "12837bf2-3072-4f45-b427-e0985c87eaeb", "content-length": "372", "date": "Sat, 14 Dec 2024 01:16:07 GMT"} })
25232024-12-14T01:16:07.280ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25242024-12-14T01:16:07.280ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25252024-12-14T01:16:07.293ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
25262024-12-14T01:16:07.293ZDEBGnexus (BackgroundTasks): client request SledAgent = 7e423e95-464a-471f-a0d9-4799977f0b0f background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
25272024-12-14T01:16:07.294ZDEBGnexus (BackgroundTasks): client response SledAgent = 7e423e95-464a-471f-a0d9-4799977f0b0f background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "ebc59fb7-7138-49a6-882e-7a3b3d0eecc6", "date": "Sat, 14 Dec 2024 01:16:07 GMT"} })
25282024-12-14T01:16:07.294ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25292024-12-14T01:16:07.295ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25302024-12-14T01:16:07.297ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25312024-12-14T01:16:07.297ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25322024-12-14T01:16:07.301ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25332024-12-14T01:16:07.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25342024-12-14T01:16:07.304ZINFOnexus (BackgroundTasks): VPC route manager sled 7e423e95-464a-471f-a0d9-4799977f0b0f push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
25352024-12-14T01:16:07.304ZDEBGnexus (BackgroundTasks): client request SledAgent = 7e423e95-464a-471f-a0d9-4799977f0b0f background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
25362024-12-14T01:16:07.305ZDEBGnexus (BackgroundTasks): client response SledAgent = 7e423e95-464a-471f-a0d9-4799977f0b0f background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "0afc25df-23e4-46e4-8871-0c9f1cb30649", "date": "Sat, 14 Dec 2024 01:16:07 GMT"} })
25372024-12-14T01:16:07.306ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 124.895674ms iteration = 29 status = {}
25382024-12-14T01:16:10.873ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 77 reason = Timeout
25392024-12-14T01:16:10.873ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 77 reason = Timeout
25402024-12-14T01:16:10.873ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
25412024-12-14T01:16:10.873ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25422024-12-14T01:16:10.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
25432024-12-14T01:16:10.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25442024-12-14T01:16:10.876ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25452024-12-14T01:16:10.878ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
25462024-12-14T01:16:10.878ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25472024-12-14T01:16:10.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25482024-12-14T01:16:10.880ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25492024-12-14T01:16:10.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25502024-12-14T01:16:10.881ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25512024-12-14T01:16:10.884ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8770bfcc-3a71-4738-a6b0-91008cadcb0f, lookup_type: ById(8770bfcc-3a71-4738-a6b0-91008cadcb0f) } result = Ok(())
25522024-12-14T01:16:10.884ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25532024-12-14T01:16:10.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25542024-12-14T01:16:10.893ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8770bfcc-3a71-4738-a6b0-91008cadcb0f original_time_created = 2024-12-14 01:03:15.378067 UTC target_id = 8770bfcc-3a71-4738-a6b0-91008cadcb0f time_created = 2024-12-14 01:03:15.378067 UTC
25552024-12-14T01:16:10.893ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.316728ms iteration = 77 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8770bfcc-3a71-4738-a6b0-91008cadcb0f","time_created":"2024-12-14T01:03:15.378067Z"}
25562024-12-14T01:16:10.902ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
25572024-12-14T01:16:10.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
25582024-12-14T01:16:10.930ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 56.602788ms iteration = 77 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
25592024-12-14T01:16:13.461ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2071 local_addr = [fd00:1122:3344:101::a]:59823 method = GET remote_addr = [fd00:1122:3344:101::d]:36065 req_id = 564574d5-ef8c-4a3e-b10a-9f0ece8af5e5 response_code = 200 uri = /ec66f35d-9dc5-46c1-80a1-ebaa91a8212a
25602024-12-14T01:16:20.874ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 78 reason = Timeout
25612024-12-14T01:16:20.874ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 78 reason = Timeout
25622024-12-14T01:16:20.874ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25632024-12-14T01:16:20.874ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
25642024-12-14T01:16:20.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25652024-12-14T01:16:20.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
25662024-12-14T01:16:20.876ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25672024-12-14T01:16:20.879ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
25682024-12-14T01:16:20.879ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25692024-12-14T01:16:20.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25702024-12-14T01:16:20.881ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25712024-12-14T01:16:20.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25722024-12-14T01:16:20.883ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25732024-12-14T01:16:20.886ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8770bfcc-3a71-4738-a6b0-91008cadcb0f, lookup_type: ById(8770bfcc-3a71-4738-a6b0-91008cadcb0f) } result = Ok(())
25742024-12-14T01:16:20.886ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25752024-12-14T01:16:20.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25762024-12-14T01:16:20.895ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8770bfcc-3a71-4738-a6b0-91008cadcb0f original_time_created = 2024-12-14 01:03:15.378067 UTC target_id = 8770bfcc-3a71-4738-a6b0-91008cadcb0f time_created = 2024-12-14 01:03:15.378067 UTC
25772024-12-14T01:16:20.895ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.274786ms iteration = 78 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8770bfcc-3a71-4738-a6b0-91008cadcb0f","time_created":"2024-12-14T01:03:15.378067Z"}
25782024-12-14T01:16:20.903ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
25792024-12-14T01:16:20.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
25802024-12-14T01:16:20.904ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.630486ms iteration = 78 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
25812024-12-14T01:16:23.460ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1708 local_addr = [fd00:1122:3344:101::a]:59823 method = GET remote_addr = [fd00:1122:3344:101::d]:36065 req_id = db866cbe-d838-4a6e-a9d1-14ca9b28ca3d response_code = 200 uri = /ec66f35d-9dc5-46c1-80a1-ebaa91a8212a
25822024-12-14T01:16:30.873ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 14 reason = Timeout
25832024-12-14T01:16:30.873ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 27 reason = Timeout
25842024-12-14T01:16:30.873ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
25852024-12-14T01:16:30.873ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
25862024-12-14T01:16:30.873ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
25872024-12-14T01:16:30.873ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 16 reason = Timeout
25882024-12-14T01:16:30.873ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 27 reason = Timeout
25892024-12-14T01:16:30.873ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 14 reason = Timeout
25902024-12-14T01:16:30.873ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
25912024-12-14T01:16:30.873ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
25922024-12-14T01:16:30.873ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 27 reason = Timeout
25932024-12-14T01:16:30.873ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 27 reason = Timeout
25942024-12-14T01:16:30.873ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
25952024-12-14T01:16:30.873ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
25962024-12-14T01:16:30.873ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
25972024-12-14T01:16:30.873ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 27 reason = Timeout
25982024-12-14T01:16:30.873ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
25992024-12-14T01:16:30.873ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 27 reason = Timeout
26002024-12-14T01:16:30.873ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
26012024-12-14T01:16:30.873ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 27 reason = Timeout
26022024-12-14T01:16:30.873ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
26032024-12-14T01:16:30.873ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 29 reason = Timeout
26042024-12-14T01:16:30.873ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
26052024-12-14T01:16:30.873ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 29 reason = Timeout
26062024-12-14T01:16:30.873ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
26072024-12-14T01:16:30.873ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 14 reason = Timeout
26082024-12-14T01:16:30.873ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 79 reason = Timeout
26092024-12-14T01:16:30.873ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
26102024-12-14T01:16:30.873ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 15 reason = Timeout
26112024-12-14T01:16:30.873ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 8770bfcc-3a71-4738-a6b0-91008cadcb0f
26122024-12-14T01:16:30.873ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 13.03\u{b5}s iteration = 15 status = {"enabled":false,"target_id":"8770bfcc-3a71-4738-a6b0-91008cadcb0f"}
26132024-12-14T01:16:30.873ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 14 reason = Timeout
26142024-12-14T01:16:30.873ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 79 reason = Timeout
26152024-12-14T01:16:30.873ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 27 reason = Timeout
26162024-12-14T01:16:30.873ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26172024-12-14T01:16:30.874ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 27 reason = Timeout
26182024-12-14T01:16:30.874ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26192024-12-14T01:16:30.874ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 16 reason = Timeout
26202024-12-14T01:16:30.874ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 14 reason = Timeout
26212024-12-14T01:16:30.874ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
26222024-12-14T01:16:30.874ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 14 reason = Timeout
26232024-12-14T01:16:30.874ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
26242024-12-14T01:16:30.874ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 27 reason = Timeout
26252024-12-14T01:16:30.874ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
26262024-12-14T01:16:30.874ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
26272024-12-14T01:16:30.874ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 14 reason = Timeout
26282024-12-14T01:16:30.874ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
26292024-12-14T01:16:30.874ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 14 reason = Timeout
26302024-12-14T01:16:30.874ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
26312024-12-14T01:16:30.874ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 14 reason = Timeout
26322024-12-14T01:16:30.874ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-14 01:06:30.873965811 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
26332024-12-14T01:16:30.874ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 14 reason = Timeout
26342024-12-14T01:16:30.874ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
26352024-12-14T01:16:30.874ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
26362024-12-14T01:16:30.874ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 27 reason = Timeout
26372024-12-14T01:16:30.874ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
26382024-12-14T01:16:30.874ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
26392024-12-14T01:16:30.874ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 27 reason = Timeout
26402024-12-14T01:16:30.874ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
26412024-12-14T01:16:30.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
26422024-12-14T01:16:30.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
26432024-12-14T01:16:30.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
26442024-12-14T01:16:30.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
26452024-12-14T01:16:30.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
26462024-12-14T01:16:30.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
26472024-12-14T01:16:30.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
26482024-12-14T01:16:30.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
26492024-12-14T01:16:30.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
26502024-12-14T01:16:30.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26512024-12-14T01:16:30.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
26522024-12-14T01:16:30.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
26532024-12-14T01:16:30.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
26542024-12-14T01:16:30.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
26552024-12-14T01:16:30.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
26562024-12-14T01:16:30.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
26572024-12-14T01:16:30.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
26582024-12-14T01:16:30.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26592024-12-14T01:16:30.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
26602024-12-14T01:16:30.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
26612024-12-14T01:16:30.874ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("381b8112-f609-4c4d-ac80-0170ad8fc4bd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("795aee12-3394-49fa-9cb5-487c97a85b2d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("795aee12-3394-49fa-9cb5-487c97a85b2d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1553, tv_nsec: 703569040 } })
26622024-12-14T01:16:30.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
26632024-12-14T01:16:30.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
26642024-12-14T01:16:30.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
26652024-12-14T01:16:30.874ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1b585a7c-7eb0-4894-b8b3-3ef1983891e5.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("36100ee5-fa9a-4857-a844-70bec0e8601f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("830b88b6-26da-4988-83b1-cf4193531cd5.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("830b88b6-26da-4988-83b1-cf4193531cd5.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1553, tv_nsec: 703623261 } })
26662024-12-14T01:16:30.875ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
26672024-12-14T01:16:30.875ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.221835ms iteration = 14 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
26682024-12-14T01:16:30.875ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
26692024-12-14T01:16:30.875ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.294967ms iteration = 14 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
26702024-12-14T01:16:30.875ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
26712024-12-14T01:16:30.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
26722024-12-14T01:16:30.876ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 3.021447ms iteration = 27 status = {"errors":[],"garbage_collect_requested":[]}
26732024-12-14T01:16:30.877ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.236654ms iteration = 27 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
26742024-12-14T01:16:30.878ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
26752024-12-14T01:16:30.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
26762024-12-14T01:16:30.878ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26772024-12-14T01:16:30.879ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 5.637213ms iteration = 27 status = {"errors":[],"records_set_to_done":[]}
26782024-12-14T01:16:30.880ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
26792024-12-14T01:16:30.880ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
26802024-12-14T01:16:30.880ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26812024-12-14T01:16:30.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
26822024-12-14T01:16:30.882ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26832024-12-14T01:16:30.882ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
26842024-12-14T01:16:30.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
26852024-12-14T01:16:30.884ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
26862024-12-14T01:16:30.884ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
26872024-12-14T01:16:30.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
26882024-12-14T01:16:30.884ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 10.68869ms iteration = 14 status = {"errors":[],"found_port_ok":[]}
26892024-12-14T01:16:30.884ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
26902024-12-14T01:16:30.884ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26912024-12-14T01:16:30.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26922024-12-14T01:16:30.886ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
26932024-12-14T01:16:30.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
26942024-12-14T01:16:30.886ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26952024-12-14T01:16:30.886ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-7e423e95-464a-471f-a0d9-4799977f0b0f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-7e423e95-464a-471f-a0d9-4799977f0b0f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1553, tv_nsec: 715656479 } })
26962024-12-14T01:16:30.886ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
26972024-12-14T01:16:30.887ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-14 01:06:30.873965811 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
26982024-12-14T01:16:30.887ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
26992024-12-14T01:16:30.887ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 13.773469ms iteration = 14 status = {"expiration":"2024-12-14T01:06:30.873965811Z","pruned":[]}
27002024-12-14T01:16:30.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
27012024-12-14T01:16:30.889ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
27022024-12-14T01:16:30.889ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
27032024-12-14T01:16:30.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
27042024-12-14T01:16:30.889ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
27052024-12-14T01:16:30.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
27062024-12-14T01:16:30.891ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27072024-12-14T01:16:30.892ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27082024-12-14T01:16:30.892ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-7e423e95-464a-471f-a0d9-4799977f0b0f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-7e423e95-464a-471f-a0d9-4799977f0b0f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1553, tv_nsec: 721435147 } })
27092024-12-14T01:16:30.892ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
27102024-12-14T01:16:30.894ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
27112024-12-14T01:16:30.894ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27122024-12-14T01:16:30.894ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
27132024-12-14T01:16:30.894ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
27142024-12-14T01:16:30.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27152024-12-14T01:16:30.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
27162024-12-14T01:16:30.896ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
27172024-12-14T01:16:30.896ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
27182024-12-14T01:16:30.896ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 22.528582ms iteration = 14 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
27192024-12-14T01:16:30.899ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
27202024-12-14T01:16:30.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
27212024-12-14T01:16:30.900ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
27222024-12-14T01:16:30.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
27232024-12-14T01:16:30.900ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-7e423e95-464a-471f-a0d9-4799977f0b0f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-7e423e95-464a-471f-a0d9-4799977f0b0f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1553, tv_nsec: 729817349 } })
27242024-12-14T01:16:30.901ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09
27252024-12-14T01:16:30.902ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
27262024-12-14T01:16:30.902ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27272024-12-14T01:16:30.902ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27282024-12-14T01:16:30.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
27292024-12-14T01:16:30.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27302024-12-14T01:16:30.905ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
27312024-12-14T01:16:30.905ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
27322024-12-14T01:16:30.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
27332024-12-14T01:16:30.907ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27342024-12-14T01:16:30.910ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8770bfcc-3a71-4738-a6b0-91008cadcb0f, lookup_type: ById(8770bfcc-3a71-4738-a6b0-91008cadcb0f) } result = Ok(())
27352024-12-14T01:16:30.910ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27362024-12-14T01:16:30.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27372024-12-14T01:16:30.914ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
27382024-12-14T01:16:30.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27392024-12-14T01:16:30.921ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
27402024-12-14T01:16:30.921ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
27412024-12-14T01:16:30.921ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
27422024-12-14T01:16:30.921ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
27432024-12-14T01:16:30.925ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8770bfcc-3a71-4738-a6b0-91008cadcb0f original_time_created = 2024-12-14 01:03:15.378067 UTC target_id = 8770bfcc-3a71-4738-a6b0-91008cadcb0f time_created = 2024-12-14 01:03:15.378067 UTC
27442024-12-14T01:16:30.925ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 52.118809ms iteration = 79 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8770bfcc-3a71-4738-a6b0-91008cadcb0f","time_created":"2024-12-14T01:03:15.378067Z"}
27452024-12-14T01:16:30.927ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27462024-12-14T01:16:30.929ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
27472024-12-14T01:16:30.936ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
27482024-12-14T01:16:30.936ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
27492024-12-14T01:16:30.937ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27502024-12-14T01:16:30.940ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
27512024-12-14T01:16:30.940ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
27522024-12-14T01:16:30.940ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
27532024-12-14T01:16:30.943ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27542024-12-14T01:16:30.944ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 71.056556ms iteration = 27 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
27552024-12-14T01:16:30.944ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27562024-12-14T01:16:30.946ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
27572024-12-14T01:16:30.947ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
27582024-12-14T01:16:30.947ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
27592024-12-14T01:16:30.947ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 73.123386ms iteration = 14 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
27602024-12-14T01:16:30.947ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
27612024-12-14T01:16:30.947ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
27622024-12-14T01:16:30.947ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
27632024-12-14T01:16:30.947ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 73.905988ms iteration = 27 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
27642024-12-14T01:16:30.947ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
27652024-12-14T01:16:30.947ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
27662024-12-14T01:16:30.947ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
27672024-12-14T01:16:30.947ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
27682024-12-14T01:16:30.948ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
27692024-12-14T01:16:30.948ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
27702024-12-14T01:16:30.948ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
27712024-12-14T01:16:30.948ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
27722024-12-14T01:16:30.948ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
27732024-12-14T01:16:30.949ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27742024-12-14T01:16:30.950ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 77.103191ms iteration = 27 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
27752024-12-14T01:16:30.951ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27762024-12-14T01:16:30.954ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 7e423e95-464a-471f-a0d9-4799977f0b0f, lookup_type: ById(7e423e95-464a-471f-a0d9-4799977f0b0f) } result = Ok(())
27772024-12-14T01:16:30.954ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
27782024-12-14T01:16:30.954ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
27792024-12-14T01:16:30.954ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
27802024-12-14T01:16:30.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
27812024-12-14T01:16:30.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
27822024-12-14T01:16:30.956ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
27832024-12-14T01:16:30.956ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 866c9448-c447-4b92-96b6-611d51967e09 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
27842024-12-14T01:16:30.956ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
27852024-12-14T01:16:30.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
27862024-12-14T01:16:30.957ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 83.368183ms iteration = 27 status = 0
27872024-12-14T01:16:30.958ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27882024-12-14T01:16:30.961ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
27892024-12-14T01:16:30.961ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
27902024-12-14T01:16:30.961ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
27912024-12-14T01:16:30.963ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
27922024-12-14T01:16:30.963ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
27932024-12-14T01:16:30.963ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 866c9448-c447-4b92-96b6-611d51967e09 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
27942024-12-14T01:16:30.963ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
27952024-12-14T01:16:30.964ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-14 01:03:51.993091 UTC dns_group = internal generation = 1
27962024-12-14T01:16:30.964ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 90.104317ms iteration = 14 status = {"generation":1}
27972024-12-14T01:16:30.964ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 90.730036ms iteration = 79 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
27982024-12-14T01:16:30.971ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
27992024-12-14T01:16:30.971ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
28002024-12-14T01:16:30.971ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
28012024-12-14T01:16:30.971ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
28022024-12-14T01:16:30.973ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
28032024-12-14T01:16:30.973ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
28042024-12-14T01:16:30.973ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
28052024-12-14T01:16:30.973ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
28062024-12-14T01:16:30.973ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
28072024-12-14T01:16:30.974ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28082024-12-14T01:16:30.976ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
28092024-12-14T01:16:30.976ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
28102024-12-14T01:16:30.977ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
28112024-12-14T01:16:30.977ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
28122024-12-14T01:16:30.977ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
28132024-12-14T01:16:30.978ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28142024-12-14T01:16:30.980ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
28152024-12-14T01:16:30.980ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = d9c36d0c-d7d2-439f-a748-798b6d8dea0c dns_zone_name = oxide.test found_so_far = 0 version = 2
28162024-12-14T01:16:30.980ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
28172024-12-14T01:16:30.980ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
28182024-12-14T01:16:30.980ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
28192024-12-14T01:16:30.980ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
28202024-12-14T01:16:30.980ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
28212024-12-14T01:16:30.982ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28222024-12-14T01:16:30.982ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
28232024-12-14T01:16:30.982ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 108.322025ms iteration = 27 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
28242024-12-14T01:16:30.984ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
28252024-12-14T01:16:30.984ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
28262024-12-14T01:16:30.985ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
28272024-12-14T01:16:30.987ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = d9c36d0c-d7d2-439f-a748-798b6d8dea0c dns_zone_name = oxide.test found_so_far = 1 version = 2
28282024-12-14T01:16:30.987ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
28292024-12-14T01:16:30.987ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-14 01:03:53.017536 UTC dns_group = external generation = 2
28302024-12-14T01:16:30.987ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 113.574137ms iteration = 14 status = {"generation":2}
28312024-12-14T01:16:31.010ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
28322024-12-14T01:16:31.010ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
28332024-12-14T01:16:31.010ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 136.442638ms iteration = 27 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
28342024-12-14T01:16:31.020ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
28352024-12-14T01:16:31.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
28362024-12-14T01:16:31.022ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 148.58978ms iteration = 29 status = {"physical_disks_added":0}
28372024-12-14T01:16:31.022ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28382024-12-14T01:16:31.024ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
28392024-12-14T01:16:31.024ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
28402024-12-14T01:16:31.025ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
28412024-12-14T01:16:31.026ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28422024-12-14T01:16:31.028ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
28432024-12-14T01:16:31.028ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
28442024-12-14T01:16:31.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
28452024-12-14T01:16:31.029ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
28462024-12-14T01:16:31.035ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-14T01:03:19.260831Z, time_modified: 2024-12-14T01:03:19.260831Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, db_silo: Silo { identity: SiloIdentity { id: 2c668072-a9a1-4a69-928c-e118c99521be, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-14T01:03:52.950638Z, time_modified: 2024-12-14T01:03:52.950638Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "ad8fd43e0fc4f6284dc5e0b0d0f2e6a6e8d979d13f86a71c9b81d6817e439efd" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, db_silo: Silo { identity: SiloIdentity { id: 2c668072-a9a1-4a69-928c-e118c99521be, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-14T01:03:52.950638Z, time_modified: 2024-12-14T01:03:52.950638Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "ad8fd43e0fc4f6284dc5e0b0d0f2e6a6e8d979d13f86a71c9b81d6817e439efd" }] }) }
28472024-12-14T01:16:31.035ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 162.151483ms iteration = 14 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"2c668072-a9a1-4a69-928c-e118c99521be","tls_certs":["ad8fd43e0fc4f6284dc5e0b0d0f2e6a6e8d979d13f86a71c9b81d6817e439efd"]}},"default_endpoint":{"silo_id":"2c668072-a9a1-4a69-928c-e118c99521be","tls_certs":["ad8fd43e0fc4f6284dc5e0b0d0f2e6a6e8d979d13f86a71c9b81d6817e439efd"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
28482024-12-14T01:16:31.050ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
28492024-12-14T01:16:31.050ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
28502024-12-14T01:16:31.051ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9e80ac59-e3e4-4c31-92b7-c283045efb99", "content-length": "26", "date": "Sat, 14 Dec 2024 01:16:31 GMT"} })
28512024-12-14T01:16:31.051ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
28522024-12-14T01:16:31.053ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
28532024-12-14T01:16:31.063ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
28542024-12-14T01:16:31.063ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 189.803032ms iteration = 14 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
28552024-12-14T01:16:31.064ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 zone_address = fd00:1122:3344:101::2
28562024-12-14T01:16:31.064ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
28572024-12-14T01:16:31.064ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "841e1153-7851-4a8e-8b25-4fc405ba0a55", "content-length": "26", "date": "Sat, 14 Dec 2024 01:16:31 GMT"} })
28582024-12-14T01:16:31.064ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
28592024-12-14T01:16:31.067ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09
28602024-12-14T01:16:31.115ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
28612024-12-14T01:16:31.187ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
28622024-12-14T01:16:31.227ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
28632024-12-14T01:16:31.227ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
28642024-12-14T01:16:31.227ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4dafc553-76e6-438f-9cac-121709d9e8d4", "content-length": "26", "date": "Sat, 14 Dec 2024 01:16:31 GMT"} })
28652024-12-14T01:16:31.227ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
28662024-12-14T01:16:31.229ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
28672024-12-14T01:16:31.231ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
28682024-12-14T01:16:31.231ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "3ac1e467-97c2-4c33-8b51-c06c12195048", "content-length": "2", "date": "Sat, 14 Dec 2024 01:16:31 GMT"} })
28692024-12-14T01:16:31.233ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
28702024-12-14T01:16:31.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
28712024-12-14T01:16:31.235ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 361.141951ms iteration = 27 status = null
28722024-12-14T01:16:31.260ZDEBGnexus (BackgroundTasks): client request SledAgent = 7e423e95-464a-471f-a0d9-4799977f0b0f background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
28732024-12-14T01:16:31.260ZDEBGnexus (BackgroundTasks): client response SledAgent = 7e423e95-464a-471f-a0d9-4799977f0b0f background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "0e945209-6218-4f76-b827-a7d4d0ee90d8", "content-length": "691", "date": "Sat, 14 Dec 2024 01:16:31 GMT"} })
28742024-12-14T01:16:31.261ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
28752024-12-14T01:16:31.261ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
28762024-12-14T01:16:31.261ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
28772024-12-14T01:16:31.263ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 389.398139ms iteration = 29 status = {}
28782024-12-14T01:16:31.329ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
28792024-12-14T01:16:31.329ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "27bea665-9d85-4a8a-92e8-53623f223525", "date": "Sat, 14 Dec 2024 01:16:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
28802024-12-14T01:16:31.329ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
28812024-12-14T01:16:31.331ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "0a5dc80c-e603-4e82-955f-278863c5550d", "date": "Sat, 14 Dec 2024 01:16:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
28822024-12-14T01:16:31.331ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
28832024-12-14T01:16:31.333ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "f7ddc170-282d-4de6-aec6-d22da17cd808", "date": "Sat, 14 Dec 2024 01:16:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
28842024-12-14T01:16:31.333ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
28852024-12-14T01:16:31.335ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
28862024-12-14T01:16:31.335ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 461.871236ms iteration = 16 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
28872024-12-14T01:16:31.356ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 482.239625ms iteration = 27 status = {}
28882024-12-14T01:16:31.390ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
28892024-12-14T01:16:31.391ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "1de74f58-4636-4c3c-8f6f-378cdaefb291", "date": "Sat, 14 Dec 2024 01:16:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
28902024-12-14T01:16:31.391ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
28912024-12-14T01:16:31.393ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "694c4249-022b-412e-881b-ab37da5e8b02", "date": "Sat, 14 Dec 2024 01:16:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
28922024-12-14T01:16:31.393ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
28932024-12-14T01:16:31.394ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
28942024-12-14T01:16:31.394ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 521.170302ms iteration = 16 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
28952024-12-14T01:16:31.446ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28962024-12-14T01:16:31.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28972024-12-14T01:16:31.448ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: bb1a4b50-730e-48ee-a311-8a9b9d7bcb73, rack_id: f30fd360-30ae-4088-9821-aa98c2bc8c09, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(bb9f5a1a-5708-4d58-ba4f-c62102236426) } rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 switch_location = Switch0
28982024-12-14T01:16:31.448ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28992024-12-14T01:16:31.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29002024-12-14T01:16:31.458ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
29012024-12-14T01:16:31.458ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "ed21fd97-1486-4e72-a8e5-269d55843c40", "content-length": "134", "date": "Sat, 14 Dec 2024 01:16:31 GMT"} })
29022024-12-14T01:16:31.458ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
29032024-12-14T01:16:31.459ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = bb9f5a1a-5708-4d58-ba4f-c62102236426
29042024-12-14T01:16:31.459ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
29052024-12-14T01:16:31.459ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
29062024-12-14T01:16:31.459ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
29072024-12-14T01:16:31.459ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
29082024-12-14T01:16:31.459ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
29092024-12-14T01:16:31.459ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
29102024-12-14T01:16:31.459ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
29112024-12-14T01:16:31.459ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
29122024-12-14T01:16:31.459ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09
29132024-12-14T01:16:31.459ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29142024-12-14T01:16:31.459ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29152024-12-14T01:16:31.462ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
29162024-12-14T01:16:31.462ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "ecea3f11-b4c0-4d56-b156-60a17e417446", "content-length": "2", "date": "Sat, 14 Dec 2024 01:16:31 GMT"} })
29172024-12-14T01:16:31.462ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
29182024-12-14T01:16:31.462ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "fdcbc6e4-079c-4549-88ce-75c59b082929", "content-length": "52", "date": "Sat, 14 Dec 2024 01:16:31 GMT"} })
29192024-12-14T01:16:31.462ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 switch_location = Switch0
29202024-12-14T01:16:31.462ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
29212024-12-14T01:16:31.555ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "ab0dc5c2-9a0e-41ec-aef6-261bcc7ec01c", "date": "Sat, 14 Dec 2024 01:16:31 GMT"} })
29222024-12-14T01:16:31.555ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 switch = Switch0
29232024-12-14T01:16:31.555ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
29242024-12-14T01:16:31.555ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "a3f728b0-04ee-400f-af33-00e394a02cd7", "content-length": "682", "date": "Sat, 14 Dec 2024 01:16:31 GMT"} })
29252024-12-14T01:16:31.555ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29262024-12-14T01:16:31.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29272024-12-14T01:16:31.559ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29282024-12-14T01:16:31.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29292024-12-14T01:16:31.563ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29302024-12-14T01:16:31.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29312024-12-14T01:16:31.565ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29322024-12-14T01:16:31.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29332024-12-14T01:16:31.573ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 699.458891ms iteration = 27 status = {}
29342024-12-14T01:16:33.461ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1868 local_addr = [fd00:1122:3344:101::a]:59823 method = GET remote_addr = [fd00:1122:3344:101::d]:36065 req_id = 258e7ac7-74d4-4b4b-bc27-242456ec3777 response_code = 200 uri = /ec66f35d-9dc5-46c1-80a1-ebaa91a8212a
29352024-12-14T01:16:37.181ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 30 reason = Timeout
29362024-12-14T01:16:37.181ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
29372024-12-14T01:16:37.181ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29382024-12-14T01:16:37.181ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29392024-12-14T01:16:37.183ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29402024-12-14T01:16:37.185ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
29412024-12-14T01:16:37.185ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29422024-12-14T01:16:37.185ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29432024-12-14T01:16:37.187ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29442024-12-14T01:16:37.189ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
29452024-12-14T01:16:37.189ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29462024-12-14T01:16:37.189ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29472024-12-14T01:16:37.222ZINFOnexus (BackgroundTasks): VPC route manager sled 7e423e95-464a-471f-a0d9-4799977f0b0f background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
29482024-12-14T01:16:37.222ZDEBGnexus (BackgroundTasks): client request SledAgent = 7e423e95-464a-471f-a0d9-4799977f0b0f background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
29492024-12-14T01:16:37.222ZDEBGnexus (BackgroundTasks): client response SledAgent = 7e423e95-464a-471f-a0d9-4799977f0b0f background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "318129f2-ff07-422c-8e68-ebe0a1cd51c9", "content-length": "372", "date": "Sat, 14 Dec 2024 01:16:37 GMT"} })
29502024-12-14T01:16:37.222ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29512024-12-14T01:16:37.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29522024-12-14T01:16:37.262ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
29532024-12-14T01:16:37.262ZDEBGnexus (BackgroundTasks): client request SledAgent = 7e423e95-464a-471f-a0d9-4799977f0b0f background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
29542024-12-14T01:16:37.262ZDEBGnexus (BackgroundTasks): client response SledAgent = 7e423e95-464a-471f-a0d9-4799977f0b0f background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "65a842eb-c3d0-4829-83c5-d586f9a9bd54", "date": "Sat, 14 Dec 2024 01:16:37 GMT"} })
29552024-12-14T01:16:37.262ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29562024-12-14T01:16:37.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29572024-12-14T01:16:37.265ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29582024-12-14T01:16:37.265ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29592024-12-14T01:16:37.268ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29602024-12-14T01:16:37.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29612024-12-14T01:16:37.271ZINFOnexus (BackgroundTasks): VPC route manager sled 7e423e95-464a-471f-a0d9-4799977f0b0f push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
29622024-12-14T01:16:37.271ZDEBGnexus (BackgroundTasks): client request SledAgent = 7e423e95-464a-471f-a0d9-4799977f0b0f background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
29632024-12-14T01:16:37.272ZDEBGnexus (BackgroundTasks): client response SledAgent = 7e423e95-464a-471f-a0d9-4799977f0b0f background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "f1b11343-1ef2-4c15-84f0-333d5b311bf0", "date": "Sat, 14 Dec 2024 01:16:37 GMT"} })
29642024-12-14T01:16:37.273ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 92.451216ms iteration = 30 status = {}
29652024-12-14T01:16:40.873ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 80 reason = Timeout
29662024-12-14T01:16:40.873ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 80 reason = Timeout
29672024-12-14T01:16:40.873ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
29682024-12-14T01:16:40.873ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29692024-12-14T01:16:40.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29702024-12-14T01:16:40.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
29712024-12-14T01:16:40.875ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29722024-12-14T01:16:40.876ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
29732024-12-14T01:16:40.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
29742024-12-14T01:16:40.878ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
29752024-12-14T01:16:40.878ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29762024-12-14T01:16:40.878ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.619384ms iteration = 80 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
29772024-12-14T01:16:40.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29782024-12-14T01:16:40.880ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29792024-12-14T01:16:40.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29802024-12-14T01:16:40.882ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29812024-12-14T01:16:40.885ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8770bfcc-3a71-4738-a6b0-91008cadcb0f, lookup_type: ById(8770bfcc-3a71-4738-a6b0-91008cadcb0f) } result = Ok(())
29822024-12-14T01:16:40.885ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29832024-12-14T01:16:40.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29842024-12-14T01:16:40.897ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8770bfcc-3a71-4738-a6b0-91008cadcb0f original_time_created = 2024-12-14 01:03:15.378067 UTC target_id = 8770bfcc-3a71-4738-a6b0-91008cadcb0f time_created = 2024-12-14 01:03:15.378067 UTC
29852024-12-14T01:16:40.897ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.043325ms iteration = 80 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8770bfcc-3a71-4738-a6b0-91008cadcb0f","time_created":"2024-12-14T01:03:15.378067Z"}
29862024-12-14T01:16:43.461ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2082 local_addr = [fd00:1122:3344:101::a]:59823 method = GET remote_addr = [fd00:1122:3344:101::d]:36065 req_id = 218a1088-731d-4850-9aa6-2597e1781660 response_code = 200 uri = /ec66f35d-9dc5-46c1-80a1-ebaa91a8212a
29872024-12-14T01:16:48.451ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:35184 req_id = ccde6256-25ff-4e87-9a08-5632944e977b roles = RoleSet { roles: {} } uri = /metrics/collectors/6e1e4a25-c6a7-49c5-bb1d-86638130bef7/producers?sort_by=id_ascending
29882024-12-14T01:16:48.452ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:35184 req_id = ccde6256-25ff-4e87-9a08-5632944e977b resource = Database result = Ok(()) uri = /metrics/collectors/6e1e4a25-c6a7-49c5-bb1d-86638130bef7/producers?sort_by=id_ascending
29892024-12-14T01:16:48.454ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2885 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:35184 req_id = ccde6256-25ff-4e87-9a08-5632944e977b response_code = 200 uri = /metrics/collectors/6e1e4a25-c6a7-49c5-bb1d-86638130bef7/producers?sort_by=id_ascending
29902024-12-14T01:16:48.454ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:35184 req_id = b5010240-1240-4b10-ae68-0f65f9bcee5c roles = RoleSet { roles: {} } uri = /metrics/collectors/6e1e4a25-c6a7-49c5-bb1d-86638130bef7/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNGM2ZGNlZi0yNTc3LTQxMmUtODNkMS0zNzkyZGNjMDQ2MWQifX0%3D
29912024-12-14T01:16:48.455ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:35184 req_id = b5010240-1240-4b10-ae68-0f65f9bcee5c resource = Database result = Ok(()) uri = /metrics/collectors/6e1e4a25-c6a7-49c5-bb1d-86638130bef7/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNGM2ZGNlZi0yNTc3LTQxMmUtODNkMS0zNzkyZGNjMDQ2MWQifX0%3D
29922024-12-14T01:16:48.457ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2599 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:35184 req_id = b5010240-1240-4b10-ae68-0f65f9bcee5c response_code = 200 uri = /metrics/collectors/6e1e4a25-c6a7-49c5-bb1d-86638130bef7/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNGM2ZGNlZi0yNTc3LTQxMmUtODNkMS0zNzkyZGNjMDQ2MWQifX0%3D
29932024-12-14T01:16:50.873ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 81 reason = Timeout
29942024-12-14T01:16:50.873ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 81 reason = Timeout
29952024-12-14T01:16:50.873ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29962024-12-14T01:16:50.873ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
29972024-12-14T01:16:50.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29982024-12-14T01:16:50.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
29992024-12-14T01:16:50.876ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30002024-12-14T01:16:50.876ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
30012024-12-14T01:16:50.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
30022024-12-14T01:16:50.878ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.919853ms iteration = 81 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
30032024-12-14T01:16:50.878ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
30042024-12-14T01:16:50.878ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30052024-12-14T01:16:50.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30062024-12-14T01:16:50.880ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30072024-12-14T01:16:50.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30082024-12-14T01:16:50.882ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30092024-12-14T01:16:50.885ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8770bfcc-3a71-4738-a6b0-91008cadcb0f, lookup_type: ById(8770bfcc-3a71-4738-a6b0-91008cadcb0f) } result = Ok(())
30102024-12-14T01:16:50.885ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30112024-12-14T01:16:50.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30122024-12-14T01:16:50.897ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8770bfcc-3a71-4738-a6b0-91008cadcb0f original_time_created = 2024-12-14 01:03:15.378067 UTC target_id = 8770bfcc-3a71-4738-a6b0-91008cadcb0f time_created = 2024-12-14 01:03:15.378067 UTC
30132024-12-14T01:16:50.897ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.426217ms iteration = 81 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8770bfcc-3a71-4738-a6b0-91008cadcb0f","time_created":"2024-12-14T01:03:15.378067Z"}
30142024-12-14T01:16:53.462ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2232 local_addr = [fd00:1122:3344:101::a]:59823 method = GET remote_addr = [fd00:1122:3344:101::d]:36065 req_id = b45e9dbf-6e4c-46fd-b908-a3ef5e63df36 response_code = 200 uri = /ec66f35d-9dc5-46c1-80a1-ebaa91a8212a
30152024-12-14T01:17:00.873ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 28 reason = Timeout
30162024-12-14T01:17:00.873ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30172024-12-14T01:17:00.873ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 82 reason = Timeout
30182024-12-14T01:17:00.873ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 28 reason = Timeout
30192024-12-14T01:17:00.873ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
30202024-12-14T01:17:00.873ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
30212024-12-14T01:17:00.873ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 28 reason = Timeout
30222024-12-14T01:17:00.873ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 28 reason = Timeout
30232024-12-14T01:17:00.873ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
30242024-12-14T01:17:00.873ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
30252024-12-14T01:17:00.873ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 28 reason = Timeout
30262024-12-14T01:17:00.873ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
30272024-12-14T01:17:00.873ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 30 reason = Timeout
30282024-12-14T01:17:00.873ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
30292024-12-14T01:17:00.873ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 28 reason = Timeout
30302024-12-14T01:17:00.873ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 28 reason = Timeout
30312024-12-14T01:17:00.873ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
30322024-12-14T01:17:00.873ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 28 reason = Timeout
30332024-12-14T01:17:00.873ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 28 reason = Timeout
30342024-12-14T01:17:00.873ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
30352024-12-14T01:17:00.873ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
30362024-12-14T01:17:00.873ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
30372024-12-14T01:17:00.873ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 28 reason = Timeout
30382024-12-14T01:17:00.873ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
30392024-12-14T01:17:00.873ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 30 reason = Timeout
30402024-12-14T01:17:00.873ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
30412024-12-14T01:17:00.873ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 28 reason = Timeout
30422024-12-14T01:17:00.873ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
30432024-12-14T01:17:00.873ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 28 reason = Timeout
30442024-12-14T01:17:00.874ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
30452024-12-14T01:17:00.874ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 82 reason = Timeout
30462024-12-14T01:17:00.874ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30472024-12-14T01:17:00.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
30482024-12-14T01:17:00.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30492024-12-14T01:17:00.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
30502024-12-14T01:17:00.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
30512024-12-14T01:17:00.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
30522024-12-14T01:17:00.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
30532024-12-14T01:17:00.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
30542024-12-14T01:17:00.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
30552024-12-14T01:17:00.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
30562024-12-14T01:17:00.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
30572024-12-14T01:17:00.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
30582024-12-14T01:17:00.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
30592024-12-14T01:17:00.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
30602024-12-14T01:17:00.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
30612024-12-14T01:17:00.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30622024-12-14T01:17:00.876ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30632024-12-14T01:17:00.877ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30642024-12-14T01:17:00.877ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.413539ms iteration = 28 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
30652024-12-14T01:17:00.877ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
30662024-12-14T01:17:00.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
30672024-12-14T01:17:00.878ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30682024-12-14T01:17:00.878ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 4.82318ms iteration = 28 status = {"errors":[],"garbage_collect_requested":[]}
30692024-12-14T01:17:00.879ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
30702024-12-14T01:17:00.879ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
30712024-12-14T01:17:00.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
30722024-12-14T01:17:00.879ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
30732024-12-14T01:17:00.879ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30742024-12-14T01:17:00.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30752024-12-14T01:17:00.880ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
30762024-12-14T01:17:00.880ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
30772024-12-14T01:17:00.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
30782024-12-14T01:17:00.881ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 7.575209ms iteration = 28 status = {"errors":[],"records_set_to_done":[]}
30792024-12-14T01:17:00.882ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-7e423e95-464a-471f-a0d9-4799977f0b0f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-7e423e95-464a-471f-a0d9-4799977f0b0f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1583, tv_nsec: 711581374 } })
30802024-12-14T01:17:00.882ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
30812024-12-14T01:17:00.883ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30822024-12-14T01:17:00.883ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
30832024-12-14T01:17:00.883ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
30842024-12-14T01:17:00.883ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
30852024-12-14T01:17:00.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
30862024-12-14T01:17:00.884ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-7e423e95-464a-471f-a0d9-4799977f0b0f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-7e423e95-464a-471f-a0d9-4799977f0b0f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1583, tv_nsec: 713466319 } })
30872024-12-14T01:17:00.884ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
30882024-12-14T01:17:00.885ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
30892024-12-14T01:17:00.885ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
30902024-12-14T01:17:00.885ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
30912024-12-14T01:17:00.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
30922024-12-14T01:17:00.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
30932024-12-14T01:17:00.886ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30942024-12-14T01:17:00.887ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 13.364087ms iteration = 82 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
30952024-12-14T01:17:00.887ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
30962024-12-14T01:17:00.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
30972024-12-14T01:17:00.888ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-7e423e95-464a-471f-a0d9-4799977f0b0f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-7e423e95-464a-471f-a0d9-4799977f0b0f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1583, tv_nsec: 717978700 } })
30982024-12-14T01:17:00.889ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09
30992024-12-14T01:17:00.889ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
31002024-12-14T01:17:00.889ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31012024-12-14T01:17:00.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31022024-12-14T01:17:00.891ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
31032024-12-14T01:17:00.891ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
31042024-12-14T01:17:00.891ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
31052024-12-14T01:17:00.891ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 18.093614ms iteration = 28 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
31062024-12-14T01:17:00.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
31072024-12-14T01:17:00.892ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
31082024-12-14T01:17:00.892ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 18.603288ms iteration = 28 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
31092024-12-14T01:17:00.892ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
31102024-12-14T01:17:00.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
31112024-12-14T01:17:00.893ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31122024-12-14T01:17:00.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31132024-12-14T01:17:00.894ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31142024-12-14T01:17:00.897ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
31152024-12-14T01:17:00.897ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
31162024-12-14T01:17:00.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
31172024-12-14T01:17:00.914ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
31182024-12-14T01:17:00.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
31192024-12-14T01:17:00.921ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
31202024-12-14T01:17:00.922ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
31212024-12-14T01:17:00.923ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
31222024-12-14T01:17:00.924ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
31232024-12-14T01:17:00.924ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
31242024-12-14T01:17:00.924ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
31252024-12-14T01:17:00.925ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31262024-12-14T01:17:00.928ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 7e423e95-464a-471f-a0d9-4799977f0b0f, lookup_type: ById(7e423e95-464a-471f-a0d9-4799977f0b0f) } result = Ok(())
31272024-12-14T01:17:00.928ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
31282024-12-14T01:17:00.928ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
31292024-12-14T01:17:00.930ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 56.884666ms iteration = 28 status = 0
31302024-12-14T01:17:00.931ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
31312024-12-14T01:17:00.931ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
31322024-12-14T01:17:00.931ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 58.138432ms iteration = 28 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
31332024-12-14T01:17:00.932ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31342024-12-14T01:17:00.935ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8770bfcc-3a71-4738-a6b0-91008cadcb0f, lookup_type: ById(8770bfcc-3a71-4738-a6b0-91008cadcb0f) } result = Ok(())
31352024-12-14T01:17:00.935ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31362024-12-14T01:17:00.935ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31372024-12-14T01:17:00.951ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
31382024-12-14T01:17:00.952ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
31392024-12-14T01:17:00.956ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8770bfcc-3a71-4738-a6b0-91008cadcb0f original_time_created = 2024-12-14 01:03:15.378067 UTC target_id = 8770bfcc-3a71-4738-a6b0-91008cadcb0f time_created = 2024-12-14 01:03:15.378067 UTC
31402024-12-14T01:17:00.956ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 83.061404ms iteration = 82 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8770bfcc-3a71-4738-a6b0-91008cadcb0f","time_created":"2024-12-14T01:03:15.378067Z"}
31412024-12-14T01:17:00.960ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
31422024-12-14T01:17:00.961ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
31432024-12-14T01:17:00.961ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
31442024-12-14T01:17:00.961ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
31452024-12-14T01:17:00.961ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 87.904764ms iteration = 28 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
31462024-12-14T01:17:00.962ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8564bc46-67e2-4687-ac30-8dd3f1c4a511", "content-length": "26", "date": "Sat, 14 Dec 2024 01:17:00 GMT"} })
31472024-12-14T01:17:00.962ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
31482024-12-14T01:17:00.964ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
31492024-12-14T01:17:00.966ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 zone_address = fd00:1122:3344:101::2
31502024-12-14T01:17:00.966ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
31512024-12-14T01:17:00.966ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8b08c2a3-fed3-45db-a0ea-57252fc59904", "content-length": "26", "date": "Sat, 14 Dec 2024 01:17:00 GMT"} })
31522024-12-14T01:17:00.966ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
31532024-12-14T01:17:00.966ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
31542024-12-14T01:17:00.966ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
31552024-12-14T01:17:00.967ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0d2fe2b7-58b5-4b46-8169-88aa51436590", "content-length": "26", "date": "Sat, 14 Dec 2024 01:17:00 GMT"} })
31562024-12-14T01:17:00.967ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
31572024-12-14T01:17:00.968ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09
31582024-12-14T01:17:00.969ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
31592024-12-14T01:17:00.992ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 118.661704ms iteration = 28 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
31602024-12-14T01:17:01.006ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 132.855785ms iteration = 30 status = {"physical_disks_added":0}
31612024-12-14T01:17:01.040ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
31622024-12-14T01:17:01.041ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "3b2f475d-ffdf-439c-89d7-4c9a72767cda", "content-length": "2", "date": "Sat, 14 Dec 2024 01:17:00 GMT"} })
31632024-12-14T01:17:01.042ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
31642024-12-14T01:17:01.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
31652024-12-14T01:17:01.045ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 171.740239ms iteration = 28 status = null
31662024-12-14T01:17:01.050ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 176.291611ms iteration = 28 status = {}
31672024-12-14T01:17:01.053ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
31682024-12-14T01:17:01.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
31692024-12-14T01:17:01.055ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31702024-12-14T01:17:01.056ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
31712024-12-14T01:17:01.057ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
31722024-12-14T01:17:01.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
31732024-12-14T01:17:01.058ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31742024-12-14T01:17:01.060ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
31752024-12-14T01:17:01.060ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
31762024-12-14T01:17:01.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
31772024-12-14T01:17:01.099ZDEBGnexus (BackgroundTasks): client request SledAgent = 7e423e95-464a-471f-a0d9-4799977f0b0f background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
31782024-12-14T01:17:01.099ZDEBGnexus (BackgroundTasks): client response SledAgent = 7e423e95-464a-471f-a0d9-4799977f0b0f background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "84ab8bd7-b80e-4efa-94c9-94a13bfd6185", "content-length": "691", "date": "Sat, 14 Dec 2024 01:17:01 GMT"} })
31792024-12-14T01:17:01.099ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
31802024-12-14T01:17:01.099ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
31812024-12-14T01:17:01.099ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
31822024-12-14T01:17:01.101ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 227.687759ms iteration = 30 status = {}
31832024-12-14T01:17:01.117ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31842024-12-14T01:17:01.117ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31852024-12-14T01:17:01.119ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: bb1a4b50-730e-48ee-a311-8a9b9d7bcb73, rack_id: f30fd360-30ae-4088-9821-aa98c2bc8c09, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(bb9f5a1a-5708-4d58-ba4f-c62102236426) } rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 switch_location = Switch0
31862024-12-14T01:17:01.120ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31872024-12-14T01:17:01.120ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31882024-12-14T01:17:01.129ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
31892024-12-14T01:17:01.129ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "9712cadf-7ae8-4190-b5b4-45b4af4b4009", "content-length": "134", "date": "Sat, 14 Dec 2024 01:17:00 GMT"} })
31902024-12-14T01:17:01.129ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
31912024-12-14T01:17:01.129ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = bb9f5a1a-5708-4d58-ba4f-c62102236426
31922024-12-14T01:17:01.130ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
31932024-12-14T01:17:01.130ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
31942024-12-14T01:17:01.130ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
31952024-12-14T01:17:01.130ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
31962024-12-14T01:17:01.130ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
31972024-12-14T01:17:01.130ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
31982024-12-14T01:17:01.130ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
31992024-12-14T01:17:01.130ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
32002024-12-14T01:17:01.130ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09
32012024-12-14T01:17:01.130ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32022024-12-14T01:17:01.130ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32032024-12-14T01:17:01.132ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
32042024-12-14T01:17:01.132ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "0a1715d3-5e8b-4eb1-b000-aec7d350d066", "content-length": "2", "date": "Sat, 14 Dec 2024 01:17:01 GMT"} })
32052024-12-14T01:17:01.132ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
32062024-12-14T01:17:01.132ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "9f9c8e56-de1b-4c7a-aefc-f9fc4ea69477", "content-length": "52", "date": "Sat, 14 Dec 2024 01:17:01 GMT"} })
32072024-12-14T01:17:01.132ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 switch_location = Switch0
32082024-12-14T01:17:01.132ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
32092024-12-14T01:17:01.225ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "f81e8fad-54b4-480c-b9f2-8c19d5041216", "date": "Sat, 14 Dec 2024 01:17:01 GMT"} })
32102024-12-14T01:17:01.226ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 switch = Switch0
32112024-12-14T01:17:01.226ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
32122024-12-14T01:17:01.226ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "3481a243-6e36-41e9-b835-b71e998cd1e9", "content-length": "682", "date": "Sat, 14 Dec 2024 01:17:01 GMT"} })
32132024-12-14T01:17:01.226ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32142024-12-14T01:17:01.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32152024-12-14T01:17:01.230ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32162024-12-14T01:17:01.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32172024-12-14T01:17:01.234ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32182024-12-14T01:17:01.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32192024-12-14T01:17:01.236ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32202024-12-14T01:17:01.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32212024-12-14T01:17:01.243ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 369.751741ms iteration = 28 status = {}
32222024-12-14T01:17:01.760ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
32232024-12-14T01:17:01.760ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::a]:12221
32242024-12-14T01:17:01.789ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::a]:12221/metrics/producers
32252024-12-14T01:17:01.790ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::a]:12221 remote_addr = [fd00:1122:3344:101::a]:64251
32262024-12-14T01:17:01.790ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::a]:64251 req_id = 2eeb476b-7e7f-4f20-acf7-9fb7472a893b roles = RoleSet { roles: {} } uri = /metrics/producers
32272024-12-14T01:17:01.790ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::a]:64251 req_id = 2eeb476b-7e7f-4f20-acf7-9fb7472a893b resource = Database result = Ok(()) uri = /metrics/producers
32282024-12-14T01:17:01.826ZINFOnexus: assigned collector to new producer collector_id = 6e1e4a25-c6a7-49c5-bb1d-86638130bef7 file = nexus/src/app/oximeter.rs:76 producer_id = ec66f35d-9dc5-46c1-80a1-ebaa91a8212a
32292024-12-14T01:17:01.826ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36161 local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::a]:64251 req_id = 2eeb476b-7e7f-4f20-acf7-9fb7472a893b response_code = 201 uri = /metrics/producers
32302024-12-14T01:17:01.826ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "2eeb476b-7e7f-4f20-acf7-9fb7472a893b", "content-length": "41", "date": "Sat, 14 Dec 2024 01:17:01 GMT"} })
32312024-12-14T01:17:01.827ZDEBGnexus (producer-registration-task): registered with nexus successfully
32322024-12-14T01:17:01.827ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
32332024-12-14T01:17:03.461ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1790 local_addr = [fd00:1122:3344:101::a]:59823 method = GET remote_addr = [fd00:1122:3344:101::d]:36065 req_id = bbd14e71-1087-4bf3-85b5-c007832433cd response_code = 200 uri = /ec66f35d-9dc5-46c1-80a1-ebaa91a8212a
32342024-12-14T01:17:07.181ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 31 reason = Timeout
32352024-12-14T01:17:07.181ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
32362024-12-14T01:17:07.181ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32372024-12-14T01:17:07.182ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32382024-12-14T01:17:07.183ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32392024-12-14T01:17:07.185ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
32402024-12-14T01:17:07.185ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32412024-12-14T01:17:07.186ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32422024-12-14T01:17:07.187ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32432024-12-14T01:17:07.189ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
32442024-12-14T01:17:07.189ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32452024-12-14T01:17:07.189ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32462024-12-14T01:17:07.276ZINFOnexus (BackgroundTasks): VPC route manager sled 7e423e95-464a-471f-a0d9-4799977f0b0f background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
32472024-12-14T01:17:07.276ZDEBGnexus (BackgroundTasks): client request SledAgent = 7e423e95-464a-471f-a0d9-4799977f0b0f background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
32482024-12-14T01:17:07.277ZDEBGnexus (BackgroundTasks): client response SledAgent = 7e423e95-464a-471f-a0d9-4799977f0b0f background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "edeb2ad3-db3a-455e-a920-2f214e33bb43", "content-length": "372", "date": "Sat, 14 Dec 2024 01:17:07 GMT"} })
32492024-12-14T01:17:07.277ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32502024-12-14T01:17:07.277ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32512024-12-14T01:17:07.291ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
32522024-12-14T01:17:07.291ZDEBGnexus (BackgroundTasks): client request SledAgent = 7e423e95-464a-471f-a0d9-4799977f0b0f background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
32532024-12-14T01:17:07.291ZDEBGnexus (BackgroundTasks): client response SledAgent = 7e423e95-464a-471f-a0d9-4799977f0b0f background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "4794f12a-253d-4873-8d25-238bb4323dde", "date": "Sat, 14 Dec 2024 01:17:07 GMT"} })
32542024-12-14T01:17:07.291ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32552024-12-14T01:17:07.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32562024-12-14T01:17:07.293ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32572024-12-14T01:17:07.293ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32582024-12-14T01:17:07.297ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32592024-12-14T01:17:07.297ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32602024-12-14T01:17:07.299ZINFOnexus (BackgroundTasks): VPC route manager sled 7e423e95-464a-471f-a0d9-4799977f0b0f push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
32612024-12-14T01:17:07.299ZDEBGnexus (BackgroundTasks): client request SledAgent = 7e423e95-464a-471f-a0d9-4799977f0b0f background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
32622024-12-14T01:17:07.300ZDEBGnexus (BackgroundTasks): client response SledAgent = 7e423e95-464a-471f-a0d9-4799977f0b0f background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "33d0b272-fb66-45dc-bfe2-1edbc5d55cfe", "date": "Sat, 14 Dec 2024 01:17:07 GMT"} })
32632024-12-14T01:17:07.301ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 120.329051ms iteration = 31 status = {}
32642024-12-14T01:17:10.873ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 83 reason = Timeout
32652024-12-14T01:17:10.873ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 83 reason = Timeout
32662024-12-14T01:17:10.873ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
32672024-12-14T01:17:10.873ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32682024-12-14T01:17:10.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
32692024-12-14T01:17:10.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32702024-12-14T01:17:10.875ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
32712024-12-14T01:17:10.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
32722024-12-14T01:17:10.875ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32732024-12-14T01:17:10.877ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.241783ms iteration = 83 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
32742024-12-14T01:17:10.878ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
32752024-12-14T01:17:10.878ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32762024-12-14T01:17:10.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32772024-12-14T01:17:10.880ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32782024-12-14T01:17:10.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32792024-12-14T01:17:10.882ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32802024-12-14T01:17:10.885ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8770bfcc-3a71-4738-a6b0-91008cadcb0f, lookup_type: ById(8770bfcc-3a71-4738-a6b0-91008cadcb0f) } result = Ok(())
32812024-12-14T01:17:10.885ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32822024-12-14T01:17:10.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32832024-12-14T01:17:10.897ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8770bfcc-3a71-4738-a6b0-91008cadcb0f original_time_created = 2024-12-14 01:03:15.378067 UTC target_id = 8770bfcc-3a71-4738-a6b0-91008cadcb0f time_created = 2024-12-14 01:03:15.378067 UTC
32842024-12-14T01:17:10.897ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.101408ms iteration = 83 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8770bfcc-3a71-4738-a6b0-91008cadcb0f","time_created":"2024-12-14T01:03:15.378067Z"}
32852024-12-14T01:17:13.461ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1627 local_addr = [fd00:1122:3344:101::a]:59823 method = GET remote_addr = [fd00:1122:3344:101::d]:36065 req_id = 6baa4206-f3c8-478c-9be7-f0397646636a response_code = 200 uri = /ec66f35d-9dc5-46c1-80a1-ebaa91a8212a
32862024-12-14T01:17:20.873ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 84 reason = Timeout
32872024-12-14T01:17:20.873ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 84 reason = Timeout
32882024-12-14T01:17:20.873ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
32892024-12-14T01:17:20.873ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32902024-12-14T01:17:20.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
32912024-12-14T01:17:20.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32922024-12-14T01:17:20.875ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
32932024-12-14T01:17:20.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
32942024-12-14T01:17:20.876ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32952024-12-14T01:17:20.877ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.116289ms iteration = 84 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
32962024-12-14T01:17:20.878ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
32972024-12-14T01:17:20.878ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32982024-12-14T01:17:20.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32992024-12-14T01:17:20.880ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33002024-12-14T01:17:20.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33012024-12-14T01:17:20.882ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33022024-12-14T01:17:20.884ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8770bfcc-3a71-4738-a6b0-91008cadcb0f, lookup_type: ById(8770bfcc-3a71-4738-a6b0-91008cadcb0f) } result = Ok(())
33032024-12-14T01:17:20.884ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33042024-12-14T01:17:20.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33052024-12-14T01:17:20.893ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8770bfcc-3a71-4738-a6b0-91008cadcb0f original_time_created = 2024-12-14 01:03:15.378067 UTC target_id = 8770bfcc-3a71-4738-a6b0-91008cadcb0f time_created = 2024-12-14 01:03:15.378067 UTC
33062024-12-14T01:17:20.893ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.293007ms iteration = 84 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8770bfcc-3a71-4738-a6b0-91008cadcb0f","time_created":"2024-12-14T01:03:15.378067Z"}
33072024-12-14T01:17:23.461ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1599 local_addr = [fd00:1122:3344:101::a]:59823 method = GET remote_addr = [fd00:1122:3344:101::d]:36065 req_id = bf20fbcd-13d5-4825-853c-94fb1526023e response_code = 200 uri = /ec66f35d-9dc5-46c1-80a1-ebaa91a8212a
33082024-12-14T01:17:30.873ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 15 reason = Timeout
33092024-12-14T01:17:30.873ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
33102024-12-14T01:17:30.873ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
33112024-12-14T01:17:30.873ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 29 reason = Timeout
33122024-12-14T01:17:30.873ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 17 reason = Timeout
33132024-12-14T01:17:30.873ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
33142024-12-14T01:17:30.873ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 29 reason = Timeout
33152024-12-14T01:17:30.873ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
33162024-12-14T01:17:30.873ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 29 reason = Timeout
33172024-12-14T01:17:30.873ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 29 reason = Timeout
33182024-12-14T01:17:30.873ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
33192024-12-14T01:17:30.873ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 15 reason = Timeout
33202024-12-14T01:17:30.873ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33212024-12-14T01:17:30.873ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
33222024-12-14T01:17:30.873ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 15 reason = Timeout
33232024-12-14T01:17:30.873ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
33242024-12-14T01:17:30.873ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 31 reason = Timeout
33252024-12-14T01:17:30.873ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
33262024-12-14T01:17:30.873ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 85 reason = Timeout
33272024-12-14T01:17:30.873ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
33282024-12-14T01:17:30.873ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 29 reason = Timeout
33292024-12-14T01:17:30.873ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 15 reason = Timeout
33302024-12-14T01:17:30.873ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
33312024-12-14T01:17:30.873ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 29 reason = Timeout
33322024-12-14T01:17:30.873ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
33332024-12-14T01:17:30.873ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
33342024-12-14T01:17:30.873ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 29 reason = Timeout
33352024-12-14T01:17:30.873ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
33362024-12-14T01:17:30.873ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 15 reason = Timeout
33372024-12-14T01:17:30.874ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
33382024-12-14T01:17:30.874ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 15 reason = Timeout
33392024-12-14T01:17:30.874ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
33402024-12-14T01:17:30.874ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
33412024-12-14T01:17:30.874ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 29 reason = Timeout
33422024-12-14T01:17:30.874ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
33432024-12-14T01:17:30.874ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 31 reason = Timeout
33442024-12-14T01:17:30.874ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
33452024-12-14T01:17:30.874ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 15 reason = Timeout
33462024-12-14T01:17:30.874ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 15 reason = Timeout
33472024-12-14T01:17:30.874ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-14 01:07:30.874001445 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
33482024-12-14T01:17:30.874ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
33492024-12-14T01:17:30.874ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 17 reason = Timeout
33502024-12-14T01:17:30.874ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 15 reason = Timeout
33512024-12-14T01:17:30.874ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
33522024-12-14T01:17:30.874ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 29 reason = Timeout
33532024-12-14T01:17:30.874ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
33542024-12-14T01:17:30.874ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 16 reason = Timeout
33552024-12-14T01:17:30.874ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 8770bfcc-3a71-4738-a6b0-91008cadcb0f
33562024-12-14T01:17:30.874ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 12.41\u{b5}s iteration = 16 status = {"enabled":false,"target_id":"8770bfcc-3a71-4738-a6b0-91008cadcb0f"}
33572024-12-14T01:17:30.874ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 85 reason = Timeout
33582024-12-14T01:17:30.874ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33592024-12-14T01:17:30.874ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 15 reason = Timeout
33602024-12-14T01:17:30.874ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 29 reason = Timeout
33612024-12-14T01:17:30.874ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 29 reason = Timeout
33622024-12-14T01:17:30.874ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
33632024-12-14T01:17:30.874ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
33642024-12-14T01:17:30.874ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 29 reason = Timeout
33652024-12-14T01:17:30.874ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
33662024-12-14T01:17:30.874ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
33672024-12-14T01:17:30.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
33682024-12-14T01:17:30.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
33692024-12-14T01:17:30.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
33702024-12-14T01:17:30.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
33712024-12-14T01:17:30.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
33722024-12-14T01:17:30.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
33732024-12-14T01:17:30.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
33742024-12-14T01:17:30.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
33752024-12-14T01:17:30.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33762024-12-14T01:17:30.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
33772024-12-14T01:17:30.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
33782024-12-14T01:17:30.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
33792024-12-14T01:17:30.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
33802024-12-14T01:17:30.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
33812024-12-14T01:17:30.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
33822024-12-14T01:17:30.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
33832024-12-14T01:17:30.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
33842024-12-14T01:17:30.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
33852024-12-14T01:17:30.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
33862024-12-14T01:17:30.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
33872024-12-14T01:17:30.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33882024-12-14T01:17:30.874ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1b585a7c-7eb0-4894-b8b3-3ef1983891e5.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("36100ee5-fa9a-4857-a844-70bec0e8601f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("830b88b6-26da-4988-83b1-cf4193531cd5.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("830b88b6-26da-4988-83b1-cf4193531cd5.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1613, tv_nsec: 703687067 } })
33892024-12-14T01:17:30.874ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("381b8112-f609-4c4d-ac80-0170ad8fc4bd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("795aee12-3394-49fa-9cb5-487c97a85b2d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("795aee12-3394-49fa-9cb5-487c97a85b2d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1613, tv_nsec: 703711828 } })
33902024-12-14T01:17:30.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
33912024-12-14T01:17:30.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
33922024-12-14T01:17:30.875ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
33932024-12-14T01:17:30.875ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.241286ms iteration = 15 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
33942024-12-14T01:17:30.875ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
33952024-12-14T01:17:30.875ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.180054ms iteration = 15 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
33962024-12-14T01:17:30.875ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
33972024-12-14T01:17:30.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
33982024-12-14T01:17:30.877ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.647645ms iteration = 29 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
33992024-12-14T01:17:30.879ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 5.758067ms iteration = 15 status = {"errors":[],"found_port_ok":[]}
34002024-12-14T01:17:30.880ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34012024-12-14T01:17:30.881ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34022024-12-14T01:17:30.882ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
34032024-12-14T01:17:30.882ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
34042024-12-14T01:17:30.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
34052024-12-14T01:17:30.883ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
34062024-12-14T01:17:30.883ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
34072024-12-14T01:17:30.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
34082024-12-14T01:17:30.886ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
34092024-12-14T01:17:30.886ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-7e423e95-464a-471f-a0d9-4799977f0b0f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-7e423e95-464a-471f-a0d9-4799977f0b0f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1613, tv_nsec: 715024515 } })
34102024-12-14T01:17:30.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
34112024-12-14T01:17:30.886ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
34122024-12-14T01:17:30.886ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-7e423e95-464a-471f-a0d9-4799977f0b0f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-7e423e95-464a-471f-a0d9-4799977f0b0f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1613, tv_nsec: 715355685 } })
34132024-12-14T01:17:30.886ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
34142024-12-14T01:17:30.886ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-14 01:07:30.874001445 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
34152024-12-14T01:17:30.886ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 12.889553ms iteration = 15 status = {"expiration":"2024-12-14T01:07:30.874001445Z","pruned":[]}
34162024-12-14T01:17:30.887ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34172024-12-14T01:17:30.888ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34182024-12-14T01:17:30.889ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
34192024-12-14T01:17:30.889ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
34202024-12-14T01:17:30.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
34212024-12-14T01:17:30.891ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
34222024-12-14T01:17:30.891ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34232024-12-14T01:17:30.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34242024-12-14T01:17:30.893ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34252024-12-14T01:17:30.894ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-7e423e95-464a-471f-a0d9-4799977f0b0f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-7e423e95-464a-471f-a0d9-4799977f0b0f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1613, tv_nsec: 723158560 } })
34262024-12-14T01:17:30.894ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09
34272024-12-14T01:17:30.894ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
34282024-12-14T01:17:30.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
34292024-12-14T01:17:30.895ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34302024-12-14T01:17:30.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34312024-12-14T01:17:30.897ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
34322024-12-14T01:17:30.897ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34332024-12-14T01:17:30.900ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8770bfcc-3a71-4738-a6b0-91008cadcb0f, lookup_type: ById(8770bfcc-3a71-4738-a6b0-91008cadcb0f) } result = Ok(())
34342024-12-14T01:17:30.900ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34352024-12-14T01:17:30.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34362024-12-14T01:17:30.912ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
34372024-12-14T01:17:30.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
34382024-12-14T01:17:30.913ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
34392024-12-14T01:17:30.913ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
34402024-12-14T01:17:30.913ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 39.522024ms iteration = 15 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
34412024-12-14T01:17:30.914ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 40.621485ms iteration = 85 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
34422024-12-14T01:17:30.915ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 41.244594ms iteration = 29 status = {"errors":[],"records_set_to_done":[]}
34432024-12-14T01:17:30.917ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34442024-12-14T01:17:30.919ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
34452024-12-14T01:17:30.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
34462024-12-14T01:17:30.919ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
34472024-12-14T01:17:30.920ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
34482024-12-14T01:17:30.920ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
34492024-12-14T01:17:30.920ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
34502024-12-14T01:17:30.920ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
34512024-12-14T01:17:30.920ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 47.179405ms iteration = 29 status = {"errors":[],"garbage_collect_requested":[]}
34522024-12-14T01:17:30.922ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
34532024-12-14T01:17:30.922ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8770bfcc-3a71-4738-a6b0-91008cadcb0f original_time_created = 2024-12-14 01:03:15.378067 UTC target_id = 8770bfcc-3a71-4738-a6b0-91008cadcb0f time_created = 2024-12-14 01:03:15.378067 UTC
34542024-12-14T01:17:30.922ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 48.164464ms iteration = 85 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8770bfcc-3a71-4738-a6b0-91008cadcb0f","time_created":"2024-12-14T01:03:15.378067Z"}
34552024-12-14T01:17:30.922ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
34562024-12-14T01:17:30.923ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 49.329057ms iteration = 29 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
34572024-12-14T01:17:30.923ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
34582024-12-14T01:17:30.923ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
34592024-12-14T01:17:30.924ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34602024-12-14T01:17:30.924ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
34612024-12-14T01:17:30.924ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34622024-12-14T01:17:30.925ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
34632024-12-14T01:17:30.926ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34642024-12-14T01:17:30.926ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 52.963343ms iteration = 29 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
34652024-12-14T01:17:30.927ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
34662024-12-14T01:17:30.927ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
34672024-12-14T01:17:30.927ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
34682024-12-14T01:17:30.928ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
34692024-12-14T01:17:30.928ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
34702024-12-14T01:17:30.928ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
34712024-12-14T01:17:30.931ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
34722024-12-14T01:17:30.931ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
34732024-12-14T01:17:30.931ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
34742024-12-14T01:17:30.932ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
34752024-12-14T01:17:30.932ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
34762024-12-14T01:17:30.932ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34772024-12-14T01:17:30.934ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
34782024-12-14T01:17:30.934ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
34792024-12-14T01:17:30.934ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
34802024-12-14T01:17:30.934ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
34812024-12-14T01:17:30.934ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
34822024-12-14T01:17:30.935ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
34832024-12-14T01:17:30.936ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
34842024-12-14T01:17:30.936ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34852024-12-14T01:17:30.937ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
34862024-12-14T01:17:30.937ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
34872024-12-14T01:17:30.937ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
34882024-12-14T01:17:30.937ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
34892024-12-14T01:17:30.938ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
34902024-12-14T01:17:30.938ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
34912024-12-14T01:17:30.938ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 64.774204ms iteration = 29 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
34922024-12-14T01:17:30.939ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
34932024-12-14T01:17:30.939ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
34942024-12-14T01:17:30.939ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
34952024-12-14T01:17:30.939ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
34962024-12-14T01:17:30.939ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
34972024-12-14T01:17:30.940ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
34982024-12-14T01:17:30.940ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
34992024-12-14T01:17:30.940ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
35002024-12-14T01:17:30.946ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
35012024-12-14T01:17:30.946ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 71.907441ms iteration = 29 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
35022024-12-14T01:17:30.956ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
35032024-12-14T01:17:30.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
35042024-12-14T01:17:30.962ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
35052024-12-14T01:17:30.962ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
35062024-12-14T01:17:30.963ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 89.317605ms iteration = 29 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
35072024-12-14T01:17:30.965ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
35082024-12-14T01:17:30.965ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
35092024-12-14T01:17:30.965ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
35102024-12-14T01:17:30.965ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
35112024-12-14T01:17:30.965ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 91.733875ms iteration = 15 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
35122024-12-14T01:17:30.966ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35132024-12-14T01:17:30.967ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
35142024-12-14T01:17:30.967ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
35152024-12-14T01:17:30.967ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
35162024-12-14T01:17:30.967ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
35172024-12-14T01:17:30.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
35182024-12-14T01:17:30.969ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35192024-12-14T01:17:30.969ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 7e423e95-464a-471f-a0d9-4799977f0b0f, lookup_type: ById(7e423e95-464a-471f-a0d9-4799977f0b0f) } result = Ok(())
35202024-12-14T01:17:30.969ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
35212024-12-14T01:17:30.970ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
35222024-12-14T01:17:30.972ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 97.901743ms iteration = 29 status = 0
35232024-12-14T01:17:30.972ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
35242024-12-14T01:17:30.972ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
35252024-12-14T01:17:30.972ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
35262024-12-14T01:17:30.973ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35272024-12-14T01:17:30.974ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 100.082106ms iteration = 31 status = {"physical_disks_added":0}
35282024-12-14T01:17:30.974ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
35292024-12-14T01:17:30.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
35302024-12-14T01:17:30.975ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35312024-12-14T01:17:30.975ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
35322024-12-14T01:17:30.976ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
35332024-12-14T01:17:30.976ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
35342024-12-14T01:17:30.977ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
35352024-12-14T01:17:30.977ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
35362024-12-14T01:17:30.977ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
35372024-12-14T01:17:31.004ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
35382024-12-14T01:17:31.004ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 866c9448-c447-4b92-96b6-611d51967e09 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
35392024-12-14T01:17:31.004ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
35402024-12-14T01:17:31.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
35412024-12-14T01:17:31.007ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35422024-12-14T01:17:31.011ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
35432024-12-14T01:17:31.011ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
35442024-12-14T01:17:31.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
35452024-12-14T01:17:31.011ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
35462024-12-14T01:17:31.011ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = d9c36d0c-d7d2-439f-a748-798b6d8dea0c dns_zone_name = oxide.test found_so_far = 0 version = 2
35472024-12-14T01:17:31.011ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
35482024-12-14T01:17:31.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
35492024-12-14T01:17:31.013ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35502024-12-14T01:17:31.013ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 866c9448-c447-4b92-96b6-611d51967e09 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
35512024-12-14T01:17:31.013ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
35522024-12-14T01:17:31.013ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-14 01:03:51.993091 UTC dns_group = internal generation = 1
35532024-12-14T01:17:31.013ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 139.540118ms iteration = 15 status = {"generation":1}
35542024-12-14T01:17:31.015ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
35552024-12-14T01:17:31.015ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 141.478585ms iteration = 15 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
35562024-12-14T01:17:31.016ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
35572024-12-14T01:17:31.016ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
35582024-12-14T01:17:31.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
35592024-12-14T01:17:31.017ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-14T01:03:19.260831Z, time_modified: 2024-12-14T01:03:19.260831Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, db_silo: Silo { identity: SiloIdentity { id: 2c668072-a9a1-4a69-928c-e118c99521be, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-14T01:03:52.950638Z, time_modified: 2024-12-14T01:03:52.950638Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "ad8fd43e0fc4f6284dc5e0b0d0f2e6a6e8d979d13f86a71c9b81d6817e439efd" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, db_silo: Silo { identity: SiloIdentity { id: 2c668072-a9a1-4a69-928c-e118c99521be, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-14T01:03:52.950638Z, time_modified: 2024-12-14T01:03:52.950638Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "ad8fd43e0fc4f6284dc5e0b0d0f2e6a6e8d979d13f86a71c9b81d6817e439efd" }] }) }
35602024-12-14T01:17:31.017ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 143.77308ms iteration = 15 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"2c668072-a9a1-4a69-928c-e118c99521be","tls_certs":["ad8fd43e0fc4f6284dc5e0b0d0f2e6a6e8d979d13f86a71c9b81d6817e439efd"]}},"default_endpoint":{"silo_id":"2c668072-a9a1-4a69-928c-e118c99521be","tls_certs":["ad8fd43e0fc4f6284dc5e0b0d0f2e6a6e8d979d13f86a71c9b81d6817e439efd"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
35612024-12-14T01:17:31.018ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = d9c36d0c-d7d2-439f-a748-798b6d8dea0c dns_zone_name = oxide.test found_so_far = 1 version = 2
35622024-12-14T01:17:31.018ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
35632024-12-14T01:17:31.018ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-14 01:03:53.017536 UTC dns_group = external generation = 2
35642024-12-14T01:17:31.018ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 144.576404ms iteration = 15 status = {"generation":2}
35652024-12-14T01:17:31.039ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
35662024-12-14T01:17:31.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
35672024-12-14T01:17:31.041ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35682024-12-14T01:17:31.042ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
35692024-12-14T01:17:31.042ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
35702024-12-14T01:17:31.043ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
35712024-12-14T01:17:31.043ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
35722024-12-14T01:17:31.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
35732024-12-14T01:17:31.043ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6b016af7-5299-4681-b69e-ab7c162c63ad", "content-length": "26", "date": "Sat, 14 Dec 2024 01:17:31 GMT"} })
35742024-12-14T01:17:31.043ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
35752024-12-14T01:17:31.044ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
35762024-12-14T01:17:31.044ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35772024-12-14T01:17:31.046ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
35782024-12-14T01:17:31.046ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
35792024-12-14T01:17:31.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
35802024-12-14T01:17:31.057ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
35812024-12-14T01:17:31.057ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
35822024-12-14T01:17:31.057ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a382131a-980f-46bf-b2dc-61dc9a7f96e0", "content-length": "26", "date": "Sat, 14 Dec 2024 01:17:31 GMT"} })
35832024-12-14T01:17:31.057ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
35842024-12-14T01:17:31.059ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
35852024-12-14T01:17:31.233ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
35862024-12-14T01:17:31.233ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "fae0cd50-88a3-418b-bcc5-cf91ddf703cb", "content-length": "2", "date": "Sat, 14 Dec 2024 01:17:30 GMT"} })
35872024-12-14T01:17:31.234ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
35882024-12-14T01:17:31.235ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
35892024-12-14T01:17:31.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
35902024-12-14T01:17:31.236ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 362.790109ms iteration = 29 status = {}
35912024-12-14T01:17:31.237ZDEBGnexus (BackgroundTasks): client request SledAgent = 7e423e95-464a-471f-a0d9-4799977f0b0f background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
35922024-12-14T01:17:31.237ZDEBGnexus (BackgroundTasks): client response SledAgent = 7e423e95-464a-471f-a0d9-4799977f0b0f background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "b2cc2535-d13f-434d-b030-90cea930cffd", "content-length": "691", "date": "Sat, 14 Dec 2024 01:17:31 GMT"} })
35932024-12-14T01:17:31.237ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
35942024-12-14T01:17:31.237ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
35952024-12-14T01:17:31.237ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
35962024-12-14T01:17:31.237ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 364.007064ms iteration = 29 status = null
35972024-12-14T01:17:31.238ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 364.716025ms iteration = 31 status = {}
35982024-12-14T01:17:31.264ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
35992024-12-14T01:17:31.288ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 zone_address = fd00:1122:3344:101::2
36002024-12-14T01:17:31.288ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
36012024-12-14T01:17:31.288ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "416c72c2-3062-4592-9280-deade09cc441", "content-length": "26", "date": "Sat, 14 Dec 2024 01:17:31 GMT"} })
36022024-12-14T01:17:31.288ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
36032024-12-14T01:17:31.290ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09
36042024-12-14T01:17:31.458ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
36052024-12-14T01:17:31.458ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "6bc0cbb7-fae4-4771-9e8b-a6ea0d37e4b5", "date": "Sat, 14 Dec 2024 01:17:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
36062024-12-14T01:17:31.458ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
36072024-12-14T01:17:31.460ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "0c4df02d-38c0-421b-b872-7f9614a70b9c", "date": "Sat, 14 Dec 2024 01:17:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
36082024-12-14T01:17:31.460ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
36092024-12-14T01:17:31.461ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
36102024-12-14T01:17:31.461ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 587.825591ms iteration = 17 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
36112024-12-14T01:17:31.467ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
36122024-12-14T01:17:31.529ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
36132024-12-14T01:17:31.529ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "c237c9a6-f0fe-4e1e-9e7f-ac3c79a1f8b1", "date": "Sat, 14 Dec 2024 01:17:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
36142024-12-14T01:17:31.529ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
36152024-12-14T01:17:31.531ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "9a4f461f-22c1-4e47-96bf-d77a2ffbfec4", "date": "Sat, 14 Dec 2024 01:17:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
36162024-12-14T01:17:31.531ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
36172024-12-14T01:17:31.533ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "0c25cfd2-778e-4274-81f3-dfcc24c85c10", "date": "Sat, 14 Dec 2024 01:17:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
36182024-12-14T01:17:31.533ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
36192024-12-14T01:17:31.535ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36202024-12-14T01:17:31.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36212024-12-14T01:17:31.535ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
36222024-12-14T01:17:31.535ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 661.827203ms iteration = 17 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
36232024-12-14T01:17:31.537ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: bb1a4b50-730e-48ee-a311-8a9b9d7bcb73, rack_id: f30fd360-30ae-4088-9821-aa98c2bc8c09, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(bb9f5a1a-5708-4d58-ba4f-c62102236426) } rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 switch_location = Switch0
36242024-12-14T01:17:31.537ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36252024-12-14T01:17:31.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36262024-12-14T01:17:31.546ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
36272024-12-14T01:17:31.547ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "09140bc5-1cc0-4d9f-a743-dce78f2465e2", "content-length": "134", "date": "Sat, 14 Dec 2024 01:17:30 GMT"} })
36282024-12-14T01:17:31.547ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
36292024-12-14T01:17:31.547ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = bb9f5a1a-5708-4d58-ba4f-c62102236426
36302024-12-14T01:17:31.547ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
36312024-12-14T01:17:31.547ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
36322024-12-14T01:17:31.547ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
36332024-12-14T01:17:31.547ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
36342024-12-14T01:17:31.547ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
36352024-12-14T01:17:31.547ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
36362024-12-14T01:17:31.547ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
36372024-12-14T01:17:31.547ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
36382024-12-14T01:17:31.547ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09
36392024-12-14T01:17:31.547ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36402024-12-14T01:17:31.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36412024-12-14T01:17:31.549ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
36422024-12-14T01:17:31.549ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "11445ee9-840b-4dae-a687-5b040a434467", "content-length": "2", "date": "Sat, 14 Dec 2024 01:17:30 GMT"} })
36432024-12-14T01:17:31.550ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
36442024-12-14T01:17:31.550ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "2f0067f1-173d-4414-b82e-e752795b7e07", "content-length": "52", "date": "Sat, 14 Dec 2024 01:17:30 GMT"} })
36452024-12-14T01:17:31.550ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 switch_location = Switch0
36462024-12-14T01:17:31.550ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
36472024-12-14T01:17:31.648ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "bb3daa26-6429-485e-839d-46c2c2c15460", "date": "Sat, 14 Dec 2024 01:17:31 GMT"} })
36482024-12-14T01:17:31.648ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 switch = Switch0
36492024-12-14T01:17:31.648ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
36502024-12-14T01:17:31.652ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "06227e48-53ee-42b1-b53f-7c9342acb460", "content-length": "682", "date": "Sat, 14 Dec 2024 01:17:31 GMT"} })
36512024-12-14T01:17:31.652ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36522024-12-14T01:17:31.652ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36532024-12-14T01:17:31.656ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36542024-12-14T01:17:31.656ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36552024-12-14T01:17:31.659ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36562024-12-14T01:17:31.659ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36572024-12-14T01:17:31.661ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36582024-12-14T01:17:31.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36592024-12-14T01:17:31.668ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 795.077899ms iteration = 29 status = {}
36602024-12-14T01:17:33.461ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1702 local_addr = [fd00:1122:3344:101::a]:59823 method = GET remote_addr = [fd00:1122:3344:101::d]:36065 req_id = c2f33a3b-ad5a-434f-afe9-460411ffce4f response_code = 200 uri = /ec66f35d-9dc5-46c1-80a1-ebaa91a8212a
36612024-12-14T01:17:37.181ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 32 reason = Timeout
36622024-12-14T01:17:37.181ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
36632024-12-14T01:17:37.181ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36642024-12-14T01:17:37.181ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36652024-12-14T01:17:37.184ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36662024-12-14T01:17:37.185ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
36672024-12-14T01:17:37.185ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36682024-12-14T01:17:37.186ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36692024-12-14T01:17:37.187ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36702024-12-14T01:17:37.189ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
36712024-12-14T01:17:37.189ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36722024-12-14T01:17:37.190ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36732024-12-14T01:17:37.224ZINFOnexus (BackgroundTasks): VPC route manager sled 7e423e95-464a-471f-a0d9-4799977f0b0f background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
36742024-12-14T01:17:37.224ZDEBGnexus (BackgroundTasks): client request SledAgent = 7e423e95-464a-471f-a0d9-4799977f0b0f background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
36752024-12-14T01:17:37.224ZDEBGnexus (BackgroundTasks): client response SledAgent = 7e423e95-464a-471f-a0d9-4799977f0b0f background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "bbb42cb4-ff3f-4298-8a75-37d90a27833b", "content-length": "372", "date": "Sat, 14 Dec 2024 01:17:37 GMT"} })
36762024-12-14T01:17:37.224ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36772024-12-14T01:17:37.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36782024-12-14T01:17:37.263ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
36792024-12-14T01:17:37.263ZDEBGnexus (BackgroundTasks): client request SledAgent = 7e423e95-464a-471f-a0d9-4799977f0b0f background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
36802024-12-14T01:17:37.263ZDEBGnexus (BackgroundTasks): client response SledAgent = 7e423e95-464a-471f-a0d9-4799977f0b0f background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "fc726791-d2a3-4061-9a1e-6f6fb201c229", "date": "Sat, 14 Dec 2024 01:17:37 GMT"} })
36812024-12-14T01:17:37.263ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36822024-12-14T01:17:37.263ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36832024-12-14T01:17:37.265ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36842024-12-14T01:17:37.265ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36852024-12-14T01:17:37.269ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36862024-12-14T01:17:37.269ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36872024-12-14T01:17:37.272ZINFOnexus (BackgroundTasks): VPC route manager sled 7e423e95-464a-471f-a0d9-4799977f0b0f push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
36882024-12-14T01:17:37.272ZDEBGnexus (BackgroundTasks): client request SledAgent = 7e423e95-464a-471f-a0d9-4799977f0b0f background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
36892024-12-14T01:17:37.273ZDEBGnexus (BackgroundTasks): client response SledAgent = 7e423e95-464a-471f-a0d9-4799977f0b0f background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "681e3727-3037-44ac-8ad1-df970612a4de", "date": "Sat, 14 Dec 2024 01:17:37 GMT"} })
36902024-12-14T01:17:37.274ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 93.240508ms iteration = 32 status = {}
36912024-12-14T01:17:40.873ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 86 reason = Timeout
36922024-12-14T01:17:40.873ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36932024-12-14T01:17:40.873ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 86 reason = Timeout
36942024-12-14T01:17:40.873ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
36952024-12-14T01:17:40.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36962024-12-14T01:17:40.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
36972024-12-14T01:17:40.876ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
36982024-12-14T01:17:40.877ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
36992024-12-14T01:17:40.878ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.776948ms iteration = 86 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
37002024-12-14T01:17:40.910ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37012024-12-14T01:17:40.912ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
37022024-12-14T01:17:40.912ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37032024-12-14T01:17:40.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37042024-12-14T01:17:40.915ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37052024-12-14T01:17:40.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37062024-12-14T01:17:40.916ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37072024-12-14T01:17:40.919ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8770bfcc-3a71-4738-a6b0-91008cadcb0f, lookup_type: ById(8770bfcc-3a71-4738-a6b0-91008cadcb0f) } result = Ok(())
37082024-12-14T01:17:40.919ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37092024-12-14T01:17:40.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37102024-12-14T01:17:40.932ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8770bfcc-3a71-4738-a6b0-91008cadcb0f original_time_created = 2024-12-14 01:03:15.378067 UTC target_id = 8770bfcc-3a71-4738-a6b0-91008cadcb0f time_created = 2024-12-14 01:03:15.378067 UTC
37112024-12-14T01:17:40.932ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 58.310407ms iteration = 86 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8770bfcc-3a71-4738-a6b0-91008cadcb0f","time_created":"2024-12-14T01:03:15.378067Z"}
37122024-12-14T01:17:43.461ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1777 local_addr = [fd00:1122:3344:101::a]:59823 method = GET remote_addr = [fd00:1122:3344:101::d]:36065 req_id = 6eb04317-05ba-4c6f-b8d1-2747b4b61437 response_code = 200 uri = /ec66f35d-9dc5-46c1-80a1-ebaa91a8212a
37132024-12-14T01:17:48.451ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:35184 req_id = d759e844-2bd6-456b-959e-7b37b3ea9378 roles = RoleSet { roles: {} } uri = /metrics/collectors/6e1e4a25-c6a7-49c5-bb1d-86638130bef7/producers?sort_by=id_ascending
37142024-12-14T01:17:48.451ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:35184 req_id = d759e844-2bd6-456b-959e-7b37b3ea9378 resource = Database result = Ok(()) uri = /metrics/collectors/6e1e4a25-c6a7-49c5-bb1d-86638130bef7/producers?sort_by=id_ascending
37152024-12-14T01:17:48.454ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3330 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:35184 req_id = d759e844-2bd6-456b-959e-7b37b3ea9378 response_code = 200 uri = /metrics/collectors/6e1e4a25-c6a7-49c5-bb1d-86638130bef7/producers?sort_by=id_ascending
37162024-12-14T01:17:48.454ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:35184 req_id = 1b78f6bc-dfb0-4955-9cab-6bf1f4cf127f roles = RoleSet { roles: {} } uri = /metrics/collectors/6e1e4a25-c6a7-49c5-bb1d-86638130bef7/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNGM2ZGNlZi0yNTc3LTQxMmUtODNkMS0zNzkyZGNjMDQ2MWQifX0%3D
37172024-12-14T01:17:48.455ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:35184 req_id = 1b78f6bc-dfb0-4955-9cab-6bf1f4cf127f resource = Database result = Ok(()) uri = /metrics/collectors/6e1e4a25-c6a7-49c5-bb1d-86638130bef7/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNGM2ZGNlZi0yNTc3LTQxMmUtODNkMS0zNzkyZGNjMDQ2MWQifX0%3D
37182024-12-14T01:17:48.457ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2175 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:35184 req_id = 1b78f6bc-dfb0-4955-9cab-6bf1f4cf127f response_code = 200 uri = /metrics/collectors/6e1e4a25-c6a7-49c5-bb1d-86638130bef7/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNGM2ZGNlZi0yNTc3LTQxMmUtODNkMS0zNzkyZGNjMDQ2MWQifX0%3D
37192024-12-14T01:17:50.873ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 87 reason = Timeout
37202024-12-14T01:17:50.873ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 87 reason = Timeout
37212024-12-14T01:17:50.873ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37222024-12-14T01:17:50.873ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37232024-12-14T01:17:50.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37242024-12-14T01:17:50.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
37252024-12-14T01:17:50.875ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37262024-12-14T01:17:50.875ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37272024-12-14T01:17:50.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
37282024-12-14T01:17:50.877ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
37292024-12-14T01:17:50.877ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37302024-12-14T01:17:50.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37312024-12-14T01:17:50.879ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37322024-12-14T01:17:50.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37332024-12-14T01:17:50.881ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37342024-12-14T01:17:50.883ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8770bfcc-3a71-4738-a6b0-91008cadcb0f, lookup_type: ById(8770bfcc-3a71-4738-a6b0-91008cadcb0f) } result = Ok(())
37352024-12-14T01:17:50.883ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37362024-12-14T01:17:50.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37372024-12-14T01:17:50.894ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8770bfcc-3a71-4738-a6b0-91008cadcb0f original_time_created = 2024-12-14 01:03:15.378067 UTC target_id = 8770bfcc-3a71-4738-a6b0-91008cadcb0f time_created = 2024-12-14 01:03:15.378067 UTC
37382024-12-14T01:17:50.894ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.456051ms iteration = 87 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8770bfcc-3a71-4738-a6b0-91008cadcb0f","time_created":"2024-12-14T01:03:15.378067Z"}
37392024-12-14T01:17:50.905ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 32.219812ms iteration = 87 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
37402024-12-14T01:17:53.462ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2204 local_addr = [fd00:1122:3344:101::a]:59823 method = GET remote_addr = [fd00:1122:3344:101::d]:36065 req_id = 1b225772-798b-44d2-9595-9b30c5324800 response_code = 200 uri = /ec66f35d-9dc5-46c1-80a1-ebaa91a8212a
37412024-12-14T01:18:00.873ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 30 reason = Timeout
37422024-12-14T01:18:00.873ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 88 reason = Timeout
37432024-12-14T01:18:00.873ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37442024-12-14T01:18:00.873ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37452024-12-14T01:18:00.873ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 30 reason = Timeout
37462024-12-14T01:18:00.873ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 30 reason = Timeout
37472024-12-14T01:18:00.873ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
37482024-12-14T01:18:00.873ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
37492024-12-14T01:18:00.873ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 30 reason = Timeout
37502024-12-14T01:18:00.873ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 30 reason = Timeout
37512024-12-14T01:18:00.873ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
37522024-12-14T01:18:00.873ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
37532024-12-14T01:18:00.873ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 30 reason = Timeout
37542024-12-14T01:18:00.873ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
37552024-12-14T01:18:00.873ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 88 reason = Timeout
37562024-12-14T01:18:00.873ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37572024-12-14T01:18:00.873ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 32 reason = Timeout
37582024-12-14T01:18:00.873ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 30 reason = Timeout
37592024-12-14T01:18:00.873ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
37602024-12-14T01:18:00.873ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
37612024-12-14T01:18:00.873ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 30 reason = Timeout
37622024-12-14T01:18:00.873ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
37632024-12-14T01:18:00.873ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 30 reason = Timeout
37642024-12-14T01:18:00.873ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
37652024-12-14T01:18:00.873ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 30 reason = Timeout
37662024-12-14T01:18:00.873ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 30 reason = Timeout
37672024-12-14T01:18:00.873ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 32 reason = Timeout
37682024-12-14T01:18:00.873ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
37692024-12-14T01:18:00.873ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
37702024-12-14T01:18:00.873ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 30 reason = Timeout
37712024-12-14T01:18:00.873ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
37722024-12-14T01:18:00.873ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
37732024-12-14T01:18:00.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
37742024-12-14T01:18:00.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
37752024-12-14T01:18:00.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
37762024-12-14T01:18:00.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
37772024-12-14T01:18:00.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37782024-12-14T01:18:00.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
37792024-12-14T01:18:00.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
37802024-12-14T01:18:00.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
37812024-12-14T01:18:00.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
37822024-12-14T01:18:00.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
37832024-12-14T01:18:00.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
37842024-12-14T01:18:00.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37852024-12-14T01:18:00.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
37862024-12-14T01:18:00.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
37872024-12-14T01:18:00.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
37882024-12-14T01:18:00.877ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37892024-12-14T01:18:00.877ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-7e423e95-464a-471f-a0d9-4799977f0b0f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-7e423e95-464a-471f-a0d9-4799977f0b0f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1643, tv_nsec: 706461469 } })
37902024-12-14T01:18:00.877ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
37912024-12-14T01:18:00.878ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37922024-12-14T01:18:00.878ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.556272ms iteration = 30 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
37932024-12-14T01:18:00.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
37942024-12-14T01:18:00.878ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-7e423e95-464a-471f-a0d9-4799977f0b0f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-7e423e95-464a-471f-a0d9-4799977f0b0f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1643, tv_nsec: 707871890 } })
37952024-12-14T01:18:00.879ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
37962024-12-14T01:18:00.879ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 5.90245ms iteration = 30 status = {"errors":[],"records_set_to_done":[]}
37972024-12-14T01:18:00.880ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
37982024-12-14T01:18:00.880ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
37992024-12-14T01:18:00.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
38002024-12-14T01:18:00.882ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38012024-12-14T01:18:00.884ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38022024-12-14T01:18:00.884ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
38032024-12-14T01:18:00.884ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
38042024-12-14T01:18:00.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
38052024-12-14T01:18:00.886ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
38062024-12-14T01:18:00.886ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38072024-12-14T01:18:00.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38082024-12-14T01:18:00.889ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
38092024-12-14T01:18:00.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
38102024-12-14T01:18:00.890ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38112024-12-14T01:18:00.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38122024-12-14T01:18:00.891ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
38132024-12-14T01:18:00.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
38142024-12-14T01:18:00.894ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
38152024-12-14T01:18:00.894ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 20.822972ms iteration = 30 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
38162024-12-14T01:18:00.900ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
38172024-12-14T01:18:00.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
38182024-12-14T01:18:00.907ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38192024-12-14T01:18:00.909ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
38202024-12-14T01:18:00.909ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38212024-12-14T01:18:00.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38222024-12-14T01:18:00.911ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38232024-12-14T01:18:00.911ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 37.472225ms iteration = 30 status = {"errors":[],"garbage_collect_requested":[]}
38242024-12-14T01:18:00.911ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
38252024-12-14T01:18:00.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
38262024-12-14T01:18:00.911ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
38272024-12-14T01:18:00.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
38282024-12-14T01:18:00.913ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-7e423e95-464a-471f-a0d9-4799977f0b0f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-7e423e95-464a-471f-a0d9-4799977f0b0f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1643, tv_nsec: 741977737 } })
38292024-12-14T01:18:00.913ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
38302024-12-14T01:18:00.913ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
38312024-12-14T01:18:00.913ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09
38322024-12-14T01:18:00.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
38332024-12-14T01:18:00.913ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
38342024-12-14T01:18:00.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
38352024-12-14T01:18:00.914ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
38362024-12-14T01:18:00.914ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
38372024-12-14T01:18:00.914ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
38382024-12-14T01:18:00.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
38392024-12-14T01:18:00.915ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 41.599834ms iteration = 88 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
38402024-12-14T01:18:00.915ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
38412024-12-14T01:18:00.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
38422024-12-14T01:18:00.915ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38432024-12-14T01:18:00.917ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
38442024-12-14T01:18:00.917ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
38452024-12-14T01:18:00.917ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
38462024-12-14T01:18:00.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
38472024-12-14T01:18:00.918ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 7e423e95-464a-471f-a0d9-4799977f0b0f, lookup_type: ById(7e423e95-464a-471f-a0d9-4799977f0b0f) } result = Ok(())
38482024-12-14T01:18:00.918ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
38492024-12-14T01:18:00.918ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
38502024-12-14T01:18:00.918ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
38512024-12-14T01:18:00.918ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
38522024-12-14T01:18:00.919ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
38532024-12-14T01:18:00.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
38542024-12-14T01:18:00.920ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 46.723822ms iteration = 30 status = 0
38552024-12-14T01:18:00.920ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38562024-12-14T01:18:00.921ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 47.650829ms iteration = 30 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
38572024-12-14T01:18:00.923ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8770bfcc-3a71-4738-a6b0-91008cadcb0f, lookup_type: ById(8770bfcc-3a71-4738-a6b0-91008cadcb0f) } result = Ok(())
38582024-12-14T01:18:00.923ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38592024-12-14T01:18:00.923ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38602024-12-14T01:18:00.929ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38612024-12-14T01:18:00.931ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
38622024-12-14T01:18:00.931ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
38632024-12-14T01:18:00.931ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
38642024-12-14T01:18:00.932ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38652024-12-14T01:18:00.935ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
38662024-12-14T01:18:00.935ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
38672024-12-14T01:18:00.935ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
38682024-12-14T01:18:00.939ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8770bfcc-3a71-4738-a6b0-91008cadcb0f original_time_created = 2024-12-14 01:03:15.378067 UTC target_id = 8770bfcc-3a71-4738-a6b0-91008cadcb0f time_created = 2024-12-14 01:03:15.378067 UTC
38692024-12-14T01:18:00.939ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 65.494506ms iteration = 88 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8770bfcc-3a71-4738-a6b0-91008cadcb0f","time_created":"2024-12-14T01:03:15.378067Z"}
38702024-12-14T01:18:00.947ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
38712024-12-14T01:18:00.947ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
38722024-12-14T01:18:00.951ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 77.568275ms iteration = 30 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
38732024-12-14T01:18:00.952ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38742024-12-14T01:18:00.953ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
38752024-12-14T01:18:00.953ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
38762024-12-14T01:18:00.954ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d8092af7-1860-450e-a647-06edab7868cb", "content-length": "26", "date": "Sat, 14 Dec 2024 01:18:00 GMT"} })
38772024-12-14T01:18:00.954ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
38782024-12-14T01:18:00.955ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
38792024-12-14T01:18:00.955ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
38802024-12-14T01:18:00.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
38812024-12-14T01:18:00.956ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
38822024-12-14T01:18:00.958ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
38832024-12-14T01:18:00.958ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
38842024-12-14T01:18:00.958ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 84.357831ms iteration = 30 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
38852024-12-14T01:18:00.960ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 86.7227ms iteration = 32 status = {"physical_disks_added":0}
38862024-12-14T01:18:00.962ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
38872024-12-14T01:18:00.962ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
38882024-12-14T01:18:00.962ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "882a9e29-9e70-4ba8-83b0-b2d38af70c17", "content-length": "26", "date": "Sat, 14 Dec 2024 01:18:00 GMT"} })
38892024-12-14T01:18:00.962ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
38902024-12-14T01:18:00.964ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
38912024-12-14T01:18:00.980ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 107.249994ms iteration = 30 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
38922024-12-14T01:18:01.007ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 zone_address = fd00:1122:3344:101::2
38932024-12-14T01:18:01.007ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
38942024-12-14T01:18:01.007ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "26609e3a-a2d9-48bb-9fde-3af13a1d9895", "content-length": "26", "date": "Sat, 14 Dec 2024 01:18:00 GMT"} })
38952024-12-14T01:18:01.007ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
38962024-12-14T01:18:01.009ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09
38972024-12-14T01:18:01.061ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 188.403162ms iteration = 30 status = {}
38982024-12-14T01:18:01.063ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
38992024-12-14T01:18:01.064ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "a308a0ef-82a8-4398-ba8d-b341adb92018", "content-length": "2", "date": "Sat, 14 Dec 2024 01:18:01 GMT"} })
39002024-12-14T01:18:01.066ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
39012024-12-14T01:18:01.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
39022024-12-14T01:18:01.068ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 195.182659ms iteration = 30 status = null
39032024-12-14T01:18:01.093ZDEBGnexus (BackgroundTasks): client request SledAgent = 7e423e95-464a-471f-a0d9-4799977f0b0f background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
39042024-12-14T01:18:01.093ZDEBGnexus (BackgroundTasks): client response SledAgent = 7e423e95-464a-471f-a0d9-4799977f0b0f background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "6f3b427f-382b-4658-89df-144bbc426255", "content-length": "691", "date": "Sat, 14 Dec 2024 01:18:01 GMT"} })
39052024-12-14T01:18:01.094ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
39062024-12-14T01:18:01.094ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
39072024-12-14T01:18:01.094ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
39082024-12-14T01:18:01.095ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 221.994684ms iteration = 32 status = {}
39092024-12-14T01:18:01.153ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39102024-12-14T01:18:01.154ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39112024-12-14T01:18:01.156ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: bb1a4b50-730e-48ee-a311-8a9b9d7bcb73, rack_id: f30fd360-30ae-4088-9821-aa98c2bc8c09, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(bb9f5a1a-5708-4d58-ba4f-c62102236426) } rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 switch_location = Switch0
39122024-12-14T01:18:01.156ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39132024-12-14T01:18:01.156ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39142024-12-14T01:18:01.163ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
39152024-12-14T01:18:01.163ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "4f4bbbe6-8fea-4eef-b47a-6c1f82c32083", "content-length": "134", "date": "Sat, 14 Dec 2024 01:18:01 GMT"} })
39162024-12-14T01:18:01.163ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
39172024-12-14T01:18:01.163ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = bb9f5a1a-5708-4d58-ba4f-c62102236426
39182024-12-14T01:18:01.164ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
39192024-12-14T01:18:01.164ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
39202024-12-14T01:18:01.164ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
39212024-12-14T01:18:01.164ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
39222024-12-14T01:18:01.164ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
39232024-12-14T01:18:01.164ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
39242024-12-14T01:18:01.164ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
39252024-12-14T01:18:01.164ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
39262024-12-14T01:18:01.164ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09
39272024-12-14T01:18:01.164ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39282024-12-14T01:18:01.164ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39292024-12-14T01:18:01.166ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
39302024-12-14T01:18:01.166ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "0fff7e05-c67f-489f-9e9a-d76fe0178c4e", "content-length": "2", "date": "Sat, 14 Dec 2024 01:18:01 GMT"} })
39312024-12-14T01:18:01.166ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
39322024-12-14T01:18:01.166ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "1d6a9cff-8282-48b5-a1ff-c8656651646c", "content-length": "52", "date": "Sat, 14 Dec 2024 01:18:01 GMT"} })
39332024-12-14T01:18:01.166ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 switch_location = Switch0
39342024-12-14T01:18:01.166ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
39352024-12-14T01:18:01.261ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "04ce9a79-375b-4ba5-ab96-d5ab476f5266", "date": "Sat, 14 Dec 2024 01:18:01 GMT"} })
39362024-12-14T01:18:01.261ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 switch = Switch0
39372024-12-14T01:18:01.261ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
39382024-12-14T01:18:01.261ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "53e489a3-26d5-4cda-ab4b-0065d7195ad1", "content-length": "682", "date": "Sat, 14 Dec 2024 01:18:01 GMT"} })
39392024-12-14T01:18:01.261ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39402024-12-14T01:18:01.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39412024-12-14T01:18:01.265ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39422024-12-14T01:18:01.265ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39432024-12-14T01:18:01.269ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39442024-12-14T01:18:01.269ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39452024-12-14T01:18:01.270ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39462024-12-14T01:18:01.270ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39472024-12-14T01:18:01.278ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 404.786974ms iteration = 30 status = {}
39482024-12-14T01:18:03.461ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1616 local_addr = [fd00:1122:3344:101::a]:59823 method = GET remote_addr = [fd00:1122:3344:101::d]:36065 req_id = 9e6899d6-1e32-4406-aded-aa4cb6c19ee2 response_code = 200 uri = /ec66f35d-9dc5-46c1-80a1-ebaa91a8212a
39492024-12-14T01:18:07.181ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 33 reason = Timeout
39502024-12-14T01:18:07.181ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
39512024-12-14T01:18:07.181ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39522024-12-14T01:18:07.182ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39532024-12-14T01:18:07.184ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39542024-12-14T01:18:07.186ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
39552024-12-14T01:18:07.186ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39562024-12-14T01:18:07.186ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39572024-12-14T01:18:07.188ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39582024-12-14T01:18:07.189ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
39592024-12-14T01:18:07.189ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39602024-12-14T01:18:07.189ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39612024-12-14T01:18:07.223ZINFOnexus (BackgroundTasks): VPC route manager sled 7e423e95-464a-471f-a0d9-4799977f0b0f background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
39622024-12-14T01:18:07.223ZDEBGnexus (BackgroundTasks): client request SledAgent = 7e423e95-464a-471f-a0d9-4799977f0b0f background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
39632024-12-14T01:18:07.223ZDEBGnexus (BackgroundTasks): client response SledAgent = 7e423e95-464a-471f-a0d9-4799977f0b0f background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "144fed97-4d56-4f8f-adcc-da414e8ef4ea", "content-length": "372", "date": "Sat, 14 Dec 2024 01:18:07 GMT"} })
39642024-12-14T01:18:07.223ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39652024-12-14T01:18:07.223ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39662024-12-14T01:18:07.236ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
39672024-12-14T01:18:07.236ZDEBGnexus (BackgroundTasks): client request SledAgent = 7e423e95-464a-471f-a0d9-4799977f0b0f background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
39682024-12-14T01:18:07.237ZDEBGnexus (BackgroundTasks): client response SledAgent = 7e423e95-464a-471f-a0d9-4799977f0b0f background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "83a21d00-ab5d-4d9d-9fa7-2cbf9487523d", "date": "Sat, 14 Dec 2024 01:18:07 GMT"} })
39692024-12-14T01:18:07.237ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39702024-12-14T01:18:07.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39712024-12-14T01:18:07.238ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39722024-12-14T01:18:07.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39732024-12-14T01:18:07.241ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39742024-12-14T01:18:07.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39752024-12-14T01:18:07.244ZINFOnexus (BackgroundTasks): VPC route manager sled 7e423e95-464a-471f-a0d9-4799977f0b0f push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
39762024-12-14T01:18:07.244ZDEBGnexus (BackgroundTasks): client request SledAgent = 7e423e95-464a-471f-a0d9-4799977f0b0f background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
39772024-12-14T01:18:07.244ZDEBGnexus (BackgroundTasks): client response SledAgent = 7e423e95-464a-471f-a0d9-4799977f0b0f background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "6d6f4d9f-3b7e-4503-b1c0-7756855b6ab8", "date": "Sat, 14 Dec 2024 01:18:07 GMT"} })
39782024-12-14T01:18:07.246ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 65.380032ms iteration = 33 status = {}
39792024-12-14T01:18:10.873ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 89 reason = Timeout
39802024-12-14T01:18:10.873ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 89 reason = Timeout
39812024-12-14T01:18:10.873ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39822024-12-14T01:18:10.873ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39832024-12-14T01:18:10.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39842024-12-14T01:18:10.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39852024-12-14T01:18:10.876ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39862024-12-14T01:18:10.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39872024-12-14T01:18:10.876ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39882024-12-14T01:18:10.877ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.850681ms iteration = 89 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
39892024-12-14T01:18:10.879ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
39902024-12-14T01:18:10.879ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39912024-12-14T01:18:10.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39922024-12-14T01:18:10.881ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39932024-12-14T01:18:10.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39942024-12-14T01:18:10.883ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39952024-12-14T01:18:10.886ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8770bfcc-3a71-4738-a6b0-91008cadcb0f, lookup_type: ById(8770bfcc-3a71-4738-a6b0-91008cadcb0f) } result = Ok(())
39962024-12-14T01:18:10.886ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39972024-12-14T01:18:10.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39982024-12-14T01:18:10.895ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8770bfcc-3a71-4738-a6b0-91008cadcb0f original_time_created = 2024-12-14 01:03:15.378067 UTC target_id = 8770bfcc-3a71-4738-a6b0-91008cadcb0f time_created = 2024-12-14 01:03:15.378067 UTC
39992024-12-14T01:18:10.895ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.710989ms iteration = 89 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8770bfcc-3a71-4738-a6b0-91008cadcb0f","time_created":"2024-12-14T01:03:15.378067Z"}
40002024-12-14T01:18:13.461ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1677 local_addr = [fd00:1122:3344:101::a]:59823 method = GET remote_addr = [fd00:1122:3344:101::d]:36065 req_id = b4de9ad8-aae2-4553-9c77-3e419aa3a369 response_code = 200 uri = /ec66f35d-9dc5-46c1-80a1-ebaa91a8212a
40012024-12-14T01:18:20.873ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 90 reason = Timeout
40022024-12-14T01:18:20.873ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 90 reason = Timeout
40032024-12-14T01:18:20.873ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
40042024-12-14T01:18:20.873ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40052024-12-14T01:18:20.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40062024-12-14T01:18:20.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
40072024-12-14T01:18:20.875ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40082024-12-14T01:18:20.876ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
40092024-12-14T01:18:20.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
40102024-12-14T01:18:20.878ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
40112024-12-14T01:18:20.878ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40122024-12-14T01:18:20.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40132024-12-14T01:18:20.878ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 5.167809ms iteration = 90 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
40142024-12-14T01:18:20.880ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40152024-12-14T01:18:20.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40162024-12-14T01:18:20.882ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40172024-12-14T01:18:20.884ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8770bfcc-3a71-4738-a6b0-91008cadcb0f, lookup_type: ById(8770bfcc-3a71-4738-a6b0-91008cadcb0f) } result = Ok(())
40182024-12-14T01:18:20.885ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40192024-12-14T01:18:20.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40202024-12-14T01:18:20.893ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8770bfcc-3a71-4738-a6b0-91008cadcb0f original_time_created = 2024-12-14 01:03:15.378067 UTC target_id = 8770bfcc-3a71-4738-a6b0-91008cadcb0f time_created = 2024-12-14 01:03:15.378067 UTC
40212024-12-14T01:18:20.893ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.519124ms iteration = 90 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8770bfcc-3a71-4738-a6b0-91008cadcb0f","time_created":"2024-12-14T01:03:15.378067Z"}
40222024-12-14T01:18:23.461ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1601 local_addr = [fd00:1122:3344:101::a]:59823 method = GET remote_addr = [fd00:1122:3344:101::d]:36065 req_id = 799855cf-8733-421c-87ef-b6c889025ced response_code = 200 uri = /ec66f35d-9dc5-46c1-80a1-ebaa91a8212a
40232024-12-14T01:18:30.873ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 33 reason = Timeout
40242024-12-14T01:18:30.873ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 16 reason = Timeout
40252024-12-14T01:18:30.873ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
40262024-12-14T01:18:30.873ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
40272024-12-14T01:18:30.873ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 17 reason = Timeout
40282024-12-14T01:18:30.873ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 8770bfcc-3a71-4738-a6b0-91008cadcb0f
40292024-12-14T01:18:30.873ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 16.071\u{b5}s iteration = 17 status = {"enabled":false,"target_id":"8770bfcc-3a71-4738-a6b0-91008cadcb0f"}
40302024-12-14T01:18:30.873ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 31 reason = Timeout
40312024-12-14T01:18:30.873ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 31 reason = Timeout
40322024-12-14T01:18:30.873ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
40332024-12-14T01:18:30.873ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 4 reason = Timeout
40342024-12-14T01:18:30.873ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
40352024-12-14T01:18:30.873ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
40362024-12-14T01:18:30.873ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 16 reason = Timeout
40372024-12-14T01:18:30.873ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 31 reason = Timeout
40382024-12-14T01:18:30.873ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 31 reason = Timeout
40392024-12-14T01:18:30.873ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
40402024-12-14T01:18:30.873ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
40412024-12-14T01:18:30.873ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 31 reason = Timeout
40422024-12-14T01:18:30.873ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
40432024-12-14T01:18:30.873ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 31 reason = Timeout
40442024-12-14T01:18:30.873ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 91 reason = Timeout
40452024-12-14T01:18:30.873ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40462024-12-14T01:18:30.873ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 7 reason = Timeout
40472024-12-14T01:18:30.873ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40482024-12-14T01:18:30.873ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 16 reason = Timeout
40492024-12-14T01:18:30.874ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
40502024-12-14T01:18:30.874ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
40512024-12-14T01:18:30.874ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
40522024-12-14T01:18:30.874ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 16 reason = Timeout
40532024-12-14T01:18:30.874ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
40542024-12-14T01:18:30.874ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
40552024-12-14T01:18:30.874ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 31 reason = Timeout
40562024-12-14T01:18:30.874ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 16 reason = Timeout
40572024-12-14T01:18:30.874ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40582024-12-14T01:18:30.874ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-14 01:08:30.873980899 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
40592024-12-14T01:18:30.874ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 31 reason = Timeout
40602024-12-14T01:18:30.874ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
40612024-12-14T01:18:30.874ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
40622024-12-14T01:18:30.874ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
40632024-12-14T01:18:30.874ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 31 reason = Timeout
40642024-12-14T01:18:30.874ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
40652024-12-14T01:18:30.874ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 18 reason = Timeout
40662024-12-14T01:18:30.874ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 16 reason = Timeout
40672024-12-14T01:18:30.874ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
40682024-12-14T01:18:30.874ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 16 reason = Timeout
40692024-12-14T01:18:30.874ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 33 reason = Timeout
40702024-12-14T01:18:30.874ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
40712024-12-14T01:18:30.874ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 16 reason = Timeout
40722024-12-14T01:18:30.874ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
40732024-12-14T01:18:30.874ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
40742024-12-14T01:18:30.874ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 16 reason = Timeout
40752024-12-14T01:18:30.874ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
40762024-12-14T01:18:30.874ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 31 reason = Timeout
40772024-12-14T01:18:30.874ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
40782024-12-14T01:18:30.874ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 18 reason = Timeout
40792024-12-14T01:18:30.874ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 31 reason = Timeout
40802024-12-14T01:18:30.874ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 16 reason = Timeout
40812024-12-14T01:18:30.874ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
40822024-12-14T01:18:30.874ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
40832024-12-14T01:18:30.874ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 91 reason = Timeout
40842024-12-14T01:18:30.874ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
40852024-12-14T01:18:30.874ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 31 reason = Timeout
40862024-12-14T01:18:30.874ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
40872024-12-14T01:18:30.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
40882024-12-14T01:18:30.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
40892024-12-14T01:18:30.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40902024-12-14T01:18:30.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
40912024-12-14T01:18:30.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40922024-12-14T01:18:30.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
40932024-12-14T01:18:30.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
40942024-12-14T01:18:30.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
40952024-12-14T01:18:30.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
40962024-12-14T01:18:30.874ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
40972024-12-14T01:18:30.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
40982024-12-14T01:18:30.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
40992024-12-14T01:18:30.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
41002024-12-14T01:18:30.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
41012024-12-14T01:18:30.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
41022024-12-14T01:18:30.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
41032024-12-14T01:18:30.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
41042024-12-14T01:18:30.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
41052024-12-14T01:18:30.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
41062024-12-14T01:18:30.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
41072024-12-14T01:18:30.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
41082024-12-14T01:18:30.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
41092024-12-14T01:18:30.874ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1b585a7c-7eb0-4894-b8b3-3ef1983891e5.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("36100ee5-fa9a-4857-a844-70bec0e8601f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("830b88b6-26da-4988-83b1-cf4193531cd5.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("830b88b6-26da-4988-83b1-cf4193531cd5.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1673, tv_nsec: 703846886 } })
41102024-12-14T01:18:30.874ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("381b8112-f609-4c4d-ac80-0170ad8fc4bd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("795aee12-3394-49fa-9cb5-487c97a85b2d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("795aee12-3394-49fa-9cb5-487c97a85b2d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1673, tv_nsec: 703844966 } })
41112024-12-14T01:18:30.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
41122024-12-14T01:18:30.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
41132024-12-14T01:18:30.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
41142024-12-14T01:18:30.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
41152024-12-14T01:18:30.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
41162024-12-14T01:18:30.874ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
41172024-12-14T01:18:30.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
41182024-12-14T01:18:30.875ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
41192024-12-14T01:18:30.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
41202024-12-14T01:18:30.875ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
41212024-12-14T01:18:30.875ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
41222024-12-14T01:18:30.875ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.495733ms iteration = 16 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
41232024-12-14T01:18:30.875ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
41242024-12-14T01:18:30.875ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.318918ms iteration = 16 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
41252024-12-14T01:18:30.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
41262024-12-14T01:18:30.876ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 2.874693ms iteration = 16 status = {"errors":[],"found_port_ok":[]}
41272024-12-14T01:18:30.877ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41282024-12-14T01:18:30.878ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.351486ms iteration = 31 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
41292024-12-14T01:18:30.878ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41302024-12-14T01:18:30.879ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
41312024-12-14T01:18:30.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
41322024-12-14T01:18:30.879ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
41332024-12-14T01:18:30.879ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41342024-12-14T01:18:30.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41352024-12-14T01:18:30.880ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-7e423e95-464a-471f-a0d9-4799977f0b0f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-7e423e95-464a-471f-a0d9-4799977f0b0f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1673, tv_nsec: 709099028 } })
41362024-12-14T01:18:30.880ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
41372024-12-14T01:18:30.881ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
41382024-12-14T01:18:30.881ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41392024-12-14T01:18:30.881ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
41402024-12-14T01:18:30.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41412024-12-14T01:18:30.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
41422024-12-14T01:18:30.881ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41432024-12-14T01:18:30.882ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
41442024-12-14T01:18:30.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
41452024-12-14T01:18:30.882ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-7e423e95-464a-471f-a0d9-4799977f0b0f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-7e423e95-464a-471f-a0d9-4799977f0b0f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1673, tv_nsec: 711975661 } })
41462024-12-14T01:18:30.883ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
41472024-12-14T01:18:30.883ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
41482024-12-14T01:18:30.883ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
41492024-12-14T01:18:30.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
41502024-12-14T01:18:30.885ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41512024-12-14T01:18:30.885ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41522024-12-14T01:18:30.887ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
41532024-12-14T01:18:30.887ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
41542024-12-14T01:18:30.887ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
41552024-12-14T01:18:30.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
41562024-12-14T01:18:30.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
41572024-12-14T01:18:30.887ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41582024-12-14T01:18:30.888ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
41592024-12-14T01:18:30.888ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
41602024-12-14T01:18:30.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
41612024-12-14T01:18:30.889ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41622024-12-14T01:18:30.892ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
41632024-12-14T01:18:30.892ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
41642024-12-14T01:18:30.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
41652024-12-14T01:18:30.892ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
41662024-12-14T01:18:30.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
41672024-12-14T01:18:30.893ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
41682024-12-14T01:18:30.893ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
41692024-12-14T01:18:30.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
41702024-12-14T01:18:30.894ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41712024-12-14T01:18:30.896ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-14 01:08:30.873980899 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
41722024-12-14T01:18:30.896ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 22.08884ms iteration = 16 status = {"expiration":"2024-12-14T01:08:30.873980899Z","pruned":[]}
41732024-12-14T01:18:30.896ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
41742024-12-14T01:18:30.896ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
41752024-12-14T01:18:30.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
41762024-12-14T01:18:30.901ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41772024-12-14T01:18:30.902ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 28.233548ms iteration = 31 status = {"errors":[],"records_set_to_done":[]}
41782024-12-14T01:18:30.904ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
41792024-12-14T01:18:30.905ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
41802024-12-14T01:18:30.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
41812024-12-14T01:18:30.906ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41822024-12-14T01:18:30.907ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41832024-12-14T01:18:30.907ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
41842024-12-14T01:18:30.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41852024-12-14T01:18:30.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
41862024-12-14T01:18:30.908ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
41872024-12-14T01:18:30.908ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
41882024-12-14T01:18:30.908ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-7e423e95-464a-471f-a0d9-4799977f0b0f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-7e423e95-464a-471f-a0d9-4799977f0b0f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1673, tv_nsec: 737285013 } })
41892024-12-14T01:18:30.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
41902024-12-14T01:18:30.908ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41912024-12-14T01:18:30.908ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09
41922024-12-14T01:18:30.910ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
41932024-12-14T01:18:30.910ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
41942024-12-14T01:18:30.910ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41952024-12-14T01:18:30.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
41962024-12-14T01:18:30.911ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41972024-12-14T01:18:30.913ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
41982024-12-14T01:18:30.915ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
41992024-12-14T01:18:30.915ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
42002024-12-14T01:18:30.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
42012024-12-14T01:18:30.916ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
42022024-12-14T01:18:30.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
42032024-12-14T01:18:30.916ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
42042024-12-14T01:18:30.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
42052024-12-14T01:18:30.917ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 43.729785ms iteration = 31 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
42062024-12-14T01:18:30.918ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
42072024-12-14T01:18:30.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
42082024-12-14T01:18:30.919ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42092024-12-14T01:18:30.919ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
42102024-12-14T01:18:30.919ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
42112024-12-14T01:18:30.919ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
42122024-12-14T01:18:30.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
42132024-12-14T01:18:30.920ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
42142024-12-14T01:18:30.920ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
42152024-12-14T01:18:30.920ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
42162024-12-14T01:18:30.920ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
42172024-12-14T01:18:30.922ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8770bfcc-3a71-4738-a6b0-91008cadcb0f, lookup_type: ById(8770bfcc-3a71-4738-a6b0-91008cadcb0f) } result = Ok(())
42182024-12-14T01:18:30.922ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42192024-12-14T01:18:30.922ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42202024-12-14T01:18:30.923ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
42212024-12-14T01:18:30.923ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
42222024-12-14T01:18:30.923ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 49.579115ms iteration = 31 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
42232024-12-14T01:18:30.924ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
42242024-12-14T01:18:30.924ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42252024-12-14T01:18:30.925ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42262024-12-14T01:18:30.925ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 51.855961ms iteration = 31 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
42272024-12-14T01:18:30.927ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
42282024-12-14T01:18:30.927ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
42292024-12-14T01:18:30.928ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
42302024-12-14T01:18:30.928ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
42312024-12-14T01:18:30.928ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
42322024-12-14T01:18:30.928ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
42332024-12-14T01:18:30.928ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
42342024-12-14T01:18:30.928ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
42352024-12-14T01:18:30.929ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
42362024-12-14T01:18:30.929ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
42372024-12-14T01:18:30.931ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 57.521494ms iteration = 31 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
42382024-12-14T01:18:30.931ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 57.500975ms iteration = 91 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
42392024-12-14T01:18:30.932ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
42402024-12-14T01:18:30.932ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
42412024-12-14T01:18:30.932ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
42422024-12-14T01:18:30.932ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
42432024-12-14T01:18:30.932ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
42442024-12-14T01:18:30.932ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 58.578675ms iteration = 16 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
42452024-12-14T01:18:30.932ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
42462024-12-14T01:18:30.934ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42472024-12-14T01:18:30.934ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42482024-12-14T01:18:30.935ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 61.020616ms iteration = 31 status = {"errors":[],"garbage_collect_requested":[]}
42492024-12-14T01:18:30.936ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42502024-12-14T01:18:30.937ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
42512024-12-14T01:18:30.937ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
42522024-12-14T01:18:30.937ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
42532024-12-14T01:18:30.939ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
42542024-12-14T01:18:30.939ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
42552024-12-14T01:18:30.939ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
42562024-12-14T01:18:30.939ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
42572024-12-14T01:18:30.939ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
42582024-12-14T01:18:30.939ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8770bfcc-3a71-4738-a6b0-91008cadcb0f original_time_created = 2024-12-14 01:03:15.378067 UTC target_id = 8770bfcc-3a71-4738-a6b0-91008cadcb0f time_created = 2024-12-14 01:03:15.378067 UTC
42592024-12-14T01:18:30.939ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 65.531937ms iteration = 91 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8770bfcc-3a71-4738-a6b0-91008cadcb0f","time_created":"2024-12-14T01:03:15.378067Z"}
42602024-12-14T01:18:30.939ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
42612024-12-14T01:18:30.941ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
42622024-12-14T01:18:30.941ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
42632024-12-14T01:18:30.941ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 67.581496ms iteration = 7 status = {"nsuccess":5}
42642024-12-14T01:18:30.942ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
42652024-12-14T01:18:30.942ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
42662024-12-14T01:18:30.943ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42672024-12-14T01:18:30.945ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
42682024-12-14T01:18:30.945ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
42692024-12-14T01:18:30.945ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
42702024-12-14T01:18:30.945ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
42712024-12-14T01:18:30.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
42722024-12-14T01:18:30.947ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42732024-12-14T01:18:30.949ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
42742024-12-14T01:18:30.949ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
42752024-12-14T01:18:30.949ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
42762024-12-14T01:18:30.949ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
42772024-12-14T01:18:30.949ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
42782024-12-14T01:18:30.950ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
42792024-12-14T01:18:30.950ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
42802024-12-14T01:18:30.950ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
42812024-12-14T01:18:30.950ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
42822024-12-14T01:18:30.950ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
42832024-12-14T01:18:30.950ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
42842024-12-14T01:18:30.950ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
42852024-12-14T01:18:30.951ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
42862024-12-14T01:18:30.953ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
42872024-12-14T01:18:30.953ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42882024-12-14T01:18:30.953ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
42892024-12-14T01:18:30.953ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
42902024-12-14T01:18:30.953ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 79.635424ms iteration = 16 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
42912024-12-14T01:18:30.953ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
42922024-12-14T01:18:30.954ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
42932024-12-14T01:18:30.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
42942024-12-14T01:18:30.957ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
42952024-12-14T01:18:30.957ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
42962024-12-14T01:18:30.958ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
42972024-12-14T01:18:30.962ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42982024-12-14T01:18:30.963ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
42992024-12-14T01:18:30.963ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
43002024-12-14T01:18:30.963ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
43012024-12-14T01:18:30.963ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
43022024-12-14T01:18:30.965ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
43032024-12-14T01:18:30.965ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
43042024-12-14T01:18:30.965ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 7e423e95-464a-471f-a0d9-4799977f0b0f, lookup_type: ById(7e423e95-464a-471f-a0d9-4799977f0b0f) } result = Ok(())
43052024-12-14T01:18:30.965ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
43062024-12-14T01:18:30.965ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
43072024-12-14T01:18:30.972ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
43082024-12-14T01:18:30.972ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
43092024-12-14T01:18:30.973ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
43102024-12-14T01:18:30.973ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
43112024-12-14T01:18:30.973ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
43122024-12-14T01:18:30.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
43132024-12-14T01:18:30.974ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
43142024-12-14T01:18:30.975ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
43152024-12-14T01:18:30.975ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 101.266361ms iteration = 31 status = 0
43162024-12-14T01:18:30.976ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
43172024-12-14T01:18:30.977ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
43182024-12-14T01:18:30.978ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43192024-12-14T01:18:30.984ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-14T01:03:19.260831Z, time_modified: 2024-12-14T01:03:19.260831Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, db_silo: Silo { identity: SiloIdentity { id: 2c668072-a9a1-4a69-928c-e118c99521be, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-14T01:03:52.950638Z, time_modified: 2024-12-14T01:03:52.950638Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "ad8fd43e0fc4f6284dc5e0b0d0f2e6a6e8d979d13f86a71c9b81d6817e439efd" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 2c668072-a9a1-4a69-928c-e118c99521be, db_silo: Silo { identity: SiloIdentity { id: 2c668072-a9a1-4a69-928c-e118c99521be, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-14T01:03:52.950638Z, time_modified: 2024-12-14T01:03:52.950638Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "ad8fd43e0fc4f6284dc5e0b0d0f2e6a6e8d979d13f86a71c9b81d6817e439efd" }] }) }
43202024-12-14T01:18:30.984ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 109.963752ms iteration = 16 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"2c668072-a9a1-4a69-928c-e118c99521be","tls_certs":["ad8fd43e0fc4f6284dc5e0b0d0f2e6a6e8d979d13f86a71c9b81d6817e439efd"]}},"default_endpoint":{"silo_id":"2c668072-a9a1-4a69-928c-e118c99521be","tls_certs":["ad8fd43e0fc4f6284dc5e0b0d0f2e6a6e8d979d13f86a71c9b81d6817e439efd"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
43212024-12-14T01:18:30.984ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
43222024-12-14T01:18:30.984ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
43232024-12-14T01:18:30.984ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
43242024-12-14T01:18:30.986ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
43252024-12-14T01:18:30.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
43262024-12-14T01:18:30.989ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
43272024-12-14T01:18:30.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
43282024-12-14T01:18:30.991ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
43292024-12-14T01:18:30.991ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = d9c36d0c-d7d2-439f-a748-798b6d8dea0c dns_zone_name = oxide.test found_so_far = 0 version = 2
43302024-12-14T01:18:30.991ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
43312024-12-14T01:18:30.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
43322024-12-14T01:18:30.991ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
43332024-12-14T01:18:30.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
43342024-12-14T01:18:30.994ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
43352024-12-14T01:18:30.994ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
43362024-12-14T01:18:30.995ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
43372024-12-14T01:18:30.996ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
43382024-12-14T01:18:30.997ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
43392024-12-14T01:18:30.997ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
43402024-12-14T01:18:30.999ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43412024-12-14T01:18:31.003ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
43422024-12-14T01:18:31.003ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
43432024-12-14T01:18:31.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
43442024-12-14T01:18:31.004ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
43452024-12-14T01:18:31.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
43462024-12-14T01:18:31.005ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
43472024-12-14T01:18:31.005ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 866c9448-c447-4b92-96b6-611d51967e09 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
43482024-12-14T01:18:31.005ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
43492024-12-14T01:18:31.006ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
43502024-12-14T01:18:31.006ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
43512024-12-14T01:18:31.006ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
43522024-12-14T01:18:31.007ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43532024-12-14T01:18:31.010ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
43542024-12-14T01:18:31.010ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
43552024-12-14T01:18:31.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
43562024-12-14T01:18:31.012ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 866c9448-c447-4b92-96b6-611d51967e09 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
43572024-12-14T01:18:31.012ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
43582024-12-14T01:18:31.012ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-14 01:03:51.993091 UTC dns_group = internal generation = 1
43592024-12-14T01:18:31.012ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 138.587381ms iteration = 16 status = {"generation":1}
43602024-12-14T01:18:31.013ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
43612024-12-14T01:18:31.013ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
43622024-12-14T01:18:31.013ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 139.407664ms iteration = 31 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
43632024-12-14T01:18:31.021ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43642024-12-14T01:18:31.024ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
43652024-12-14T01:18:31.024ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
43662024-12-14T01:18:31.024ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
43672024-12-14T01:18:31.025ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
43682024-12-14T01:18:31.025ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
43692024-12-14T01:18:31.025ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ab2b20b3-59a6-4e13-a30e-85228eb0c72b", "content-length": "26", "date": "Sat, 14 Dec 2024 01:18:31 GMT"} })
43702024-12-14T01:18:31.025ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
43712024-12-14T01:18:31.026ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = d9c36d0c-d7d2-439f-a748-798b6d8dea0c dns_zone_name = oxide.test found_so_far = 1 version = 2
43722024-12-14T01:18:31.026ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
43732024-12-14T01:18:31.026ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-14 01:03:53.017536 UTC dns_group = external generation = 2
43742024-12-14T01:18:31.026ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 152.41815ms iteration = 16 status = {"generation":2}
43752024-12-14T01:18:31.027ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
43762024-12-14T01:18:31.028ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
43772024-12-14T01:18:31.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
43782024-12-14T01:18:31.030ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43792024-12-14T01:18:31.032ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
43802024-12-14T01:18:31.032ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
43812024-12-14T01:18:31.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
43822024-12-14T01:18:31.033ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43832024-12-14T01:18:31.035ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43842024-12-14T01:18:31.035ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
43852024-12-14T01:18:31.035ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
43862024-12-14T01:18:31.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
43872024-12-14T01:18:31.038ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 164.377517ms iteration = 33 status = {"physical_disks_added":0}
43882024-12-14T01:18:31.039ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
43892024-12-14T01:18:31.039ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
43902024-12-14T01:18:31.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
43912024-12-14T01:18:31.043ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
43922024-12-14T01:18:31.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
43932024-12-14T01:18:31.045ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
43942024-12-14T01:18:31.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
43952024-12-14T01:18:31.047ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
43962024-12-14T01:18:31.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
43972024-12-14T01:18:31.049ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
43982024-12-14T01:18:31.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
43992024-12-14T01:18:31.050ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
44002024-12-14T01:18:31.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
44012024-12-14T01:18:31.054ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
44022024-12-14T01:18:31.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
44032024-12-14T01:18:31.057ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
44042024-12-14T01:18:31.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
44052024-12-14T01:18:31.059ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44062024-12-14T01:18:31.064ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
44072024-12-14T01:18:31.064ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
44082024-12-14T01:18:31.064ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
44092024-12-14T01:18:31.069ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
44102024-12-14T01:18:31.069ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 194.980782ms iteration = 16 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
44112024-12-14T01:18:31.071ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
44122024-12-14T01:18:31.071ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
44132024-12-14T01:18:31.071ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "19f39f0f-fb5b-4212-8523-a950bbaa5d8f", "content-length": "26", "date": "Sat, 14 Dec 2024 01:18:31 GMT"} })
44142024-12-14T01:18:31.071ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
44152024-12-14T01:18:31.073ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
44162024-12-14T01:18:31.078ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 zone_address = fd00:1122:3344:101::2
44172024-12-14T01:18:31.078ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
44182024-12-14T01:18:31.078ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e8133583-3f3d-4d63-bc3e-6460946d44a9", "content-length": "26", "date": "Sat, 14 Dec 2024 01:18:31 GMT"} })
44192024-12-14T01:18:31.078ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
44202024-12-14T01:18:31.080ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09
44212024-12-14T01:18:31.092ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
44222024-12-14T01:18:31.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
44232024-12-14T01:18:31.093ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
44242024-12-14T01:18:31.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
44252024-12-14T01:18:31.095ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44262024-12-14T01:18:31.098ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
44272024-12-14T01:18:31.098ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
44282024-12-14T01:18:31.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
44292024-12-14T01:18:31.131ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
44302024-12-14T01:18:31.157ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
44312024-12-14T01:18:31.212ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 338.248899ms iteration = 31 status = {}
44322024-12-14T01:18:31.247ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
44332024-12-14T01:18:31.247ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "c608d3e2-ca12-4288-a6e4-a58f3fa5bbdb", "content-length": "2", "date": "Sat, 14 Dec 2024 01:18:31 GMT"} })
44342024-12-14T01:18:31.249ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
44352024-12-14T01:18:31.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
44362024-12-14T01:18:31.270ZDEBGnexus (BackgroundTasks): client request SledAgent = 7e423e95-464a-471f-a0d9-4799977f0b0f background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
44372024-12-14T01:18:31.271ZDEBGnexus (BackgroundTasks): client response SledAgent = 7e423e95-464a-471f-a0d9-4799977f0b0f background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "4e82a4f3-0a2a-4b37-9504-c143d7c72dac", "content-length": "691", "date": "Sat, 14 Dec 2024 01:18:31 GMT"} })
44382024-12-14T01:18:31.271ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
44392024-12-14T01:18:31.271ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
44402024-12-14T01:18:31.271ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
44412024-12-14T01:18:31.272ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 398.513502ms iteration = 33 status = {}
44422024-12-14T01:18:31.273ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 399.312816ms iteration = 31 status = null
44432024-12-14T01:18:31.276ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("external-dns"): [NetworkInterface { id: 3835d729-f242-4499-8923-c91ffb2ad191, kind: Service { id: 795aee12-3394-49fa-9cb5-487c97a85b2d }, name: Name("external-dns-795aee12-3394-49fa-9cb5-487c97a85b2d"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 211, 244])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b8823ae3-8d3f-4e91-8974-20b2215f5f6a, kind: Service { id: 381b8112-f609-4c4d-ac80-0170ad8fc4bd }, name: Name("external-dns-381b8112-f609-4c4d-ac80-0170ad8fc4bd"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 145, 84])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("nexus"): [NetworkInterface { id: 9d7ba901-6721-4901-9614-31b446ae9f92, kind: Service { id: 499bc009-7d23-4916-9be8-0a6a8f4e2f93 }, name: Name("nexus-499bc009-7d23-4916-9be8-0a6a8f4e2f93"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 204, 17])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b14a1598-4e88-4af1-a9ee-2ce6011bef09, kind: Service { id: 52e7031c-459b-4f41-8b32-1e60c10ae128 }, name: Name("nexus-52e7031c-459b-4f41-8b32-1e60c10ae128"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 199, 161])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e5efd450-c262-4b61-8535-5d0721452011, kind: Service { id: ec66f35d-9dc5-46c1-80a1-ebaa91a8212a }, name: Name("nexus-ec66f35d-9dc5-46c1-80a1-ebaa91a8212a"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 209, 118])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })], Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })]} vpc_interfaces = {}
44442024-12-14T01:18:31.276ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
44452024-12-14T01:18:31.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
44462024-12-14T01:18:31.277ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44472024-12-14T01:18:31.279ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
44482024-12-14T01:18:31.279ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
44492024-12-14T01:18:31.279ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
44502024-12-14T01:18:31.281ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
44512024-12-14T01:18:31.281ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 3835d729-f242-4499-8923-c91ffb2ad191, kind: Service { id: 795aee12-3394-49fa-9cb5-487c97a85b2d }, name: Name("external-dns-795aee12-3394-49fa-9cb5-487c97a85b2d"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 211, 244])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b8823ae3-8d3f-4e91-8974-20b2215f5f6a, kind: Service { id: 381b8112-f609-4c4d-ac80-0170ad8fc4bd }, name: Name("external-dns-381b8112-f609-4c4d-ac80-0170ad8fc4bd"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 145, 84])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 9d7ba901-6721-4901-9614-31b446ae9f92, kind: Service { id: 499bc009-7d23-4916-9be8-0a6a8f4e2f93 }, name: Name("nexus-499bc009-7d23-4916-9be8-0a6a8f4e2f93"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 204, 17])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b14a1598-4e88-4af1-a9ee-2ce6011bef09, kind: Service { id: 52e7031c-459b-4f41-8b32-1e60c10ae128 }, name: Name("nexus-52e7031c-459b-4f41-8b32-1e60c10ae128"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 199, 161])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e5efd450-c262-4b61-8535-5d0721452011, kind: Service { id: ec66f35d-9dc5-46c1-80a1-ebaa91a8212a }, name: Name("nexus-ec66f35d-9dc5-46c1-80a1-ebaa91a8212a"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 209, 118])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
44522024-12-14T01:18:31.281ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
44532024-12-14T01:18:31.329ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: 7e423e95-464a-471f-a0d9-4799977f0b0f, time_created: 2024-12-14T01:03:50.654151Z, time_modified: 2024-12-14T01:03:50.654151Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: f30fd360-30ae-4088-9821-aa98c2bc8c09, is_scrimlet: true, serial_number: "buskin", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::1:0, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
44542024-12-14T01:18:31.329ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
44552024-12-14T01:18:31.329ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
44562024-12-14T01:18:31.330ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
44572024-12-14T01:18:31.332ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
44582024-12-14T01:18:31.332ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
44592024-12-14T01:18:31.333ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44602024-12-14T01:18:31.336ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: 7e423e95-464a-471f-a0d9-4799977f0b0f, lookup_type: ById(7e423e95-464a-471f-a0d9-4799977f0b0f) } result = Ok(())
44612024-12-14T01:18:31.375ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
44622024-12-14T01:18:31.375ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "e74c3e21-3f24-473f-8fca-8b7fbdbfabda", "date": "Sat, 14 Dec 2024 01:18:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
44632024-12-14T01:18:31.375ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
44642024-12-14T01:18:31.377ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "7b54e1f3-4b7f-4b96-afaa-dc2a8bdb4a41", "date": "Sat, 14 Dec 2024 01:18:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
44652024-12-14T01:18:31.377ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
44662024-12-14T01:18:31.378ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
44672024-12-14T01:18:31.378ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 504.903471ms iteration = 18 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
44682024-12-14T01:18:31.388ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
44692024-12-14T01:18:31.423ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = 7e423e95-464a-471f-a0d9-4799977f0b0f background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
44702024-12-14T01:18:31.424ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = 7e423e95-464a-471f-a0d9-4799977f0b0f background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "8207e045-ae07-4897-888b-dbc9a4c90d4f", "date": "Sat, 14 Dec 2024 01:18:31 GMT"} })
44712024-12-14T01:18:31.425ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
44722024-12-14T01:18:31.425ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 551.51197ms
44732024-12-14T01:18:31.425ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 551.521951ms iteration = 4 status = {}
44742024-12-14T01:18:31.438ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44752024-12-14T01:18:31.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44762024-12-14T01:18:31.440ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: bb1a4b50-730e-48ee-a311-8a9b9d7bcb73, rack_id: f30fd360-30ae-4088-9821-aa98c2bc8c09, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(bb9f5a1a-5708-4d58-ba4f-c62102236426) } rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 switch_location = Switch0
44772024-12-14T01:18:31.440ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44782024-12-14T01:18:31.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44792024-12-14T01:18:31.448ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
44802024-12-14T01:18:31.449ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "92a0fdbf-dbff-4222-b880-d70a7ec6b9af", "date": "Sat, 14 Dec 2024 01:18:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
44812024-12-14T01:18:31.449ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
44822024-12-14T01:18:31.449ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
44832024-12-14T01:18:31.450ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "3461fe32-7c65-4931-8191-09b770f37718", "content-length": "134", "date": "Sat, 14 Dec 2024 01:18:31 GMT"} })
44842024-12-14T01:18:31.450ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
44852024-12-14T01:18:31.450ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = bb9f5a1a-5708-4d58-ba4f-c62102236426
44862024-12-14T01:18:31.450ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
44872024-12-14T01:18:31.450ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
44882024-12-14T01:18:31.450ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
44892024-12-14T01:18:31.450ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
44902024-12-14T01:18:31.450ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
44912024-12-14T01:18:31.450ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
44922024-12-14T01:18:31.450ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
44932024-12-14T01:18:31.450ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
44942024-12-14T01:18:31.450ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "90b9d1b2-1e28-4c60-8c61-f16b7ec7306d", "date": "Sat, 14 Dec 2024 01:18:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
44952024-12-14T01:18:31.450ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
44962024-12-14T01:18:31.450ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09
44972024-12-14T01:18:31.450ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44982024-12-14T01:18:31.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44992024-12-14T01:18:31.452ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "905184ae-0eb0-4714-99de-9bc656b793af", "date": "Sat, 14 Dec 2024 01:18:31 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
45002024-12-14T01:18:31.452ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
45012024-12-14T01:18:31.452ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
45022024-12-14T01:18:31.452ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "ff82f61e-2169-4d00-ac1d-205ded226c3e", "content-length": "2", "date": "Sat, 14 Dec 2024 01:18:31 GMT"} })
45032024-12-14T01:18:31.452ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
45042024-12-14T01:18:31.453ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "745be444-3859-4175-acbf-5b5a7dc4bd91", "content-length": "52", "date": "Sat, 14 Dec 2024 01:18:31 GMT"} })
45052024-12-14T01:18:31.453ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 switch_location = Switch0
45062024-12-14T01:18:31.453ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
45072024-12-14T01:18:31.454ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
45082024-12-14T01:18:31.454ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 580.330154ms iteration = 18 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
45092024-12-14T01:18:31.548ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "26667adf-a2a7-495a-af56-539ae8eb0969", "date": "Sat, 14 Dec 2024 01:18:31 GMT"} })
45102024-12-14T01:18:31.548ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 switch = Switch0
45112024-12-14T01:18:31.548ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
45122024-12-14T01:18:31.548ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f30fd360-30ae-4088-9821-aa98c2bc8c09 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "a70e4af6-7b87-4828-b36f-261596530fd6", "content-length": "682", "date": "Sat, 14 Dec 2024 01:18:31 GMT"} })
45132024-12-14T01:18:31.548ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45142024-12-14T01:18:31.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45152024-12-14T01:18:31.552ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45162024-12-14T01:18:31.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45172024-12-14T01:18:31.556ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45182024-12-14T01:18:31.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45192024-12-14T01:18:31.558ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45202024-12-14T01:18:31.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45212024-12-14T01:18:31.566ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 692.315955ms iteration = 31 status = {}
45222024-12-14T01:18:33.461ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1572 local_addr = [fd00:1122:3344:101::a]:59823 method = GET remote_addr = [fd00:1122:3344:101::d]:36065 req_id = 5da9f086-36b6-4efe-8953-7186c65679c9 response_code = 200 uri = /ec66f35d-9dc5-46c1-80a1-ebaa91a8212a
45232024-12-14T01:18:37.182ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 34 reason = Timeout
45242024-12-14T01:18:37.182ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
45252024-12-14T01:18:37.182ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45262024-12-14T01:18:37.182ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45272024-12-14T01:18:37.184ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45282024-12-14T01:18:37.186ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
45292024-12-14T01:18:37.186ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45302024-12-14T01:18:37.186ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45312024-12-14T01:18:37.188ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45322024-12-14T01:18:37.190ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
45332024-12-14T01:18:37.190ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45342024-12-14T01:18:37.190ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45352024-12-14T01:18:37.222ZINFOnexus (BackgroundTasks): VPC route manager sled 7e423e95-464a-471f-a0d9-4799977f0b0f background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
45362024-12-14T01:18:37.222ZDEBGnexus (BackgroundTasks): client request SledAgent = 7e423e95-464a-471f-a0d9-4799977f0b0f background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
45372024-12-14T01:18:37.223ZDEBGnexus (BackgroundTasks): client response SledAgent = 7e423e95-464a-471f-a0d9-4799977f0b0f background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "53feb5ec-142b-49d1-b455-66887996300d", "content-length": "372", "date": "Sat, 14 Dec 2024 01:18:37 GMT"} })
45382024-12-14T01:18:37.223ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45392024-12-14T01:18:37.223ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45402024-12-14T01:18:37.263ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
45412024-12-14T01:18:37.263ZDEBGnexus (BackgroundTasks): client request SledAgent = 7e423e95-464a-471f-a0d9-4799977f0b0f background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
45422024-12-14T01:18:37.263ZDEBGnexus (BackgroundTasks): client response SledAgent = 7e423e95-464a-471f-a0d9-4799977f0b0f background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "2e67a44e-8fe5-4f13-bc4e-ec2af14f8707", "date": "Sat, 14 Dec 2024 01:18:37 GMT"} })
45432024-12-14T01:18:37.263ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45442024-12-14T01:18:37.263ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45452024-12-14T01:18:37.266ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45462024-12-14T01:18:37.266ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45472024-12-14T01:18:37.268ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45482024-12-14T01:18:37.269ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45492024-12-14T01:18:37.272ZINFOnexus (BackgroundTasks): VPC route manager sled 7e423e95-464a-471f-a0d9-4799977f0b0f push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
45502024-12-14T01:18:37.272ZDEBGnexus (BackgroundTasks): client request SledAgent = 7e423e95-464a-471f-a0d9-4799977f0b0f background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
45512024-12-14T01:18:37.272ZDEBGnexus (BackgroundTasks): client response SledAgent = 7e423e95-464a-471f-a0d9-4799977f0b0f background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "86cd8bb2-184c-4970-abad-6c0cec472c42", "date": "Sat, 14 Dec 2024 01:18:37 GMT"} })
45522024-12-14T01:18:37.274ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 91.995792ms iteration = 34 status = {}
45532024-12-14T01:18:40.873ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 92 reason = Timeout
45542024-12-14T01:18:40.873ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 92 reason = Timeout
45552024-12-14T01:18:40.873ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
45562024-12-14T01:18:40.873ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45572024-12-14T01:18:40.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
45582024-12-14T01:18:40.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45592024-12-14T01:18:40.875ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45602024-12-14T01:18:40.878ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
45612024-12-14T01:18:40.878ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45622024-12-14T01:18:40.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45632024-12-14T01:18:40.879ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45642024-12-14T01:18:40.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45652024-12-14T01:18:40.881ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45662024-12-14T01:18:40.883ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 8770bfcc-3a71-4738-a6b0-91008cadcb0f, lookup_type: ById(8770bfcc-3a71-4738-a6b0-91008cadcb0f) } result = Ok(())
45672024-12-14T01:18:40.883ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45682024-12-14T01:18:40.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45692024-12-14T01:18:40.895ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 8770bfcc-3a71-4738-a6b0-91008cadcb0f original_time_created = 2024-12-14 01:03:15.378067 UTC target_id = 8770bfcc-3a71-4738-a6b0-91008cadcb0f time_created = 2024-12-14 01:03:15.378067 UTC
45702024-12-14T01:18:40.895ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.079739ms iteration = 92 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"8770bfcc-3a71-4738-a6b0-91008cadcb0f","time_created":"2024-12-14T01:03:15.378067Z"}
45712024-12-14T01:18:40.902ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
45722024-12-14T01:18:40.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
45732024-12-14T01:18:40.903ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.429291ms iteration = 92 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
45742024-12-14T01:18:43.461ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1652 local_addr = [fd00:1122:3344:101::a]:59823 method = GET remote_addr = [fd00:1122:3344:101::d]:36065 req_id = 93fe051e-2475-48a4-ae53-ac9dd305ff43 response_code = 200 uri = /ec66f35d-9dc5-46c1-80a1-ebaa91a8212a