Max level shown:
12024-07-06T00:15:00.665ZDEBGnexus: attempted to write instance state from sled agent instance_id = 415a700f-113f-4ad3-9802-e6737b3e2041 propolis_id = 7243498a-d18c-4720-aa3a-10d138309072 result = Ok(InstanceUpdateResult { instance_updated: false, vmm_updated: true, migration_updated: None })
22024-07-06T00:15:00.667ZDEBGnexus (dropshot_external): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.2.100:49064 req_id = 6b044c2b-8426-4cc3-8a78-6e32f0ac6b6f roles = RoleSet { roles: {} } uri = /v1/instances/instance-2d04248594e/stop?project=proj-d35d69fc246
32024-07-06T00:15:00.667ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.2.100:49064 req_id = 6b044c2b-8426-4cc3-8a78-6e32f0ac6b6f resource = Database result = Ok(()) uri = /v1/instances/instance-2d04248594e/stop?project=proj-d35d69fc246
42024-07-06T00:15:00.670ZDEBGnexus (dropshot_external): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.2.100:49064 req_id = 6b044c2b-8426-4cc3-8a78-6e32f0ac6b6f roles = RoleSet { roles: {} } uri = /v1/instances/instance-2d04248594e/stop?project=proj-d35d69fc246
52024-07-06T00:15:00.670ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.2.100:49064 req_id = 6b044c2b-8426-4cc3-8a78-6e32f0ac6b6f resource = Database result = Ok(()) uri = /v1/instances/instance-2d04248594e/stop?project=proj-d35d69fc246
62024-07-06T00:15:00.673ZDEBGnexus (dropshot_external): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.2.100:49064 req_id = 6b044c2b-8426-4cc3-8a78-6e32f0ac6b6f roles = RoleSet { roles: {} } uri = /v1/instances/instance-2d04248594e/stop?project=proj-d35d69fc246
72024-07-06T00:15:00.673ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.2.100:49064 req_id = 6b044c2b-8426-4cc3-8a78-6e32f0ac6b6f resource = Database result = Ok(()) uri = /v1/instances/instance-2d04248594e/stop?project=proj-d35d69fc246
82024-07-06T00:15:00.676ZDEBGnexus (dropshot_external): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.2.100:49064 req_id = 6b044c2b-8426-4cc3-8a78-6e32f0ac6b6f roles = RoleSet { roles: {} } uri = /v1/instances/instance-2d04248594e/stop?project=proj-d35d69fc246
92024-07-06T00:15:00.676ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.2.100:49064 req_id = 6b044c2b-8426-4cc3-8a78-6e32f0ac6b6f resource = Database result = Ok(()) uri = /v1/instances/instance-2d04248594e/stop?project=proj-d35d69fc246
102024-07-06T00:15:00.679ZDEBGnexus (dropshot_external): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.2.100:49064 req_id = 6b044c2b-8426-4cc3-8a78-6e32f0ac6b6f roles = RoleSet { roles: {(Silo, ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, "admin")} } uri = /v1/instances/instance-2d04248594e/stop?project=proj-d35d69fc246
112024-07-06T00:15:00.682ZDEBGnexus (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.2.100:49064 req_id = 6b044c2b-8426-4cc3-8a78-6e32f0ac6b6f resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, lookup_type: ById(ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c) }, key: aac9ad5c-0170-42a6-930f-2f05e44928f2, lookup_type: ByName("proj-d35d69fc246") }, key: 415a700f-113f-4ad3-9802-e6737b3e2041, lookup_type: ByName("instance-2d04248594e") } result = Ok(()) uri = /v1/instances/instance-2d04248594e/stop?project=proj-d35d69fc246
122024-07-06T00:15:00.682ZDEBGnexus (dropshot_external): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.2.100:49064 req_id = 6b044c2b-8426-4cc3-8a78-6e32f0ac6b6f roles = RoleSet { roles: {} } uri = /v1/instances/instance-2d04248594e/stop?project=proj-d35d69fc246
132024-07-06T00:15:00.682ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.2.100:49064 req_id = 6b044c2b-8426-4cc3-8a78-6e32f0ac6b6f resource = Database result = Ok(()) uri = /v1/instances/instance-2d04248594e/stop?project=proj-d35d69fc246
142024-07-06T00:15:00.685ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/6a3f84c/dropshot/src/server.rs:878 latency_us = 198232 local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.2.100:49064 req_id = 6b044c2b-8426-4cc3-8a78-6e32f0ac6b6f response_code = 202 uri = /v1/instances/instance-2d04248594e/stop?project=proj-d35d69fc246
152024-07-06T00:15:00.686ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
162024-07-06T00:15:00.687ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
172024-07-06T00:15:00.688ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
182024-07-06T00:15:00.688ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
192024-07-06T00:15:00.690ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
202024-07-06T00:15:00.691ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "871c52af06a2f4799eefbb9da74e17d3a62de46e", lookup_type: ByCompositeId("token = \\"871c52af06a2f4799eefbb9da74e17d3a62de46e\\"") } result = Ok(())
212024-07-06T00:15:00.691ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
222024-07-06T00:15:00.691ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
232024-07-06T00:15:00.692ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
242024-07-06T00:15:00.692ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
252024-07-06T00:15:00.694ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
262024-07-06T00:15:00.694ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
272024-07-06T00:15:00.695ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
282024-07-06T00:15:00.695ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
292024-07-06T00:15:00.697ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
302024-07-06T00:15:00.698ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, lookup_type: ById(ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c) }, key: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, lookup_type: ById(49d08b27-316b-4c97-97fd-dd3a8bf02b58) } result = Ok(())
312024-07-06T00:15:00.698ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
322024-07-06T00:15:00.698ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
332024-07-06T00:15:00.699ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
342024-07-06T00:15:00.700ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "871c52af06a2f4799eefbb9da74e17d3a62de46e", lookup_type: ByCompositeId("871c52af06a2f4799eefbb9da74e17d3a62de46e") } result = Ok(())
352024-07-06T00:15:00.700ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
362024-07-06T00:15:00.700ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
372024-07-06T00:15:00.709ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
382024-07-06T00:15:00.709ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
392024-07-06T00:15:00.710ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
402024-07-06T00:15:00.710ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
412024-07-06T00:15:00.712ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
422024-07-06T00:15:00.712ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
432024-07-06T00:15:00.713ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
442024-07-06T00:15:00.713ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
452024-07-06T00:15:00.714ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
462024-07-06T00:15:00.716ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, lookup_type: ById(ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c) }, key: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, lookup_type: ById(49d08b27-316b-4c97-97fd-dd3a8bf02b58) } result = Ok(())
472024-07-06T00:15:00.716ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
482024-07-06T00:15:00.716ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
492024-07-06T00:15:00.717ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
502024-07-06T00:15:00.717ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
512024-07-06T00:15:00.718ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
522024-07-06T00:15:00.719ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
532024-07-06T00:15:00.720ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
542024-07-06T00:15:00.721ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, lookup_type: ById(ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c) } result = Ok(())
552024-07-06T00:15:00.721ZDEBGnexus (dropshot_external): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 86a36498-a7b3-4b1f-b6be-ffc513939462 roles = RoleSet { roles: {} } uri = /v1/instances/instance-2d04248594e?project=proj-d35d69fc246
562024-07-06T00:15:00.721ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 86a36498-a7b3-4b1f-b6be-ffc513939462 resource = Database result = Ok(()) uri = /v1/instances/instance-2d04248594e?project=proj-d35d69fc246
572024-07-06T00:15:00.722ZDEBGnexus (dropshot_external): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 86a36498-a7b3-4b1f-b6be-ffc513939462 roles = RoleSet { roles: {} } uri = /v1/instances/instance-2d04248594e?project=proj-d35d69fc246
582024-07-06T00:15:00.723ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 86a36498-a7b3-4b1f-b6be-ffc513939462 resource = Database result = Ok(()) uri = /v1/instances/instance-2d04248594e?project=proj-d35d69fc246
592024-07-06T00:15:00.724ZDEBGnexus (dropshot_external): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 86a36498-a7b3-4b1f-b6be-ffc513939462 roles = RoleSet { roles: {} } uri = /v1/instances/instance-2d04248594e?project=proj-d35d69fc246
602024-07-06T00:15:00.725ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 86a36498-a7b3-4b1f-b6be-ffc513939462 resource = Database result = Ok(()) uri = /v1/instances/instance-2d04248594e?project=proj-d35d69fc246
612024-07-06T00:15:00.726ZDEBGnexus (dropshot_external): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 86a36498-a7b3-4b1f-b6be-ffc513939462 roles = RoleSet { roles: {} } uri = /v1/instances/instance-2d04248594e?project=proj-d35d69fc246
622024-07-06T00:15:00.726ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 86a36498-a7b3-4b1f-b6be-ffc513939462 resource = Database result = Ok(()) uri = /v1/instances/instance-2d04248594e?project=proj-d35d69fc246
632024-07-06T00:15:00.728ZDEBGnexus (dropshot_external): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 86a36498-a7b3-4b1f-b6be-ffc513939462 roles = RoleSet { roles: {} } uri = /v1/instances/instance-2d04248594e?project=proj-d35d69fc246
642024-07-06T00:15:00.729ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 86a36498-a7b3-4b1f-b6be-ffc513939462 resource = Database result = Ok(()) uri = /v1/instances/instance-2d04248594e?project=proj-d35d69fc246
652024-07-06T00:15:00.731ZDEBGnexus (dropshot_external): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 86a36498-a7b3-4b1f-b6be-ffc513939462 roles = RoleSet { roles: {} } uri = /v1/instances/instance-2d04248594e?project=proj-d35d69fc246
662024-07-06T00:15:00.731ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 86a36498-a7b3-4b1f-b6be-ffc513939462 resource = Database result = Ok(()) uri = /v1/instances/instance-2d04248594e?project=proj-d35d69fc246
672024-07-06T00:15:00.733ZDEBGnexus (dropshot_external): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 86a36498-a7b3-4b1f-b6be-ffc513939462 roles = RoleSet { roles: {} } uri = /v1/instances/instance-2d04248594e?project=proj-d35d69fc246
682024-07-06T00:15:00.734ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 86a36498-a7b3-4b1f-b6be-ffc513939462 resource = Database result = Ok(()) uri = /v1/instances/instance-2d04248594e?project=proj-d35d69fc246
692024-07-06T00:15:00.735ZDEBGnexus (dropshot_external): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 86a36498-a7b3-4b1f-b6be-ffc513939462 roles = RoleSet { roles: {(Silo, ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, "admin")} } uri = /v1/instances/instance-2d04248594e?project=proj-d35d69fc246
702024-07-06T00:15:00.738ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 86a36498-a7b3-4b1f-b6be-ffc513939462 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, lookup_type: ById(ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c) }, key: aac9ad5c-0170-42a6-930f-2f05e44928f2, lookup_type: ByName("proj-d35d69fc246") }, key: 415a700f-113f-4ad3-9802-e6737b3e2041, lookup_type: ByName("instance-2d04248594e") } result = Ok(()) uri = /v1/instances/instance-2d04248594e?project=proj-d35d69fc246
712024-07-06T00:15:00.738ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
722024-07-06T00:15:00.738ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
732024-07-06T00:15:00.739ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
742024-07-06T00:15:00.741ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Fleet result = Ok(())
752024-07-06T00:15:00.741ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
762024-07-06T00:15:00.741ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
772024-07-06T00:15:00.744ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:194 saga_id = 5497bed6-54a2-46cd-9758-7e799ead00c4 saga_name = instance-delete
782024-07-06T00:15:00.744ZINFOnexus (SEC): saga create dag = {"end_node":5,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[4,0,null],[3,5,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"instance_delete.instance_delete_nat","label":"InstanceDeleteNat","name":"no_result4"}},{"Action":{"action_name":"instance_delete.instance_delete_record","label":"InstanceDeleteRecord","name":"no_result1"}},{"Action":{"action_name":"instance_delete.delete_network_interfaces","label":"DeleteNetworkInterfaces","name":"no_result2"}},{"Action":{"action_name":"instance_delete.deallocate_external_ip","label":"DeallocateExternalIp","name":"no_result3"}},{"Start":{"params":{"authz_instance":{"key":"415a700f-113f-4ad3-9802-e6737b3e2041","lookup_type":{"ByName":"instance-2d04248594e"},"parent":{"key":"aac9ad5c-0170-42a6-930f-2f05e44928f2","lookup_type":{"ByName":"proj-d35d69fc246"},"parent":{"key":"ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c","lookup_type":{"ById":"ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c"},"parent":null}}},"boundary_switches":["switch0"],"instance":{"boot_on_fault":false,"hostname":"localshark","identity":{"description":"","id":"415a700f-113f-4ad3-9802-e6737b3e2041","name":"instance-2d04248594e","time_created":"2024-07-06T00:14:34.988987Z","time_deleted":null,"time_modified":"2024-07-06T00:14:34.988987Z"},"memory":1073741824,"ncpus":2,"project_id":"aac9ad5c-0170-42a6-930f-2f05e44928f2","runtime_state":{"dst_propolis_id":null,"gen":3,"migration_id":null,"nexus_state":"Vmm","propolis_id":"7243498a-d18c-4720-aa3a-10d138309072","time_updated":"2024-07-06T00:14:37.202713Z"},"updater_gen":1,"updater_id":null,"user_data":[]},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"SiloUser":{"silo_id":"ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c","silo_user_id":"49d08b27-316b-4c97-97fd-dd3a8bf02b58"}}},{"mapped_fleet_roles":{"admin":["admin"]}}]}}}}},"End"]},"saga_name":"instance-delete","start_node":4} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = 5497bed6-54a2-46cd-9758-7e799ead00c4 saga_name = instance-delete sec_id = 9ff5ab27-a3ab-4401-8a23-c0799de85f2f
792024-07-06T00:15:00.744ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:49 saga_id = 5497bed6-54a2-46cd-9758-7e799ead00c4 saga_name = instance-delete
802024-07-06T00:15:00.752ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:293 saga_id = 5497bed6-54a2-46cd-9758-7e799ead00c4 saga_name = instance-delete
812024-07-06T00:15:00.752ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = 5497bed6-54a2-46cd-9758-7e799ead00c4 saga_name = instance-delete sec_id = 9ff5ab27-a3ab-4401-8a23-c0799de85f2f
822024-07-06T00:15:00.752ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 9ff5ab27-a3ab-4401-8a23-c0799de85f2f
832024-07-06T00:15:00.752ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 5497bed6-54a2-46cd-9758-7e799ead00c4
842024-07-06T00:15:00.758ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 9ff5ab27-a3ab-4401-8a23-c0799de85f2f
852024-07-06T00:15:00.758ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = 5497bed6-54a2-46cd-9758-7e799ead00c4
862024-07-06T00:15:00.765ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 9ff5ab27-a3ab-4401-8a23-c0799de85f2f
872024-07-06T00:15:00.765ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 5497bed6-54a2-46cd-9758-7e799ead00c4
882024-07-06T00:15:00.769ZDEBGnexus (SagaExecutor): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true roles = RoleSet { roles: {} } saga_id = 5497bed6-54a2-46cd-9758-7e799ead00c4 saga_name = instance-delete saga_node = InstanceDeleteNat
892024-07-06T00:15:00.770ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true resource = Database result = Ok(()) saga_id = 5497bed6-54a2-46cd-9758-7e799ead00c4 saga_name = instance-delete saga_node = InstanceDeleteNat
902024-07-06T00:15:00.771ZDEBGnexus (SagaExecutor): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true roles = RoleSet { roles: {} } saga_id = 5497bed6-54a2-46cd-9758-7e799ead00c4 saga_name = instance-delete saga_node = InstanceDeleteNat
912024-07-06T00:15:00.771ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true resource = Database result = Ok(()) saga_id = 5497bed6-54a2-46cd-9758-7e799ead00c4 saga_name = instance-delete saga_node = InstanceDeleteNat
922024-07-06T00:15:00.772ZDEBGnexus (SagaExecutor): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true roles = RoleSet { roles: {} } saga_id = 5497bed6-54a2-46cd-9758-7e799ead00c4 saga_name = instance-delete saga_node = InstanceDeleteNat
932024-07-06T00:15:00.773ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true resource = Database result = Ok(()) saga_id = 5497bed6-54a2-46cd-9758-7e799ead00c4 saga_name = instance-delete saga_node = InstanceDeleteNat
942024-07-06T00:15:00.774ZDEBGnexus (SagaExecutor): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true roles = RoleSet { roles: {} } saga_id = 5497bed6-54a2-46cd-9758-7e799ead00c4 saga_name = instance-delete saga_node = InstanceDeleteNat
952024-07-06T00:15:00.774ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true resource = Database result = Ok(()) saga_id = 5497bed6-54a2-46cd-9758-7e799ead00c4 saga_name = instance-delete saga_node = InstanceDeleteNat
962024-07-06T00:15:00.776ZDEBGnexus (SagaExecutor): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true roles = RoleSet { roles: {} } saga_id = 5497bed6-54a2-46cd-9758-7e799ead00c4 saga_name = instance-delete saga_node = InstanceDeleteNat
972024-07-06T00:15:00.776ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true resource = Database result = Ok(()) saga_id = 5497bed6-54a2-46cd-9758-7e799ead00c4 saga_name = instance-delete saga_node = InstanceDeleteNat
982024-07-06T00:15:00.779ZDEBGnexus (SagaExecutor): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true roles = RoleSet { roles: {} } saga_id = 5497bed6-54a2-46cd-9758-7e799ead00c4 saga_name = instance-delete saga_node = InstanceDeleteNat
992024-07-06T00:15:00.779ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true resource = Database result = Ok(()) saga_id = 5497bed6-54a2-46cd-9758-7e799ead00c4 saga_name = instance-delete saga_node = InstanceDeleteNat
1002024-07-06T00:15:00.782ZDEBGnexus (SagaExecutor): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true roles = RoleSet { roles: {} } saga_id = 5497bed6-54a2-46cd-9758-7e799ead00c4 saga_name = instance-delete saga_node = InstanceDeleteNat
1012024-07-06T00:15:00.782ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true resource = Database result = Ok(()) saga_id = 5497bed6-54a2-46cd-9758-7e799ead00c4 saga_name = instance-delete saga_node = InstanceDeleteNat
1022024-07-06T00:15:00.784ZDEBGnexus (SagaExecutor): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true roles = RoleSet { roles: {(Silo, ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, "admin")} } saga_id = 5497bed6-54a2-46cd-9758-7e799ead00c4 saga_name = instance-delete saga_node = InstanceDeleteNat
1032024-07-06T00:15:00.787ZDEBGnexus (SagaExecutor): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, lookup_type: ById(ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c) }, key: aac9ad5c-0170-42a6-930f-2f05e44928f2, lookup_type: ById(aac9ad5c-0170-42a6-930f-2f05e44928f2) }, key: 415a700f-113f-4ad3-9802-e6737b3e2041, lookup_type: ById(415a700f-113f-4ad3-9802-e6737b3e2041) } result = Ok(()) saga_id = 5497bed6-54a2-46cd-9758-7e799ead00c4 saga_name = instance-delete saga_node = InstanceDeleteNat
1042024-07-06T00:15:00.787ZINFOnexus: deleting instance dpd configuration file = nexus/src/app/instance_network.rs:757 instance_id = 415a700f-113f-4ad3-9802-e6737b3e2041
1052024-07-06T00:15:00.787ZDEBGnexus (SagaExecutor): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true roles = RoleSet { roles: {} } saga_id = 5497bed6-54a2-46cd-9758-7e799ead00c4 saga_name = instance-delete saga_node = InstanceDeleteNat
1062024-07-06T00:15:00.787ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true resource = Database result = Ok(()) saga_id = 5497bed6-54a2-46cd-9758-7e799ead00c4 saga_name = instance-delete saga_node = InstanceDeleteNat
1072024-07-06T00:15:00.788ZDEBGnexus (SagaExecutor): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true roles = RoleSet { roles: {} } saga_id = 5497bed6-54a2-46cd-9758-7e799ead00c4 saga_name = instance-delete saga_node = InstanceDeleteNat
1082024-07-06T00:15:00.789ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true resource = Database result = Ok(()) saga_id = 5497bed6-54a2-46cd-9758-7e799ead00c4 saga_name = instance-delete saga_node = InstanceDeleteNat
1092024-07-06T00:15:00.805ZDEBGnexus (SagaExecutor): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true roles = RoleSet { roles: {} } saga_id = 5497bed6-54a2-46cd-9758-7e799ead00c4 saga_name = instance-delete saga_node = InstanceDeleteNat
1102024-07-06T00:15:00.806ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true resource = Database result = Ok(()) saga_id = 5497bed6-54a2-46cd-9758-7e799ead00c4 saga_name = instance-delete saga_node = InstanceDeleteNat
1112024-07-06T00:15:00.817ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
1122024-07-06T00:15:00.817ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
1132024-07-06T00:15:00.819ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
1142024-07-06T00:15:00.820ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Fleet result = Ok(())
1152024-07-06T00:15:00.820ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
1162024-07-06T00:15:00.820ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
1172024-07-06T00:15:00.825ZDEBGnexus: notifying dendrite of updates instance_id = Some(415a700f-113f-4ad3-9802-e6737b3e2041 (instance)) switch = switch0
1182024-07-06T00:15:00.825ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4d88c6ce-c5a2-418b-b915-09fea24f811c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-4d88c6ce-c5a2-418b-b915-09fea24f811c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 2279, tv_nsec: 459543523 } })
1192024-07-06T00:15:00.825ZINFOnexus: Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1014
1202024-07-06T00:15:00.857ZINFOnexus: determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1022 zone_address = fd00:1122:3344:101::2
1212024-07-06T00:15:00.857ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
1222024-07-06T00:15:00.858ZDEBGnexus (MgsClient): client response result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "80afa1c2-e471-49bc-af0f-b5d585bda804", "content-length": "26", "date": "Sat, 06 Jul 2024 00:15:00 GMT"} })
1232024-07-06T00:15:00.858ZINFOnexus: identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1027 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
1242024-07-06T00:15:00.858ZINFOnexus: completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1059 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
1252024-07-06T00:15:00.889ZDEBGnexus (DpdClient): client request body = None method = POST uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger
1262024-07-06T00:15:00.891ZDEBGnexus (DpdClient): client response result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/trigger", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "ac5f332f-2d56-45a7-908c-1bccfd0c4616", "content-length": "4", "date": "Sat, 06 Jul 2024 00:15:00 GMT"} })
1272024-07-06T00:15:00.892ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 9ff5ab27-a3ab-4401-8a23-c0799de85f2f
1282024-07-06T00:15:00.892ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 0 saga_id = 5497bed6-54a2-46cd-9758-7e799ead00c4
1292024-07-06T00:15:00.900ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 9ff5ab27-a3ab-4401-8a23-c0799de85f2f
1302024-07-06T00:15:00.900ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 5497bed6-54a2-46cd-9758-7e799ead00c4
1312024-07-06T00:15:00.904ZDEBGnexus (SagaExecutor): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true roles = RoleSet { roles: {} } saga_id = 5497bed6-54a2-46cd-9758-7e799ead00c4 saga_name = instance-delete saga_node = InstanceDeleteRecord
1322024-07-06T00:15:00.905ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true resource = Database result = Ok(()) saga_id = 5497bed6-54a2-46cd-9758-7e799ead00c4 saga_name = instance-delete saga_node = InstanceDeleteRecord
1332024-07-06T00:15:00.909ZDEBGnexus (SagaExecutor): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true roles = RoleSet { roles: {} } saga_id = 5497bed6-54a2-46cd-9758-7e799ead00c4 saga_name = instance-delete saga_node = InstanceDeleteRecord
1342024-07-06T00:15:00.909ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true resource = Database result = Ok(()) saga_id = 5497bed6-54a2-46cd-9758-7e799ead00c4 saga_name = instance-delete saga_node = InstanceDeleteRecord
1352024-07-06T00:15:00.911ZDEBGnexus (SagaExecutor): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true roles = RoleSet { roles: {} } saga_id = 5497bed6-54a2-46cd-9758-7e799ead00c4 saga_name = instance-delete saga_node = InstanceDeleteRecord
1362024-07-06T00:15:00.911ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true resource = Database result = Ok(()) saga_id = 5497bed6-54a2-46cd-9758-7e799ead00c4 saga_name = instance-delete saga_node = InstanceDeleteRecord
1372024-07-06T00:15:00.914ZDEBGnexus (SagaExecutor): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true roles = RoleSet { roles: {} } saga_id = 5497bed6-54a2-46cd-9758-7e799ead00c4 saga_name = instance-delete saga_node = InstanceDeleteRecord
1382024-07-06T00:15:00.914ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true resource = Database result = Ok(()) saga_id = 5497bed6-54a2-46cd-9758-7e799ead00c4 saga_name = instance-delete saga_node = InstanceDeleteRecord
1392024-07-06T00:15:00.916ZDEBGnexus (SagaExecutor): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true roles = RoleSet { roles: {(Silo, ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, "admin")} } saga_id = 5497bed6-54a2-46cd-9758-7e799ead00c4 saga_name = instance-delete saga_node = InstanceDeleteRecord
1402024-07-06T00:15:00.919ZDEBGnexus (SagaExecutor): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, lookup_type: ById(ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c) }, key: aac9ad5c-0170-42a6-930f-2f05e44928f2, lookup_type: ByName("proj-d35d69fc246") }, key: 415a700f-113f-4ad3-9802-e6737b3e2041, lookup_type: ByName("instance-2d04248594e") } result = Ok(()) saga_id = 5497bed6-54a2-46cd-9758-7e799ead00c4 saga_name = instance-delete saga_node = InstanceDeleteRecord
1412024-07-06T00:15:00.919ZDEBGnexus (SagaExecutor): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true roles = RoleSet { roles: {} } saga_id = 5497bed6-54a2-46cd-9758-7e799ead00c4 saga_name = instance-delete saga_node = InstanceDeleteRecord
1422024-07-06T00:15:00.920ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true resource = Database result = Ok(()) saga_id = 5497bed6-54a2-46cd-9758-7e799ead00c4 saga_name = instance-delete saga_node = InstanceDeleteRecord
1432024-07-06T00:15:00.964ZDEBGnexus (SEC): saga log event new_state = N001 failed sec_id = 9ff5ab27-a3ab-4401-8a23-c0799de85f2f
1442024-07-06T00:15:00.964ZDEBGnexus (SecStore): recording saga event event_type = Failed(ActionFailed { source_error: Object {"InvalidRequest": Object {"message": Object {"external_message": String("cannot delete instance: instance is running or has not yet fully stopped"), "internal_context": String("")}}} }) node_id = 1 saga_id = 5497bed6-54a2-46cd-9758-7e799ead00c4
1452024-07-06T00:15:01.003ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Unwinding saga_id = 5497bed6-54a2-46cd-9758-7e799ead00c4 sec_id = 9ff5ab27-a3ab-4401-8a23-c0799de85f2f
1462024-07-06T00:15:01.004ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:131 new_state = unwinding saga_id = 5497bed6-54a2-46cd-9758-7e799ead00c4
1472024-07-06T00:15:01.026ZDEBGnexus (SEC): saga log event new_state = N000 undo_started sec_id = 9ff5ab27-a3ab-4401-8a23-c0799de85f2f
1482024-07-06T00:15:01.026ZDEBGnexus (SecStore): recording saga event event_type = UndoStarted node_id = 0 saga_id = 5497bed6-54a2-46cd-9758-7e799ead00c4
1492024-07-06T00:15:01.030ZDEBGnexus (SEC): saga log event new_state = N000 undo_finished sec_id = 9ff5ab27-a3ab-4401-8a23-c0799de85f2f
1502024-07-06T00:15:01.030ZDEBGnexus (SecStore): recording saga event event_type = UndoFinished node_id = 0 saga_id = 5497bed6-54a2-46cd-9758-7e799ead00c4
1512024-07-06T00:15:01.036ZDEBGnexus (SEC): saga log event new_state = N004 undo_started sec_id = 9ff5ab27-a3ab-4401-8a23-c0799de85f2f
1522024-07-06T00:15:01.036ZDEBGnexus (SecStore): recording saga event event_type = UndoStarted node_id = 4 saga_id = 5497bed6-54a2-46cd-9758-7e799ead00c4
1532024-07-06T00:15:01.041ZDEBGnexus (SEC): saga log event new_state = N004 undo_finished sec_id = 9ff5ab27-a3ab-4401-8a23-c0799de85f2f
1542024-07-06T00:15:01.041ZDEBGnexus (SecStore): recording saga event event_type = UndoFinished node_id = 4 saga_id = 5497bed6-54a2-46cd-9758-7e799ead00c4
1552024-07-06T00:15:01.043ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 5497bed6-54a2-46cd-9758-7e799ead00c4 sec_id = 9ff5ab27-a3ab-4401-8a23-c0799de85f2f
1562024-07-06T00:15:01.043ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:131 new_state = done saga_id = 5497bed6-54a2-46cd-9758-7e799ead00c4
1572024-07-06T00:15:01.053ZWARNnexus (SEC): saga finished action_error_node_name = "no_result1" action_error_source = ActionFailed { source_error: Object {"InvalidRequest": Object {"message": Object {"external_message": String("cannot delete instance: instance is running or has not yet fully stopped"), "internal_context": String("")}}} } file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1044 result = failure saga_id = 5497bed6-54a2-46cd-9758-7e799ead00c4 saga_name = instance-delete sec_id = 9ff5ab27-a3ab-4401-8a23-c0799de85f2f undo_result = success
1582024-07-06T00:15:01.053ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:344 saga_id = 5497bed6-54a2-46cd-9758-7e799ead00c4 saga_name = instance-delete saga_result = SagaResult { saga_id: 5497bed6-54a2-46cd-9758-7e799ead00c4, saga_log: SagaLog { saga_id: 5497bed6-54a2-46cd-9758-7e799ead00c4, unwinding: true, events: [N004 started, N004 succeeded, N000 started, N000 succeeded, N001 started, N001 failed, N000 undo_started, N000 undo_finished, N004 undo_started, N004 undo_finished], node_status: {0: UndoFinished, 1: Failed(ActionFailed { source_error: Object {"InvalidRequest": Object {"message": Object {"external_message": String("cannot delete instance: instance is running or has not yet fully stopped"), "internal_context": String("")}}} }), 4: UndoFinished} }, kind: Err(SagaResultErr { error_node_name: "no_result1", error_source: ActionFailed { source_error: Object {"InvalidRequest": Object {"message": Object {"external_message": String("cannot delete instance: instance is running or has not yet fully stopped"), "internal_context": String("")}}} }, undo_failure: None }) }
1592024-07-06T00:15:01.056ZINFOnexus (dropshot_external): request completed error_message_external = cannot delete instance: instance is running or has not yet fully stopped error_message_internal = cannot delete instance: instance is running or has not yet fully stopped (with internal context: saga ACTION error at node "no_result1") file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/6a3f84c/dropshot/src/server.rs:866 latency_us = 369516 local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 86a36498-a7b3-4b1f-b6be-ffc513939462 response_code = 400 uri = /v1/instances/instance-2d04248594e?project=proj-d35d69fc246
1602024-07-06T00:15:02.058ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
1612024-07-06T00:15:02.058ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
1622024-07-06T00:15:02.060ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
1632024-07-06T00:15:02.060ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
1642024-07-06T00:15:02.061ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
1652024-07-06T00:15:02.063ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "871c52af06a2f4799eefbb9da74e17d3a62de46e", lookup_type: ByCompositeId("token = \\"871c52af06a2f4799eefbb9da74e17d3a62de46e\\"") } result = Ok(())
1662024-07-06T00:15:02.063ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
1672024-07-06T00:15:02.063ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
1682024-07-06T00:15:02.064ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
1692024-07-06T00:15:02.064ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
1702024-07-06T00:15:02.065ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
1712024-07-06T00:15:02.066ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
1722024-07-06T00:15:02.067ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
1732024-07-06T00:15:02.067ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
1742024-07-06T00:15:02.068ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
1752024-07-06T00:15:02.069ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, lookup_type: ById(ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c) }, key: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, lookup_type: ById(49d08b27-316b-4c97-97fd-dd3a8bf02b58) } result = Ok(())
1762024-07-06T00:15:02.069ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
1772024-07-06T00:15:02.069ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
1782024-07-06T00:15:02.071ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
1792024-07-06T00:15:02.072ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "871c52af06a2f4799eefbb9da74e17d3a62de46e", lookup_type: ByCompositeId("871c52af06a2f4799eefbb9da74e17d3a62de46e") } result = Ok(())
1802024-07-06T00:15:02.072ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
1812024-07-06T00:15:02.072ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
1822024-07-06T00:15:02.081ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
1832024-07-06T00:15:02.081ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
1842024-07-06T00:15:02.082ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
1852024-07-06T00:15:02.082ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
1862024-07-06T00:15:02.083ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
1872024-07-06T00:15:02.083ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
1882024-07-06T00:15:02.084ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
1892024-07-06T00:15:02.084ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
1902024-07-06T00:15:02.085ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
1912024-07-06T00:15:02.086ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, lookup_type: ById(ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c) }, key: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, lookup_type: ById(49d08b27-316b-4c97-97fd-dd3a8bf02b58) } result = Ok(())
1922024-07-06T00:15:02.086ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
1932024-07-06T00:15:02.087ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
1942024-07-06T00:15:02.088ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
1952024-07-06T00:15:02.088ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
1962024-07-06T00:15:02.089ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
1972024-07-06T00:15:02.089ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
1982024-07-06T00:15:02.090ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
1992024-07-06T00:15:02.091ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, lookup_type: ById(ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c) } result = Ok(())
2002024-07-06T00:15:02.091ZDEBGnexus (dropshot_external): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 8da890ee-7ac1-4343-b0cd-bf290b2227e8 roles = RoleSet { roles: {} } uri = /v1/instances/instance-2d04248594e?project=proj-d35d69fc246
2012024-07-06T00:15:02.091ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 8da890ee-7ac1-4343-b0cd-bf290b2227e8 resource = Database result = Ok(()) uri = /v1/instances/instance-2d04248594e?project=proj-d35d69fc246
2022024-07-06T00:15:02.092ZDEBGnexus (dropshot_external): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 8da890ee-7ac1-4343-b0cd-bf290b2227e8 roles = RoleSet { roles: {} } uri = /v1/instances/instance-2d04248594e?project=proj-d35d69fc246
2032024-07-06T00:15:02.093ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 8da890ee-7ac1-4343-b0cd-bf290b2227e8 resource = Database result = Ok(()) uri = /v1/instances/instance-2d04248594e?project=proj-d35d69fc246
2042024-07-06T00:15:02.094ZDEBGnexus (dropshot_external): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 8da890ee-7ac1-4343-b0cd-bf290b2227e8 roles = RoleSet { roles: {} } uri = /v1/instances/instance-2d04248594e?project=proj-d35d69fc246
2052024-07-06T00:15:02.094ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 8da890ee-7ac1-4343-b0cd-bf290b2227e8 resource = Database result = Ok(()) uri = /v1/instances/instance-2d04248594e?project=proj-d35d69fc246
2062024-07-06T00:15:02.096ZDEBGnexus (dropshot_external): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 8da890ee-7ac1-4343-b0cd-bf290b2227e8 roles = RoleSet { roles: {} } uri = /v1/instances/instance-2d04248594e?project=proj-d35d69fc246
2072024-07-06T00:15:02.096ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 8da890ee-7ac1-4343-b0cd-bf290b2227e8 resource = Database result = Ok(()) uri = /v1/instances/instance-2d04248594e?project=proj-d35d69fc246
2082024-07-06T00:15:02.098ZDEBGnexus (dropshot_external): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 8da890ee-7ac1-4343-b0cd-bf290b2227e8 roles = RoleSet { roles: {} } uri = /v1/instances/instance-2d04248594e?project=proj-d35d69fc246
2092024-07-06T00:15:02.098ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 8da890ee-7ac1-4343-b0cd-bf290b2227e8 resource = Database result = Ok(()) uri = /v1/instances/instance-2d04248594e?project=proj-d35d69fc246
2102024-07-06T00:15:02.100ZDEBGnexus (dropshot_external): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 8da890ee-7ac1-4343-b0cd-bf290b2227e8 roles = RoleSet { roles: {} } uri = /v1/instances/instance-2d04248594e?project=proj-d35d69fc246
2112024-07-06T00:15:02.100ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 8da890ee-7ac1-4343-b0cd-bf290b2227e8 resource = Database result = Ok(()) uri = /v1/instances/instance-2d04248594e?project=proj-d35d69fc246
2122024-07-06T00:15:02.102ZDEBGnexus (dropshot_external): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 8da890ee-7ac1-4343-b0cd-bf290b2227e8 roles = RoleSet { roles: {} } uri = /v1/instances/instance-2d04248594e?project=proj-d35d69fc246
2132024-07-06T00:15:02.103ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 8da890ee-7ac1-4343-b0cd-bf290b2227e8 resource = Database result = Ok(()) uri = /v1/instances/instance-2d04248594e?project=proj-d35d69fc246
2142024-07-06T00:15:02.104ZDEBGnexus (dropshot_external): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 8da890ee-7ac1-4343-b0cd-bf290b2227e8 roles = RoleSet { roles: {(Silo, ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, "admin")} } uri = /v1/instances/instance-2d04248594e?project=proj-d35d69fc246
2152024-07-06T00:15:02.107ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 8da890ee-7ac1-4343-b0cd-bf290b2227e8 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, lookup_type: ById(ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c) }, key: aac9ad5c-0170-42a6-930f-2f05e44928f2, lookup_type: ByName("proj-d35d69fc246") }, key: 415a700f-113f-4ad3-9802-e6737b3e2041, lookup_type: ByName("instance-2d04248594e") } result = Ok(()) uri = /v1/instances/instance-2d04248594e?project=proj-d35d69fc246
2162024-07-06T00:15:02.107ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
2172024-07-06T00:15:02.107ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
2182024-07-06T00:15:02.108ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
2192024-07-06T00:15:02.109ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Fleet result = Ok(())
2202024-07-06T00:15:02.109ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
2212024-07-06T00:15:02.109ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
2222024-07-06T00:15:02.112ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:194 saga_id = 6e4a27dd-1658-40a3-90eb-ef18dfeb65f6 saga_name = instance-delete
2232024-07-06T00:15:02.112ZINFOnexus (SEC): saga create dag = {"end_node":5,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[4,0,null],[3,5,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"instance_delete.instance_delete_nat","label":"InstanceDeleteNat","name":"no_result4"}},{"Action":{"action_name":"instance_delete.instance_delete_record","label":"InstanceDeleteRecord","name":"no_result1"}},{"Action":{"action_name":"instance_delete.delete_network_interfaces","label":"DeleteNetworkInterfaces","name":"no_result2"}},{"Action":{"action_name":"instance_delete.deallocate_external_ip","label":"DeallocateExternalIp","name":"no_result3"}},{"Start":{"params":{"authz_instance":{"key":"415a700f-113f-4ad3-9802-e6737b3e2041","lookup_type":{"ByName":"instance-2d04248594e"},"parent":{"key":"aac9ad5c-0170-42a6-930f-2f05e44928f2","lookup_type":{"ByName":"proj-d35d69fc246"},"parent":{"key":"ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c","lookup_type":{"ById":"ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c"},"parent":null}}},"boundary_switches":["switch0"],"instance":{"boot_on_fault":false,"hostname":"localshark","identity":{"description":"","id":"415a700f-113f-4ad3-9802-e6737b3e2041","name":"instance-2d04248594e","time_created":"2024-07-06T00:14:34.988987Z","time_deleted":null,"time_modified":"2024-07-06T00:14:34.988987Z"},"memory":1073741824,"ncpus":2,"project_id":"aac9ad5c-0170-42a6-930f-2f05e44928f2","runtime_state":{"dst_propolis_id":null,"gen":3,"migration_id":null,"nexus_state":"Vmm","propolis_id":"7243498a-d18c-4720-aa3a-10d138309072","time_updated":"2024-07-06T00:14:37.202713Z"},"updater_gen":1,"updater_id":null,"user_data":[]},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"SiloUser":{"silo_id":"ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c","silo_user_id":"49d08b27-316b-4c97-97fd-dd3a8bf02b58"}}},{"mapped_fleet_roles":{"admin":["admin"]}}]}}}}},"End"]},"saga_name":"instance-delete","start_node":4} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = 6e4a27dd-1658-40a3-90eb-ef18dfeb65f6 saga_name = instance-delete sec_id = 9ff5ab27-a3ab-4401-8a23-c0799de85f2f
2242024-07-06T00:15:02.112ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:49 saga_id = 6e4a27dd-1658-40a3-90eb-ef18dfeb65f6 saga_name = instance-delete
2252024-07-06T00:15:02.122ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:293 saga_id = 6e4a27dd-1658-40a3-90eb-ef18dfeb65f6 saga_name = instance-delete
2262024-07-06T00:15:02.122ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = 6e4a27dd-1658-40a3-90eb-ef18dfeb65f6 saga_name = instance-delete sec_id = 9ff5ab27-a3ab-4401-8a23-c0799de85f2f
2272024-07-06T00:15:02.122ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 9ff5ab27-a3ab-4401-8a23-c0799de85f2f
2282024-07-06T00:15:02.122ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 6e4a27dd-1658-40a3-90eb-ef18dfeb65f6
2292024-07-06T00:15:02.126ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 9ff5ab27-a3ab-4401-8a23-c0799de85f2f
2302024-07-06T00:15:02.126ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = 6e4a27dd-1658-40a3-90eb-ef18dfeb65f6
2312024-07-06T00:15:02.131ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 9ff5ab27-a3ab-4401-8a23-c0799de85f2f
2322024-07-06T00:15:02.131ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 6e4a27dd-1658-40a3-90eb-ef18dfeb65f6
2332024-07-06T00:15:02.135ZDEBGnexus (SagaExecutor): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true roles = RoleSet { roles: {} } saga_id = 6e4a27dd-1658-40a3-90eb-ef18dfeb65f6 saga_name = instance-delete saga_node = InstanceDeleteNat
2342024-07-06T00:15:02.135ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true resource = Database result = Ok(()) saga_id = 6e4a27dd-1658-40a3-90eb-ef18dfeb65f6 saga_name = instance-delete saga_node = InstanceDeleteNat
2352024-07-06T00:15:02.137ZDEBGnexus (SagaExecutor): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true roles = RoleSet { roles: {} } saga_id = 6e4a27dd-1658-40a3-90eb-ef18dfeb65f6 saga_name = instance-delete saga_node = InstanceDeleteNat
2362024-07-06T00:15:02.137ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true resource = Database result = Ok(()) saga_id = 6e4a27dd-1658-40a3-90eb-ef18dfeb65f6 saga_name = instance-delete saga_node = InstanceDeleteNat
2372024-07-06T00:15:02.138ZDEBGnexus (SagaExecutor): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true roles = RoleSet { roles: {} } saga_id = 6e4a27dd-1658-40a3-90eb-ef18dfeb65f6 saga_name = instance-delete saga_node = InstanceDeleteNat
2382024-07-06T00:15:02.138ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true resource = Database result = Ok(()) saga_id = 6e4a27dd-1658-40a3-90eb-ef18dfeb65f6 saga_name = instance-delete saga_node = InstanceDeleteNat
2392024-07-06T00:15:02.139ZDEBGnexus (SagaExecutor): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true roles = RoleSet { roles: {} } saga_id = 6e4a27dd-1658-40a3-90eb-ef18dfeb65f6 saga_name = instance-delete saga_node = InstanceDeleteNat
2402024-07-06T00:15:02.139ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true resource = Database result = Ok(()) saga_id = 6e4a27dd-1658-40a3-90eb-ef18dfeb65f6 saga_name = instance-delete saga_node = InstanceDeleteNat
2412024-07-06T00:15:02.141ZDEBGnexus (SagaExecutor): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true roles = RoleSet { roles: {} } saga_id = 6e4a27dd-1658-40a3-90eb-ef18dfeb65f6 saga_name = instance-delete saga_node = InstanceDeleteNat
2422024-07-06T00:15:02.141ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true resource = Database result = Ok(()) saga_id = 6e4a27dd-1658-40a3-90eb-ef18dfeb65f6 saga_name = instance-delete saga_node = InstanceDeleteNat
2432024-07-06T00:15:02.143ZDEBGnexus (SagaExecutor): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true roles = RoleSet { roles: {} } saga_id = 6e4a27dd-1658-40a3-90eb-ef18dfeb65f6 saga_name = instance-delete saga_node = InstanceDeleteNat
2442024-07-06T00:15:02.144ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true resource = Database result = Ok(()) saga_id = 6e4a27dd-1658-40a3-90eb-ef18dfeb65f6 saga_name = instance-delete saga_node = InstanceDeleteNat
2452024-07-06T00:15:02.146ZDEBGnexus (SagaExecutor): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true roles = RoleSet { roles: {} } saga_id = 6e4a27dd-1658-40a3-90eb-ef18dfeb65f6 saga_name = instance-delete saga_node = InstanceDeleteNat
2462024-07-06T00:15:02.146ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true resource = Database result = Ok(()) saga_id = 6e4a27dd-1658-40a3-90eb-ef18dfeb65f6 saga_name = instance-delete saga_node = InstanceDeleteNat
2472024-07-06T00:15:02.148ZDEBGnexus (SagaExecutor): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true roles = RoleSet { roles: {(Silo, ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, "admin")} } saga_id = 6e4a27dd-1658-40a3-90eb-ef18dfeb65f6 saga_name = instance-delete saga_node = InstanceDeleteNat
2482024-07-06T00:15:02.150ZDEBGnexus (SagaExecutor): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, lookup_type: ById(ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c) }, key: aac9ad5c-0170-42a6-930f-2f05e44928f2, lookup_type: ById(aac9ad5c-0170-42a6-930f-2f05e44928f2) }, key: 415a700f-113f-4ad3-9802-e6737b3e2041, lookup_type: ById(415a700f-113f-4ad3-9802-e6737b3e2041) } result = Ok(()) saga_id = 6e4a27dd-1658-40a3-90eb-ef18dfeb65f6 saga_name = instance-delete saga_node = InstanceDeleteNat
2492024-07-06T00:15:02.150ZINFOnexus: deleting instance dpd configuration file = nexus/src/app/instance_network.rs:757 instance_id = 415a700f-113f-4ad3-9802-e6737b3e2041
2502024-07-06T00:15:02.150ZDEBGnexus (SagaExecutor): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true roles = RoleSet { roles: {} } saga_id = 6e4a27dd-1658-40a3-90eb-ef18dfeb65f6 saga_name = instance-delete saga_node = InstanceDeleteNat
2512024-07-06T00:15:02.150ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true resource = Database result = Ok(()) saga_id = 6e4a27dd-1658-40a3-90eb-ef18dfeb65f6 saga_name = instance-delete saga_node = InstanceDeleteNat
2522024-07-06T00:15:02.152ZDEBGnexus (SagaExecutor): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true roles = RoleSet { roles: {} } saga_id = 6e4a27dd-1658-40a3-90eb-ef18dfeb65f6 saga_name = instance-delete saga_node = InstanceDeleteNat
2532024-07-06T00:15:02.152ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true resource = Database result = Ok(()) saga_id = 6e4a27dd-1658-40a3-90eb-ef18dfeb65f6 saga_name = instance-delete saga_node = InstanceDeleteNat
2542024-07-06T00:15:02.154ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:920
2552024-07-06T00:15:02.154ZDEBGnexus (SagaExecutor): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true roles = RoleSet { roles: {} } saga_id = 6e4a27dd-1658-40a3-90eb-ef18dfeb65f6 saga_name = instance-delete saga_node = InstanceDeleteNat
2562024-07-06T00:15:02.154ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true resource = Database result = Ok(()) saga_id = 6e4a27dd-1658-40a3-90eb-ef18dfeb65f6 saga_name = instance-delete saga_node = InstanceDeleteNat
2572024-07-06T00:15:02.155ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:920
2582024-07-06T00:15:02.155ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
2592024-07-06T00:15:02.156ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
2602024-07-06T00:15:02.157ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
2612024-07-06T00:15:02.158ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Fleet result = Ok(())
2622024-07-06T00:15:02.158ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
2632024-07-06T00:15:02.158ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
2642024-07-06T00:15:02.160ZDEBGnexus: notifying dendrite of updates instance_id = Some(415a700f-113f-4ad3-9802-e6737b3e2041 (instance)) switch = switch0
2652024-07-06T00:15:02.161ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4d88c6ce-c5a2-418b-b915-09fea24f811c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-4d88c6ce-c5a2-418b-b915-09fea24f811c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 2280, tv_nsec: 795154729 } })
2662024-07-06T00:15:02.161ZINFOnexus: Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1014
2672024-07-06T00:15:02.190ZINFOnexus: determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1022 zone_address = fd00:1122:3344:101::2
2682024-07-06T00:15:02.190ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
2692024-07-06T00:15:02.190ZDEBGnexus (MgsClient): client response result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "bd85752e-6ac9-4a4f-a4f7-0b202271fe8d", "content-length": "26", "date": "Sat, 06 Jul 2024 00:15:02 GMT"} })
2702024-07-06T00:15:02.190ZINFOnexus: identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1027 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
2712024-07-06T00:15:02.191ZINFOnexus: completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1059 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
2722024-07-06T00:15:02.219ZDEBGnexus (DpdClient): client request body = None method = POST uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger
2732024-07-06T00:15:02.219ZDEBGnexus (DpdClient): client response result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/trigger", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "79dd57c2-3241-48f2-a01c-70b6b41e1756", "content-length": "4", "date": "Sat, 06 Jul 2024 00:15:02 GMT"} })
2742024-07-06T00:15:02.220ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 9ff5ab27-a3ab-4401-8a23-c0799de85f2f
2752024-07-06T00:15:02.220ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 0 saga_id = 6e4a27dd-1658-40a3-90eb-ef18dfeb65f6
2762024-07-06T00:15:02.226ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 9ff5ab27-a3ab-4401-8a23-c0799de85f2f
2772024-07-06T00:15:02.226ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 6e4a27dd-1658-40a3-90eb-ef18dfeb65f6
2782024-07-06T00:15:02.231ZDEBGnexus (SagaExecutor): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true roles = RoleSet { roles: {} } saga_id = 6e4a27dd-1658-40a3-90eb-ef18dfeb65f6 saga_name = instance-delete saga_node = InstanceDeleteRecord
2792024-07-06T00:15:02.231ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true resource = Database result = Ok(()) saga_id = 6e4a27dd-1658-40a3-90eb-ef18dfeb65f6 saga_name = instance-delete saga_node = InstanceDeleteRecord
2802024-07-06T00:15:02.233ZDEBGnexus (SagaExecutor): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true roles = RoleSet { roles: {} } saga_id = 6e4a27dd-1658-40a3-90eb-ef18dfeb65f6 saga_name = instance-delete saga_node = InstanceDeleteRecord
2812024-07-06T00:15:02.233ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true resource = Database result = Ok(()) saga_id = 6e4a27dd-1658-40a3-90eb-ef18dfeb65f6 saga_name = instance-delete saga_node = InstanceDeleteRecord
2822024-07-06T00:15:02.235ZDEBGnexus (SagaExecutor): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true roles = RoleSet { roles: {} } saga_id = 6e4a27dd-1658-40a3-90eb-ef18dfeb65f6 saga_name = instance-delete saga_node = InstanceDeleteRecord
2832024-07-06T00:15:02.235ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true resource = Database result = Ok(()) saga_id = 6e4a27dd-1658-40a3-90eb-ef18dfeb65f6 saga_name = instance-delete saga_node = InstanceDeleteRecord
2842024-07-06T00:15:02.237ZDEBGnexus (SagaExecutor): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true roles = RoleSet { roles: {} } saga_id = 6e4a27dd-1658-40a3-90eb-ef18dfeb65f6 saga_name = instance-delete saga_node = InstanceDeleteRecord
2852024-07-06T00:15:02.237ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true resource = Database result = Ok(()) saga_id = 6e4a27dd-1658-40a3-90eb-ef18dfeb65f6 saga_name = instance-delete saga_node = InstanceDeleteRecord
2862024-07-06T00:15:02.239ZDEBGnexus (SagaExecutor): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true roles = RoleSet { roles: {(Silo, ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, "admin")} } saga_id = 6e4a27dd-1658-40a3-90eb-ef18dfeb65f6 saga_name = instance-delete saga_node = InstanceDeleteRecord
2872024-07-06T00:15:02.241ZDEBGnexus (SagaExecutor): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, lookup_type: ById(ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c) }, key: aac9ad5c-0170-42a6-930f-2f05e44928f2, lookup_type: ByName("proj-d35d69fc246") }, key: 415a700f-113f-4ad3-9802-e6737b3e2041, lookup_type: ByName("instance-2d04248594e") } result = Ok(()) saga_id = 6e4a27dd-1658-40a3-90eb-ef18dfeb65f6 saga_name = instance-delete saga_node = InstanceDeleteRecord
2882024-07-06T00:15:02.241ZDEBGnexus (SagaExecutor): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true roles = RoleSet { roles: {} } saga_id = 6e4a27dd-1658-40a3-90eb-ef18dfeb65f6 saga_name = instance-delete saga_node = InstanceDeleteRecord
2892024-07-06T00:15:02.241ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true resource = Database result = Ok(()) saga_id = 6e4a27dd-1658-40a3-90eb-ef18dfeb65f6 saga_name = instance-delete saga_node = InstanceDeleteRecord
2902024-07-06T00:15:02.318ZDEBGnexus (SEC): saga log event new_state = N001 failed sec_id = 9ff5ab27-a3ab-4401-8a23-c0799de85f2f
2912024-07-06T00:15:02.318ZDEBGnexus (SecStore): recording saga event event_type = Failed(ActionFailed { source_error: Object {"InvalidRequest": Object {"message": Object {"external_message": String("cannot delete instance: instance is running or has not yet fully stopped"), "internal_context": String("")}}} }) node_id = 1 saga_id = 6e4a27dd-1658-40a3-90eb-ef18dfeb65f6
2922024-07-06T00:15:02.324ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Unwinding saga_id = 6e4a27dd-1658-40a3-90eb-ef18dfeb65f6 sec_id = 9ff5ab27-a3ab-4401-8a23-c0799de85f2f
2932024-07-06T00:15:02.324ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:131 new_state = unwinding saga_id = 6e4a27dd-1658-40a3-90eb-ef18dfeb65f6
2942024-07-06T00:15:02.338ZDEBGnexus (SEC): saga log event new_state = N000 undo_started sec_id = 9ff5ab27-a3ab-4401-8a23-c0799de85f2f
2952024-07-06T00:15:02.338ZDEBGnexus (SecStore): recording saga event event_type = UndoStarted node_id = 0 saga_id = 6e4a27dd-1658-40a3-90eb-ef18dfeb65f6
2962024-07-06T00:15:02.340ZDEBGnexus (SEC): saga log event new_state = N000 undo_finished sec_id = 9ff5ab27-a3ab-4401-8a23-c0799de85f2f
2972024-07-06T00:15:02.340ZDEBGnexus (SecStore): recording saga event event_type = UndoFinished node_id = 0 saga_id = 6e4a27dd-1658-40a3-90eb-ef18dfeb65f6
2982024-07-06T00:15:02.343ZDEBGnexus (SEC): saga log event new_state = N004 undo_started sec_id = 9ff5ab27-a3ab-4401-8a23-c0799de85f2f
2992024-07-06T00:15:02.343ZDEBGnexus (SecStore): recording saga event event_type = UndoStarted node_id = 4 saga_id = 6e4a27dd-1658-40a3-90eb-ef18dfeb65f6
3002024-07-06T00:15:02.348ZDEBGnexus (SEC): saga log event new_state = N004 undo_finished sec_id = 9ff5ab27-a3ab-4401-8a23-c0799de85f2f
3012024-07-06T00:15:02.348ZDEBGnexus (SecStore): recording saga event event_type = UndoFinished node_id = 4 saga_id = 6e4a27dd-1658-40a3-90eb-ef18dfeb65f6
3022024-07-06T00:15:02.352ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 6e4a27dd-1658-40a3-90eb-ef18dfeb65f6 sec_id = 9ff5ab27-a3ab-4401-8a23-c0799de85f2f
3032024-07-06T00:15:02.352ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:131 new_state = done saga_id = 6e4a27dd-1658-40a3-90eb-ef18dfeb65f6
3042024-07-06T00:15:02.366ZWARNnexus (SEC): saga finished action_error_node_name = "no_result1" action_error_source = ActionFailed { source_error: Object {"InvalidRequest": Object {"message": Object {"external_message": String("cannot delete instance: instance is running or has not yet fully stopped"), "internal_context": String("")}}} } file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1044 result = failure saga_id = 6e4a27dd-1658-40a3-90eb-ef18dfeb65f6 saga_name = instance-delete sec_id = 9ff5ab27-a3ab-4401-8a23-c0799de85f2f undo_result = success
3052024-07-06T00:15:02.366ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:344 saga_id = 6e4a27dd-1658-40a3-90eb-ef18dfeb65f6 saga_name = instance-delete saga_result = SagaResult { saga_id: 6e4a27dd-1658-40a3-90eb-ef18dfeb65f6, saga_log: SagaLog { saga_id: 6e4a27dd-1658-40a3-90eb-ef18dfeb65f6, unwinding: true, events: [N004 started, N004 succeeded, N000 started, N000 succeeded, N001 started, N001 failed, N000 undo_started, N000 undo_finished, N004 undo_started, N004 undo_finished], node_status: {0: UndoFinished, 1: Failed(ActionFailed { source_error: Object {"InvalidRequest": Object {"message": Object {"external_message": String("cannot delete instance: instance is running or has not yet fully stopped"), "internal_context": String("")}}} }), 4: UndoFinished} }, kind: Err(SagaResultErr { error_node_name: "no_result1", error_source: ActionFailed { source_error: Object {"InvalidRequest": Object {"message": Object {"external_message": String("cannot delete instance: instance is running or has not yet fully stopped"), "internal_context": String("")}}} }, undo_failure: None }) }
3062024-07-06T00:15:02.366ZINFOnexus (dropshot_external): request completed error_message_external = cannot delete instance: instance is running or has not yet fully stopped error_message_internal = cannot delete instance: instance is running or has not yet fully stopped (with internal context: saga ACTION error at node "no_result1") file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/6a3f84c/dropshot/src/server.rs:866 latency_us = 308405 local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 8da890ee-7ac1-4343-b0cd-bf290b2227e8 response_code = 400 uri = /v1/instances/instance-2d04248594e?project=proj-d35d69fc246
3072024-07-06T00:15:03.368ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
3082024-07-06T00:15:03.369ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
3092024-07-06T00:15:03.370ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
3102024-07-06T00:15:03.370ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
3112024-07-06T00:15:03.372ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
3122024-07-06T00:15:03.373ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "871c52af06a2f4799eefbb9da74e17d3a62de46e", lookup_type: ByCompositeId("token = \\"871c52af06a2f4799eefbb9da74e17d3a62de46e\\"") } result = Ok(())
3132024-07-06T00:15:03.373ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
3142024-07-06T00:15:03.373ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
3152024-07-06T00:15:03.374ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
3162024-07-06T00:15:03.374ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
3172024-07-06T00:15:03.375ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
3182024-07-06T00:15:03.375ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
3192024-07-06T00:15:03.377ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
3202024-07-06T00:15:03.377ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
3212024-07-06T00:15:03.378ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
3222024-07-06T00:15:03.379ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, lookup_type: ById(ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c) }, key: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, lookup_type: ById(49d08b27-316b-4c97-97fd-dd3a8bf02b58) } result = Ok(())
3232024-07-06T00:15:03.379ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
3242024-07-06T00:15:03.379ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
3252024-07-06T00:15:03.380ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
3262024-07-06T00:15:03.381ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "871c52af06a2f4799eefbb9da74e17d3a62de46e", lookup_type: ByCompositeId("871c52af06a2f4799eefbb9da74e17d3a62de46e") } result = Ok(())
3272024-07-06T00:15:03.381ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
3282024-07-06T00:15:03.381ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
3292024-07-06T00:15:03.387ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
3302024-07-06T00:15:03.388ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
3312024-07-06T00:15:03.389ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
3322024-07-06T00:15:03.389ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
3332024-07-06T00:15:03.390ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
3342024-07-06T00:15:03.390ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
3352024-07-06T00:15:03.391ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
3362024-07-06T00:15:03.391ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
3372024-07-06T00:15:03.392ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
3382024-07-06T00:15:03.393ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, lookup_type: ById(ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c) }, key: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, lookup_type: ById(49d08b27-316b-4c97-97fd-dd3a8bf02b58) } result = Ok(())
3392024-07-06T00:15:03.393ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
3402024-07-06T00:15:03.393ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
3412024-07-06T00:15:03.394ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
3422024-07-06T00:15:03.395ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
3432024-07-06T00:15:03.396ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
3442024-07-06T00:15:03.396ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
3452024-07-06T00:15:03.397ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
3462024-07-06T00:15:03.398ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, lookup_type: ById(ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c) } result = Ok(())
3472024-07-06T00:15:03.398ZDEBGnexus (dropshot_external): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 60a292e0-3e23-4b0d-a883-c0bedc6b3fa9 roles = RoleSet { roles: {} } uri = /v1/instances/instance-2d04248594e?project=proj-d35d69fc246
3482024-07-06T00:15:03.398ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 60a292e0-3e23-4b0d-a883-c0bedc6b3fa9 resource = Database result = Ok(()) uri = /v1/instances/instance-2d04248594e?project=proj-d35d69fc246
3492024-07-06T00:15:03.399ZDEBGnexus (dropshot_external): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 60a292e0-3e23-4b0d-a883-c0bedc6b3fa9 roles = RoleSet { roles: {} } uri = /v1/instances/instance-2d04248594e?project=proj-d35d69fc246
3502024-07-06T00:15:03.399ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 60a292e0-3e23-4b0d-a883-c0bedc6b3fa9 resource = Database result = Ok(()) uri = /v1/instances/instance-2d04248594e?project=proj-d35d69fc246
3512024-07-06T00:15:03.400ZDEBGnexus (dropshot_external): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 60a292e0-3e23-4b0d-a883-c0bedc6b3fa9 roles = RoleSet { roles: {} } uri = /v1/instances/instance-2d04248594e?project=proj-d35d69fc246
3522024-07-06T00:15:03.401ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 60a292e0-3e23-4b0d-a883-c0bedc6b3fa9 resource = Database result = Ok(()) uri = /v1/instances/instance-2d04248594e?project=proj-d35d69fc246
3532024-07-06T00:15:03.402ZDEBGnexus (dropshot_external): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 60a292e0-3e23-4b0d-a883-c0bedc6b3fa9 roles = RoleSet { roles: {} } uri = /v1/instances/instance-2d04248594e?project=proj-d35d69fc246
3542024-07-06T00:15:03.403ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 60a292e0-3e23-4b0d-a883-c0bedc6b3fa9 resource = Database result = Ok(()) uri = /v1/instances/instance-2d04248594e?project=proj-d35d69fc246
3552024-07-06T00:15:03.405ZDEBGnexus (dropshot_external): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 60a292e0-3e23-4b0d-a883-c0bedc6b3fa9 roles = RoleSet { roles: {} } uri = /v1/instances/instance-2d04248594e?project=proj-d35d69fc246
3562024-07-06T00:15:03.405ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 60a292e0-3e23-4b0d-a883-c0bedc6b3fa9 resource = Database result = Ok(()) uri = /v1/instances/instance-2d04248594e?project=proj-d35d69fc246
3572024-07-06T00:15:03.407ZDEBGnexus (dropshot_external): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 60a292e0-3e23-4b0d-a883-c0bedc6b3fa9 roles = RoleSet { roles: {} } uri = /v1/instances/instance-2d04248594e?project=proj-d35d69fc246
3582024-07-06T00:15:03.407ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 60a292e0-3e23-4b0d-a883-c0bedc6b3fa9 resource = Database result = Ok(()) uri = /v1/instances/instance-2d04248594e?project=proj-d35d69fc246
3592024-07-06T00:15:03.409ZDEBGnexus (dropshot_external): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 60a292e0-3e23-4b0d-a883-c0bedc6b3fa9 roles = RoleSet { roles: {} } uri = /v1/instances/instance-2d04248594e?project=proj-d35d69fc246
3602024-07-06T00:15:03.409ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 60a292e0-3e23-4b0d-a883-c0bedc6b3fa9 resource = Database result = Ok(()) uri = /v1/instances/instance-2d04248594e?project=proj-d35d69fc246
3612024-07-06T00:15:03.411ZDEBGnexus (dropshot_external): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 60a292e0-3e23-4b0d-a883-c0bedc6b3fa9 roles = RoleSet { roles: {(Silo, ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, "admin")} } uri = /v1/instances/instance-2d04248594e?project=proj-d35d69fc246
3622024-07-06T00:15:03.413ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 60a292e0-3e23-4b0d-a883-c0bedc6b3fa9 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, lookup_type: ById(ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c) }, key: aac9ad5c-0170-42a6-930f-2f05e44928f2, lookup_type: ByName("proj-d35d69fc246") }, key: 415a700f-113f-4ad3-9802-e6737b3e2041, lookup_type: ByName("instance-2d04248594e") } result = Ok(()) uri = /v1/instances/instance-2d04248594e?project=proj-d35d69fc246
3632024-07-06T00:15:03.413ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
3642024-07-06T00:15:03.413ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
3652024-07-06T00:15:03.414ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
3662024-07-06T00:15:03.415ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Fleet result = Ok(())
3672024-07-06T00:15:03.415ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
3682024-07-06T00:15:03.416ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
3692024-07-06T00:15:03.419ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:194 saga_id = 3a7f3ce1-f982-489c-8400-3a1228cc5602 saga_name = instance-delete
3702024-07-06T00:15:03.419ZINFOnexus (SEC): saga create dag = {"end_node":5,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[4,0,null],[3,5,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"instance_delete.instance_delete_nat","label":"InstanceDeleteNat","name":"no_result4"}},{"Action":{"action_name":"instance_delete.instance_delete_record","label":"InstanceDeleteRecord","name":"no_result1"}},{"Action":{"action_name":"instance_delete.delete_network_interfaces","label":"DeleteNetworkInterfaces","name":"no_result2"}},{"Action":{"action_name":"instance_delete.deallocate_external_ip","label":"DeallocateExternalIp","name":"no_result3"}},{"Start":{"params":{"authz_instance":{"key":"415a700f-113f-4ad3-9802-e6737b3e2041","lookup_type":{"ByName":"instance-2d04248594e"},"parent":{"key":"aac9ad5c-0170-42a6-930f-2f05e44928f2","lookup_type":{"ByName":"proj-d35d69fc246"},"parent":{"key":"ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c","lookup_type":{"ById":"ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c"},"parent":null}}},"boundary_switches":["switch0"],"instance":{"boot_on_fault":false,"hostname":"localshark","identity":{"description":"","id":"415a700f-113f-4ad3-9802-e6737b3e2041","name":"instance-2d04248594e","time_created":"2024-07-06T00:14:34.988987Z","time_deleted":null,"time_modified":"2024-07-06T00:14:34.988987Z"},"memory":1073741824,"ncpus":2,"project_id":"aac9ad5c-0170-42a6-930f-2f05e44928f2","runtime_state":{"dst_propolis_id":null,"gen":3,"migration_id":null,"nexus_state":"Vmm","propolis_id":"7243498a-d18c-4720-aa3a-10d138309072","time_updated":"2024-07-06T00:14:37.202713Z"},"updater_gen":1,"updater_id":null,"user_data":[]},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"SiloUser":{"silo_id":"ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c","silo_user_id":"49d08b27-316b-4c97-97fd-dd3a8bf02b58"}}},{"mapped_fleet_roles":{"admin":["admin"]}}]}}}}},"End"]},"saga_name":"instance-delete","start_node":4} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = 3a7f3ce1-f982-489c-8400-3a1228cc5602 saga_name = instance-delete sec_id = 9ff5ab27-a3ab-4401-8a23-c0799de85f2f
3712024-07-06T00:15:03.419ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:49 saga_id = 3a7f3ce1-f982-489c-8400-3a1228cc5602 saga_name = instance-delete
3722024-07-06T00:15:03.424ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:293 saga_id = 3a7f3ce1-f982-489c-8400-3a1228cc5602 saga_name = instance-delete
3732024-07-06T00:15:03.424ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = 3a7f3ce1-f982-489c-8400-3a1228cc5602 saga_name = instance-delete sec_id = 9ff5ab27-a3ab-4401-8a23-c0799de85f2f
3742024-07-06T00:15:03.424ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 9ff5ab27-a3ab-4401-8a23-c0799de85f2f
3752024-07-06T00:15:03.424ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 3a7f3ce1-f982-489c-8400-3a1228cc5602
3762024-07-06T00:15:03.432ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 9ff5ab27-a3ab-4401-8a23-c0799de85f2f
3772024-07-06T00:15:03.432ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = 3a7f3ce1-f982-489c-8400-3a1228cc5602
3782024-07-06T00:15:03.438ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 9ff5ab27-a3ab-4401-8a23-c0799de85f2f
3792024-07-06T00:15:03.438ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 3a7f3ce1-f982-489c-8400-3a1228cc5602
3802024-07-06T00:15:03.442ZDEBGnexus (SagaExecutor): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true roles = RoleSet { roles: {} } saga_id = 3a7f3ce1-f982-489c-8400-3a1228cc5602 saga_name = instance-delete saga_node = InstanceDeleteNat
3812024-07-06T00:15:03.442ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true resource = Database result = Ok(()) saga_id = 3a7f3ce1-f982-489c-8400-3a1228cc5602 saga_name = instance-delete saga_node = InstanceDeleteNat
3822024-07-06T00:15:03.443ZDEBGnexus (SagaExecutor): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true roles = RoleSet { roles: {} } saga_id = 3a7f3ce1-f982-489c-8400-3a1228cc5602 saga_name = instance-delete saga_node = InstanceDeleteNat
3832024-07-06T00:15:03.443ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true resource = Database result = Ok(()) saga_id = 3a7f3ce1-f982-489c-8400-3a1228cc5602 saga_name = instance-delete saga_node = InstanceDeleteNat
3842024-07-06T00:15:03.444ZDEBGnexus (SagaExecutor): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true roles = RoleSet { roles: {} } saga_id = 3a7f3ce1-f982-489c-8400-3a1228cc5602 saga_name = instance-delete saga_node = InstanceDeleteNat
3852024-07-06T00:15:03.444ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true resource = Database result = Ok(()) saga_id = 3a7f3ce1-f982-489c-8400-3a1228cc5602 saga_name = instance-delete saga_node = InstanceDeleteNat
3862024-07-06T00:15:03.445ZDEBGnexus (SagaExecutor): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true roles = RoleSet { roles: {} } saga_id = 3a7f3ce1-f982-489c-8400-3a1228cc5602 saga_name = instance-delete saga_node = InstanceDeleteNat
3872024-07-06T00:15:03.445ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true resource = Database result = Ok(()) saga_id = 3a7f3ce1-f982-489c-8400-3a1228cc5602 saga_name = instance-delete saga_node = InstanceDeleteNat
3882024-07-06T00:15:03.447ZDEBGnexus (SagaExecutor): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true roles = RoleSet { roles: {} } saga_id = 3a7f3ce1-f982-489c-8400-3a1228cc5602 saga_name = instance-delete saga_node = InstanceDeleteNat
3892024-07-06T00:15:03.447ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true resource = Database result = Ok(()) saga_id = 3a7f3ce1-f982-489c-8400-3a1228cc5602 saga_name = instance-delete saga_node = InstanceDeleteNat
3902024-07-06T00:15:03.449ZDEBGnexus (SagaExecutor): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true roles = RoleSet { roles: {} } saga_id = 3a7f3ce1-f982-489c-8400-3a1228cc5602 saga_name = instance-delete saga_node = InstanceDeleteNat
3912024-07-06T00:15:03.450ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true resource = Database result = Ok(()) saga_id = 3a7f3ce1-f982-489c-8400-3a1228cc5602 saga_name = instance-delete saga_node = InstanceDeleteNat
3922024-07-06T00:15:03.451ZDEBGnexus (SagaExecutor): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true roles = RoleSet { roles: {} } saga_id = 3a7f3ce1-f982-489c-8400-3a1228cc5602 saga_name = instance-delete saga_node = InstanceDeleteNat
3932024-07-06T00:15:03.452ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true resource = Database result = Ok(()) saga_id = 3a7f3ce1-f982-489c-8400-3a1228cc5602 saga_name = instance-delete saga_node = InstanceDeleteNat
3942024-07-06T00:15:03.453ZDEBGnexus (SagaExecutor): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true roles = RoleSet { roles: {(Silo, ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, "admin")} } saga_id = 3a7f3ce1-f982-489c-8400-3a1228cc5602 saga_name = instance-delete saga_node = InstanceDeleteNat
3952024-07-06T00:15:03.456ZDEBGnexus (SagaExecutor): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, lookup_type: ById(ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c) }, key: aac9ad5c-0170-42a6-930f-2f05e44928f2, lookup_type: ById(aac9ad5c-0170-42a6-930f-2f05e44928f2) }, key: 415a700f-113f-4ad3-9802-e6737b3e2041, lookup_type: ById(415a700f-113f-4ad3-9802-e6737b3e2041) } result = Ok(()) saga_id = 3a7f3ce1-f982-489c-8400-3a1228cc5602 saga_name = instance-delete saga_node = InstanceDeleteNat
3962024-07-06T00:15:03.456ZINFOnexus: deleting instance dpd configuration file = nexus/src/app/instance_network.rs:757 instance_id = 415a700f-113f-4ad3-9802-e6737b3e2041
3972024-07-06T00:15:03.456ZDEBGnexus (SagaExecutor): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true roles = RoleSet { roles: {} } saga_id = 3a7f3ce1-f982-489c-8400-3a1228cc5602 saga_name = instance-delete saga_node = InstanceDeleteNat
3982024-07-06T00:15:03.456ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true resource = Database result = Ok(()) saga_id = 3a7f3ce1-f982-489c-8400-3a1228cc5602 saga_name = instance-delete saga_node = InstanceDeleteNat
3992024-07-06T00:15:03.457ZDEBGnexus (SagaExecutor): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true roles = RoleSet { roles: {} } saga_id = 3a7f3ce1-f982-489c-8400-3a1228cc5602 saga_name = instance-delete saga_node = InstanceDeleteNat
4002024-07-06T00:15:03.457ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true resource = Database result = Ok(()) saga_id = 3a7f3ce1-f982-489c-8400-3a1228cc5602 saga_name = instance-delete saga_node = InstanceDeleteNat
4012024-07-06T00:15:03.459ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:920
4022024-07-06T00:15:03.459ZDEBGnexus (SagaExecutor): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true roles = RoleSet { roles: {} } saga_id = 3a7f3ce1-f982-489c-8400-3a1228cc5602 saga_name = instance-delete saga_node = InstanceDeleteNat
4032024-07-06T00:15:03.459ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true resource = Database result = Ok(()) saga_id = 3a7f3ce1-f982-489c-8400-3a1228cc5602 saga_name = instance-delete saga_node = InstanceDeleteNat
4042024-07-06T00:15:03.460ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:920
4052024-07-06T00:15:03.460ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
4062024-07-06T00:15:03.461ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
4072024-07-06T00:15:03.462ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
4082024-07-06T00:15:03.463ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Fleet result = Ok(())
4092024-07-06T00:15:03.463ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
4102024-07-06T00:15:03.463ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
4112024-07-06T00:15:03.466ZDEBGnexus: notifying dendrite of updates instance_id = Some(415a700f-113f-4ad3-9802-e6737b3e2041 (instance)) switch = switch0
4122024-07-06T00:15:03.467ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4d88c6ce-c5a2-418b-b915-09fea24f811c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-4d88c6ce-c5a2-418b-b915-09fea24f811c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 2282, tv_nsec: 101080770 } })
4132024-07-06T00:15:03.467ZINFOnexus: Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1014
4142024-07-06T00:15:03.496ZINFOnexus: determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1022 zone_address = fd00:1122:3344:101::2
4152024-07-06T00:15:03.496ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
4162024-07-06T00:15:03.496ZDEBGnexus (MgsClient): client response result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "7d1fc450-c74e-4ab8-850a-66c78b7ccced", "content-length": "26", "date": "Sat, 06 Jul 2024 00:15:03 GMT"} })
4172024-07-06T00:15:03.496ZINFOnexus: identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1027 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
4182024-07-06T00:15:03.498ZINFOnexus: completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1059 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
4192024-07-06T00:15:03.527ZDEBGnexus (DpdClient): client request body = None method = POST uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger
4202024-07-06T00:15:03.527ZDEBGnexus (DpdClient): client response result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/trigger", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "31094fae-8083-45ea-ae78-5590d5028465", "content-length": "4", "date": "Sat, 06 Jul 2024 00:15:03 GMT"} })
4212024-07-06T00:15:03.528ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 9ff5ab27-a3ab-4401-8a23-c0799de85f2f
4222024-07-06T00:15:03.528ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 0 saga_id = 3a7f3ce1-f982-489c-8400-3a1228cc5602
4232024-07-06T00:15:03.534ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 9ff5ab27-a3ab-4401-8a23-c0799de85f2f
4242024-07-06T00:15:03.534ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 3a7f3ce1-f982-489c-8400-3a1228cc5602
4252024-07-06T00:15:03.543ZDEBGnexus (SagaExecutor): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true roles = RoleSet { roles: {} } saga_id = 3a7f3ce1-f982-489c-8400-3a1228cc5602 saga_name = instance-delete saga_node = InstanceDeleteRecord
4262024-07-06T00:15:03.543ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true resource = Database result = Ok(()) saga_id = 3a7f3ce1-f982-489c-8400-3a1228cc5602 saga_name = instance-delete saga_node = InstanceDeleteRecord
4272024-07-06T00:15:03.545ZDEBGnexus (SagaExecutor): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true roles = RoleSet { roles: {} } saga_id = 3a7f3ce1-f982-489c-8400-3a1228cc5602 saga_name = instance-delete saga_node = InstanceDeleteRecord
4282024-07-06T00:15:03.545ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true resource = Database result = Ok(()) saga_id = 3a7f3ce1-f982-489c-8400-3a1228cc5602 saga_name = instance-delete saga_node = InstanceDeleteRecord
4292024-07-06T00:15:03.547ZDEBGnexus (SagaExecutor): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true roles = RoleSet { roles: {} } saga_id = 3a7f3ce1-f982-489c-8400-3a1228cc5602 saga_name = instance-delete saga_node = InstanceDeleteRecord
4302024-07-06T00:15:03.547ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true resource = Database result = Ok(()) saga_id = 3a7f3ce1-f982-489c-8400-3a1228cc5602 saga_name = instance-delete saga_node = InstanceDeleteRecord
4312024-07-06T00:15:03.549ZDEBGnexus (SagaExecutor): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true roles = RoleSet { roles: {} } saga_id = 3a7f3ce1-f982-489c-8400-3a1228cc5602 saga_name = instance-delete saga_node = InstanceDeleteRecord
4322024-07-06T00:15:03.549ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true resource = Database result = Ok(()) saga_id = 3a7f3ce1-f982-489c-8400-3a1228cc5602 saga_name = instance-delete saga_node = InstanceDeleteRecord
4332024-07-06T00:15:03.551ZDEBGnexus (SagaExecutor): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true roles = RoleSet { roles: {(Silo, ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, "admin")} } saga_id = 3a7f3ce1-f982-489c-8400-3a1228cc5602 saga_name = instance-delete saga_node = InstanceDeleteRecord
4342024-07-06T00:15:03.554ZDEBGnexus (SagaExecutor): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, lookup_type: ById(ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c) }, key: aac9ad5c-0170-42a6-930f-2f05e44928f2, lookup_type: ByName("proj-d35d69fc246") }, key: 415a700f-113f-4ad3-9802-e6737b3e2041, lookup_type: ByName("instance-2d04248594e") } result = Ok(()) saga_id = 3a7f3ce1-f982-489c-8400-3a1228cc5602 saga_name = instance-delete saga_node = InstanceDeleteRecord
4352024-07-06T00:15:03.554ZDEBGnexus (SagaExecutor): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true roles = RoleSet { roles: {} } saga_id = 3a7f3ce1-f982-489c-8400-3a1228cc5602 saga_name = instance-delete saga_node = InstanceDeleteRecord
4362024-07-06T00:15:03.554ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true resource = Database result = Ok(()) saga_id = 3a7f3ce1-f982-489c-8400-3a1228cc5602 saga_name = instance-delete saga_node = InstanceDeleteRecord
4372024-07-06T00:15:03.620ZDEBGnexus (SEC): saga log event new_state = N001 failed sec_id = 9ff5ab27-a3ab-4401-8a23-c0799de85f2f
4382024-07-06T00:15:03.620ZDEBGnexus (SecStore): recording saga event event_type = Failed(ActionFailed { source_error: Object {"InvalidRequest": Object {"message": Object {"external_message": String("cannot delete instance: instance is running or has not yet fully stopped"), "internal_context": String("")}}} }) node_id = 1 saga_id = 3a7f3ce1-f982-489c-8400-3a1228cc5602
4392024-07-06T00:15:03.625ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Unwinding saga_id = 3a7f3ce1-f982-489c-8400-3a1228cc5602 sec_id = 9ff5ab27-a3ab-4401-8a23-c0799de85f2f
4402024-07-06T00:15:03.625ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:131 new_state = unwinding saga_id = 3a7f3ce1-f982-489c-8400-3a1228cc5602
4412024-07-06T00:15:03.644ZDEBGnexus (SEC): saga log event new_state = N000 undo_started sec_id = 9ff5ab27-a3ab-4401-8a23-c0799de85f2f
4422024-07-06T00:15:03.644ZDEBGnexus (SecStore): recording saga event event_type = UndoStarted node_id = 0 saga_id = 3a7f3ce1-f982-489c-8400-3a1228cc5602
4432024-07-06T00:15:03.650ZDEBGnexus (SEC): saga log event new_state = N000 undo_finished sec_id = 9ff5ab27-a3ab-4401-8a23-c0799de85f2f
4442024-07-06T00:15:03.650ZDEBGnexus (SecStore): recording saga event event_type = UndoFinished node_id = 0 saga_id = 3a7f3ce1-f982-489c-8400-3a1228cc5602
4452024-07-06T00:15:03.659ZDEBGnexus (SEC): saga log event new_state = N004 undo_started sec_id = 9ff5ab27-a3ab-4401-8a23-c0799de85f2f
4462024-07-06T00:15:03.659ZDEBGnexus (SecStore): recording saga event event_type = UndoStarted node_id = 4 saga_id = 3a7f3ce1-f982-489c-8400-3a1228cc5602
4472024-07-06T00:15:03.665ZDEBGnexus (SEC): saga log event new_state = N004 undo_finished sec_id = 9ff5ab27-a3ab-4401-8a23-c0799de85f2f
4482024-07-06T00:15:03.665ZDEBGnexus (SecStore): recording saga event event_type = UndoFinished node_id = 4 saga_id = 3a7f3ce1-f982-489c-8400-3a1228cc5602
4492024-07-06T00:15:03.672ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 3a7f3ce1-f982-489c-8400-3a1228cc5602 sec_id = 9ff5ab27-a3ab-4401-8a23-c0799de85f2f
4502024-07-06T00:15:03.672ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:131 new_state = done saga_id = 3a7f3ce1-f982-489c-8400-3a1228cc5602
4512024-07-06T00:15:03.705ZWARNnexus (SEC): saga finished action_error_node_name = "no_result1" action_error_source = ActionFailed { source_error: Object {"InvalidRequest": Object {"message": Object {"external_message": String("cannot delete instance: instance is running or has not yet fully stopped"), "internal_context": String("")}}} } file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1044 result = failure saga_id = 3a7f3ce1-f982-489c-8400-3a1228cc5602 saga_name = instance-delete sec_id = 9ff5ab27-a3ab-4401-8a23-c0799de85f2f undo_result = success
4522024-07-06T00:15:03.705ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:344 saga_id = 3a7f3ce1-f982-489c-8400-3a1228cc5602 saga_name = instance-delete saga_result = SagaResult { saga_id: 3a7f3ce1-f982-489c-8400-3a1228cc5602, saga_log: SagaLog { saga_id: 3a7f3ce1-f982-489c-8400-3a1228cc5602, unwinding: true, events: [N004 started, N004 succeeded, N000 started, N000 succeeded, N001 started, N001 failed, N000 undo_started, N000 undo_finished, N004 undo_started, N004 undo_finished], node_status: {0: UndoFinished, 1: Failed(ActionFailed { source_error: Object {"InvalidRequest": Object {"message": Object {"external_message": String("cannot delete instance: instance is running or has not yet fully stopped"), "internal_context": String("")}}} }), 4: UndoFinished} }, kind: Err(SagaResultErr { error_node_name: "no_result1", error_source: ActionFailed { source_error: Object {"InvalidRequest": Object {"message": Object {"external_message": String("cannot delete instance: instance is running or has not yet fully stopped"), "internal_context": String("")}}} }, undo_failure: None }) }
4532024-07-06T00:15:03.705ZINFOnexus (dropshot_external): request completed error_message_external = cannot delete instance: instance is running or has not yet fully stopped error_message_internal = cannot delete instance: instance is running or has not yet fully stopped (with internal context: saga ACTION error at node "no_result1") file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/6a3f84c/dropshot/src/server.rs:866 latency_us = 336710 local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 60a292e0-3e23-4b0d-a883-c0bedc6b3fa9 response_code = 400 uri = /v1/instances/instance-2d04248594e?project=proj-d35d69fc246
4542024-07-06T00:15:04.707ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
4552024-07-06T00:15:04.708ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
4562024-07-06T00:15:04.710ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
4572024-07-06T00:15:04.710ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
4582024-07-06T00:15:04.711ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
4592024-07-06T00:15:04.712ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "871c52af06a2f4799eefbb9da74e17d3a62de46e", lookup_type: ByCompositeId("token = \\"871c52af06a2f4799eefbb9da74e17d3a62de46e\\"") } result = Ok(())
4602024-07-06T00:15:04.712ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
4612024-07-06T00:15:04.713ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
4622024-07-06T00:15:04.714ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
4632024-07-06T00:15:04.714ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
4642024-07-06T00:15:04.715ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
4652024-07-06T00:15:04.716ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
4662024-07-06T00:15:04.717ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
4672024-07-06T00:15:04.717ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
4682024-07-06T00:15:04.718ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
4692024-07-06T00:15:04.720ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, lookup_type: ById(ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c) }, key: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, lookup_type: ById(49d08b27-316b-4c97-97fd-dd3a8bf02b58) } result = Ok(())
4702024-07-06T00:15:04.720ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
4712024-07-06T00:15:04.720ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
4722024-07-06T00:15:04.721ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
4732024-07-06T00:15:04.722ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "871c52af06a2f4799eefbb9da74e17d3a62de46e", lookup_type: ByCompositeId("871c52af06a2f4799eefbb9da74e17d3a62de46e") } result = Ok(())
4742024-07-06T00:15:04.722ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
4752024-07-06T00:15:04.722ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
4762024-07-06T00:15:04.736ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
4772024-07-06T00:15:04.736ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
4782024-07-06T00:15:04.738ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
4792024-07-06T00:15:04.738ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
4802024-07-06T00:15:04.739ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
4812024-07-06T00:15:04.739ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
4822024-07-06T00:15:04.740ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
4832024-07-06T00:15:04.740ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
4842024-07-06T00:15:04.741ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
4852024-07-06T00:15:04.742ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, lookup_type: ById(ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c) }, key: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, lookup_type: ById(49d08b27-316b-4c97-97fd-dd3a8bf02b58) } result = Ok(())
4862024-07-06T00:15:04.742ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
4872024-07-06T00:15:04.743ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
4882024-07-06T00:15:04.744ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
4892024-07-06T00:15:04.744ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
4902024-07-06T00:15:04.745ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
4912024-07-06T00:15:04.745ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
4922024-07-06T00:15:04.746ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
4932024-07-06T00:15:04.747ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, lookup_type: ById(ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c) } result = Ok(())
4942024-07-06T00:15:04.747ZDEBGnexus (dropshot_external): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 6f9e86ba-f51c-402c-9ef0-c428cb2209bd roles = RoleSet { roles: {} } uri = /v1/instances/instance-2d04248594e?project=proj-d35d69fc246
4952024-07-06T00:15:04.747ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 6f9e86ba-f51c-402c-9ef0-c428cb2209bd resource = Database result = Ok(()) uri = /v1/instances/instance-2d04248594e?project=proj-d35d69fc246
4962024-07-06T00:15:04.749ZDEBGnexus (dropshot_external): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 6f9e86ba-f51c-402c-9ef0-c428cb2209bd roles = RoleSet { roles: {} } uri = /v1/instances/instance-2d04248594e?project=proj-d35d69fc246
4972024-07-06T00:15:04.749ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 6f9e86ba-f51c-402c-9ef0-c428cb2209bd resource = Database result = Ok(()) uri = /v1/instances/instance-2d04248594e?project=proj-d35d69fc246
4982024-07-06T00:15:04.751ZDEBGnexus (dropshot_external): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 6f9e86ba-f51c-402c-9ef0-c428cb2209bd roles = RoleSet { roles: {} } uri = /v1/instances/instance-2d04248594e?project=proj-d35d69fc246
4992024-07-06T00:15:04.751ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 6f9e86ba-f51c-402c-9ef0-c428cb2209bd resource = Database result = Ok(()) uri = /v1/instances/instance-2d04248594e?project=proj-d35d69fc246
5002024-07-06T00:15:04.753ZDEBGnexus (dropshot_external): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 6f9e86ba-f51c-402c-9ef0-c428cb2209bd roles = RoleSet { roles: {} } uri = /v1/instances/instance-2d04248594e?project=proj-d35d69fc246
5012024-07-06T00:15:04.753ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 6f9e86ba-f51c-402c-9ef0-c428cb2209bd resource = Database result = Ok(()) uri = /v1/instances/instance-2d04248594e?project=proj-d35d69fc246
5022024-07-06T00:15:04.755ZDEBGnexus (dropshot_external): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 6f9e86ba-f51c-402c-9ef0-c428cb2209bd roles = RoleSet { roles: {} } uri = /v1/instances/instance-2d04248594e?project=proj-d35d69fc246
5032024-07-06T00:15:04.755ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 6f9e86ba-f51c-402c-9ef0-c428cb2209bd resource = Database result = Ok(()) uri = /v1/instances/instance-2d04248594e?project=proj-d35d69fc246
5042024-07-06T00:15:04.757ZDEBGnexus (dropshot_external): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 6f9e86ba-f51c-402c-9ef0-c428cb2209bd roles = RoleSet { roles: {} } uri = /v1/instances/instance-2d04248594e?project=proj-d35d69fc246
5052024-07-06T00:15:04.757ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 6f9e86ba-f51c-402c-9ef0-c428cb2209bd resource = Database result = Ok(()) uri = /v1/instances/instance-2d04248594e?project=proj-d35d69fc246
5062024-07-06T00:15:04.759ZDEBGnexus (dropshot_external): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 6f9e86ba-f51c-402c-9ef0-c428cb2209bd roles = RoleSet { roles: {} } uri = /v1/instances/instance-2d04248594e?project=proj-d35d69fc246
5072024-07-06T00:15:04.759ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 6f9e86ba-f51c-402c-9ef0-c428cb2209bd resource = Database result = Ok(()) uri = /v1/instances/instance-2d04248594e?project=proj-d35d69fc246
5082024-07-06T00:15:04.761ZDEBGnexus (dropshot_external): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 6f9e86ba-f51c-402c-9ef0-c428cb2209bd roles = RoleSet { roles: {(Silo, ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, "admin")} } uri = /v1/instances/instance-2d04248594e?project=proj-d35d69fc246
5092024-07-06T00:15:04.764ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 6f9e86ba-f51c-402c-9ef0-c428cb2209bd resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, lookup_type: ById(ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c) }, key: aac9ad5c-0170-42a6-930f-2f05e44928f2, lookup_type: ByName("proj-d35d69fc246") }, key: 415a700f-113f-4ad3-9802-e6737b3e2041, lookup_type: ByName("instance-2d04248594e") } result = Ok(()) uri = /v1/instances/instance-2d04248594e?project=proj-d35d69fc246
5102024-07-06T00:15:04.764ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
5112024-07-06T00:15:04.764ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
5122024-07-06T00:15:04.765ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
5132024-07-06T00:15:04.766ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Fleet result = Ok(())
5142024-07-06T00:15:04.766ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
5152024-07-06T00:15:04.766ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
5162024-07-06T00:15:04.770ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:194 saga_id = 19bc260e-9d03-4287-be6d-2d6f81eb2a17 saga_name = instance-delete
5172024-07-06T00:15:04.770ZINFOnexus (SEC): saga create dag = {"end_node":5,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[4,0,null],[3,5,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"instance_delete.instance_delete_nat","label":"InstanceDeleteNat","name":"no_result4"}},{"Action":{"action_name":"instance_delete.instance_delete_record","label":"InstanceDeleteRecord","name":"no_result1"}},{"Action":{"action_name":"instance_delete.delete_network_interfaces","label":"DeleteNetworkInterfaces","name":"no_result2"}},{"Action":{"action_name":"instance_delete.deallocate_external_ip","label":"DeallocateExternalIp","name":"no_result3"}},{"Start":{"params":{"authz_instance":{"key":"415a700f-113f-4ad3-9802-e6737b3e2041","lookup_type":{"ByName":"instance-2d04248594e"},"parent":{"key":"aac9ad5c-0170-42a6-930f-2f05e44928f2","lookup_type":{"ByName":"proj-d35d69fc246"},"parent":{"key":"ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c","lookup_type":{"ById":"ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c"},"parent":null}}},"boundary_switches":["switch0"],"instance":{"boot_on_fault":false,"hostname":"localshark","identity":{"description":"","id":"415a700f-113f-4ad3-9802-e6737b3e2041","name":"instance-2d04248594e","time_created":"2024-07-06T00:14:34.988987Z","time_deleted":null,"time_modified":"2024-07-06T00:14:34.988987Z"},"memory":1073741824,"ncpus":2,"project_id":"aac9ad5c-0170-42a6-930f-2f05e44928f2","runtime_state":{"dst_propolis_id":null,"gen":5,"migration_id":null,"nexus_state":"NoVmm","propolis_id":null,"time_updated":"2024-07-06T00:15:00.702444Z"},"updater_gen":1,"updater_id":null,"user_data":[]},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"SiloUser":{"silo_id":"ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c","silo_user_id":"49d08b27-316b-4c97-97fd-dd3a8bf02b58"}}},{"mapped_fleet_roles":{"admin":["admin"]}}]}}}}},"End"]},"saga_name":"instance-delete","start_node":4} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = 19bc260e-9d03-4287-be6d-2d6f81eb2a17 saga_name = instance-delete sec_id = 9ff5ab27-a3ab-4401-8a23-c0799de85f2f
5182024-07-06T00:15:04.770ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:49 saga_id = 19bc260e-9d03-4287-be6d-2d6f81eb2a17 saga_name = instance-delete
5192024-07-06T00:15:04.780ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:293 saga_id = 19bc260e-9d03-4287-be6d-2d6f81eb2a17 saga_name = instance-delete
5202024-07-06T00:15:04.780ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = 19bc260e-9d03-4287-be6d-2d6f81eb2a17 saga_name = instance-delete sec_id = 9ff5ab27-a3ab-4401-8a23-c0799de85f2f
5212024-07-06T00:15:04.780ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 9ff5ab27-a3ab-4401-8a23-c0799de85f2f
5222024-07-06T00:15:04.780ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 19bc260e-9d03-4287-be6d-2d6f81eb2a17
5232024-07-06T00:15:04.789ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 9ff5ab27-a3ab-4401-8a23-c0799de85f2f
5242024-07-06T00:15:04.789ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = 19bc260e-9d03-4287-be6d-2d6f81eb2a17
5252024-07-06T00:15:04.797ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 9ff5ab27-a3ab-4401-8a23-c0799de85f2f
5262024-07-06T00:15:04.797ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 19bc260e-9d03-4287-be6d-2d6f81eb2a17
5272024-07-06T00:15:04.804ZDEBGnexus (SagaExecutor): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true roles = RoleSet { roles: {} } saga_id = 19bc260e-9d03-4287-be6d-2d6f81eb2a17 saga_name = instance-delete saga_node = InstanceDeleteNat
5282024-07-06T00:15:04.804ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true resource = Database result = Ok(()) saga_id = 19bc260e-9d03-4287-be6d-2d6f81eb2a17 saga_name = instance-delete saga_node = InstanceDeleteNat
5292024-07-06T00:15:04.805ZDEBGnexus (SagaExecutor): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true roles = RoleSet { roles: {} } saga_id = 19bc260e-9d03-4287-be6d-2d6f81eb2a17 saga_name = instance-delete saga_node = InstanceDeleteNat
5302024-07-06T00:15:04.805ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true resource = Database result = Ok(()) saga_id = 19bc260e-9d03-4287-be6d-2d6f81eb2a17 saga_name = instance-delete saga_node = InstanceDeleteNat
5312024-07-06T00:15:04.806ZDEBGnexus (SagaExecutor): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true roles = RoleSet { roles: {} } saga_id = 19bc260e-9d03-4287-be6d-2d6f81eb2a17 saga_name = instance-delete saga_node = InstanceDeleteNat
5322024-07-06T00:15:04.807ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true resource = Database result = Ok(()) saga_id = 19bc260e-9d03-4287-be6d-2d6f81eb2a17 saga_name = instance-delete saga_node = InstanceDeleteNat
5332024-07-06T00:15:04.808ZDEBGnexus (SagaExecutor): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true roles = RoleSet { roles: {} } saga_id = 19bc260e-9d03-4287-be6d-2d6f81eb2a17 saga_name = instance-delete saga_node = InstanceDeleteNat
5342024-07-06T00:15:04.808ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true resource = Database result = Ok(()) saga_id = 19bc260e-9d03-4287-be6d-2d6f81eb2a17 saga_name = instance-delete saga_node = InstanceDeleteNat
5352024-07-06T00:15:04.810ZDEBGnexus (SagaExecutor): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true roles = RoleSet { roles: {} } saga_id = 19bc260e-9d03-4287-be6d-2d6f81eb2a17 saga_name = instance-delete saga_node = InstanceDeleteNat
5362024-07-06T00:15:04.810ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true resource = Database result = Ok(()) saga_id = 19bc260e-9d03-4287-be6d-2d6f81eb2a17 saga_name = instance-delete saga_node = InstanceDeleteNat
5372024-07-06T00:15:04.812ZDEBGnexus (SagaExecutor): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true roles = RoleSet { roles: {} } saga_id = 19bc260e-9d03-4287-be6d-2d6f81eb2a17 saga_name = instance-delete saga_node = InstanceDeleteNat
5382024-07-06T00:15:04.812ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true resource = Database result = Ok(()) saga_id = 19bc260e-9d03-4287-be6d-2d6f81eb2a17 saga_name = instance-delete saga_node = InstanceDeleteNat
5392024-07-06T00:15:04.814ZDEBGnexus (SagaExecutor): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true roles = RoleSet { roles: {} } saga_id = 19bc260e-9d03-4287-be6d-2d6f81eb2a17 saga_name = instance-delete saga_node = InstanceDeleteNat
5402024-07-06T00:15:04.814ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true resource = Database result = Ok(()) saga_id = 19bc260e-9d03-4287-be6d-2d6f81eb2a17 saga_name = instance-delete saga_node = InstanceDeleteNat
5412024-07-06T00:15:04.816ZDEBGnexus (SagaExecutor): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true roles = RoleSet { roles: {(Silo, ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, "admin")} } saga_id = 19bc260e-9d03-4287-be6d-2d6f81eb2a17 saga_name = instance-delete saga_node = InstanceDeleteNat
5422024-07-06T00:15:04.818ZDEBGnexus (SagaExecutor): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, lookup_type: ById(ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c) }, key: aac9ad5c-0170-42a6-930f-2f05e44928f2, lookup_type: ById(aac9ad5c-0170-42a6-930f-2f05e44928f2) }, key: 415a700f-113f-4ad3-9802-e6737b3e2041, lookup_type: ById(415a700f-113f-4ad3-9802-e6737b3e2041) } result = Ok(()) saga_id = 19bc260e-9d03-4287-be6d-2d6f81eb2a17 saga_name = instance-delete saga_node = InstanceDeleteNat
5432024-07-06T00:15:04.818ZINFOnexus: deleting instance dpd configuration file = nexus/src/app/instance_network.rs:757 instance_id = 415a700f-113f-4ad3-9802-e6737b3e2041
5442024-07-06T00:15:04.818ZDEBGnexus (SagaExecutor): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true roles = RoleSet { roles: {} } saga_id = 19bc260e-9d03-4287-be6d-2d6f81eb2a17 saga_name = instance-delete saga_node = InstanceDeleteNat
5452024-07-06T00:15:04.819ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true resource = Database result = Ok(()) saga_id = 19bc260e-9d03-4287-be6d-2d6f81eb2a17 saga_name = instance-delete saga_node = InstanceDeleteNat
5462024-07-06T00:15:04.820ZDEBGnexus (SagaExecutor): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true roles = RoleSet { roles: {} } saga_id = 19bc260e-9d03-4287-be6d-2d6f81eb2a17 saga_name = instance-delete saga_node = InstanceDeleteNat
5472024-07-06T00:15:04.820ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true resource = Database result = Ok(()) saga_id = 19bc260e-9d03-4287-be6d-2d6f81eb2a17 saga_name = instance-delete saga_node = InstanceDeleteNat
5482024-07-06T00:15:04.822ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:920
5492024-07-06T00:15:04.822ZDEBGnexus (SagaExecutor): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true roles = RoleSet { roles: {} } saga_id = 19bc260e-9d03-4287-be6d-2d6f81eb2a17 saga_name = instance-delete saga_node = InstanceDeleteNat
5502024-07-06T00:15:04.822ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true resource = Database result = Ok(()) saga_id = 19bc260e-9d03-4287-be6d-2d6f81eb2a17 saga_name = instance-delete saga_node = InstanceDeleteNat
5512024-07-06T00:15:04.823ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:920
5522024-07-06T00:15:04.823ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
5532024-07-06T00:15:04.824ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
5542024-07-06T00:15:04.825ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
5552024-07-06T00:15:04.826ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Fleet result = Ok(())
5562024-07-06T00:15:04.826ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
5572024-07-06T00:15:04.826ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
5582024-07-06T00:15:04.829ZDEBGnexus: notifying dendrite of updates instance_id = Some(415a700f-113f-4ad3-9802-e6737b3e2041 (instance)) switch = switch0
5592024-07-06T00:15:04.830ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4d88c6ce-c5a2-418b-b915-09fea24f811c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-4d88c6ce-c5a2-418b-b915-09fea24f811c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 2283, tv_nsec: 464071353 } })
5602024-07-06T00:15:04.830ZINFOnexus: Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1014
5612024-07-06T00:15:04.859ZINFOnexus: determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1022 zone_address = fd00:1122:3344:101::2
5622024-07-06T00:15:04.859ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
5632024-07-06T00:15:04.860ZDEBGnexus (MgsClient): client response result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "76cd423f-8859-467e-a074-944cda4f4fe7", "content-length": "26", "date": "Sat, 06 Jul 2024 00:15:04 GMT"} })
5642024-07-06T00:15:04.860ZINFOnexus: identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1027 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
5652024-07-06T00:15:04.860ZINFOnexus: completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1059 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
5662024-07-06T00:15:04.888ZDEBGnexus (DpdClient): client request body = None method = POST uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger
5672024-07-06T00:15:04.889ZDEBGnexus (DpdClient): client response result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/trigger", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "2cfb9327-8eb9-46d8-8491-55474f723e2f", "content-length": "4", "date": "Sat, 06 Jul 2024 00:15:04 GMT"} })
5682024-07-06T00:15:04.890ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 9ff5ab27-a3ab-4401-8a23-c0799de85f2f
5692024-07-06T00:15:04.890ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 0 saga_id = 19bc260e-9d03-4287-be6d-2d6f81eb2a17
5702024-07-06T00:15:04.899ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 9ff5ab27-a3ab-4401-8a23-c0799de85f2f
5712024-07-06T00:15:04.899ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 19bc260e-9d03-4287-be6d-2d6f81eb2a17
5722024-07-06T00:15:04.904ZDEBGnexus (SagaExecutor): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true roles = RoleSet { roles: {} } saga_id = 19bc260e-9d03-4287-be6d-2d6f81eb2a17 saga_name = instance-delete saga_node = InstanceDeleteRecord
5732024-07-06T00:15:04.904ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true resource = Database result = Ok(()) saga_id = 19bc260e-9d03-4287-be6d-2d6f81eb2a17 saga_name = instance-delete saga_node = InstanceDeleteRecord
5742024-07-06T00:15:04.906ZDEBGnexus (SagaExecutor): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true roles = RoleSet { roles: {} } saga_id = 19bc260e-9d03-4287-be6d-2d6f81eb2a17 saga_name = instance-delete saga_node = InstanceDeleteRecord
5752024-07-06T00:15:04.906ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true resource = Database result = Ok(()) saga_id = 19bc260e-9d03-4287-be6d-2d6f81eb2a17 saga_name = instance-delete saga_node = InstanceDeleteRecord
5762024-07-06T00:15:04.908ZDEBGnexus (SagaExecutor): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true roles = RoleSet { roles: {} } saga_id = 19bc260e-9d03-4287-be6d-2d6f81eb2a17 saga_name = instance-delete saga_node = InstanceDeleteRecord
5772024-07-06T00:15:04.908ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true resource = Database result = Ok(()) saga_id = 19bc260e-9d03-4287-be6d-2d6f81eb2a17 saga_name = instance-delete saga_node = InstanceDeleteRecord
5782024-07-06T00:15:04.910ZDEBGnexus (SagaExecutor): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true roles = RoleSet { roles: {} } saga_id = 19bc260e-9d03-4287-be6d-2d6f81eb2a17 saga_name = instance-delete saga_node = InstanceDeleteRecord
5792024-07-06T00:15:04.910ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true resource = Database result = Ok(()) saga_id = 19bc260e-9d03-4287-be6d-2d6f81eb2a17 saga_name = instance-delete saga_node = InstanceDeleteRecord
5802024-07-06T00:15:04.912ZDEBGnexus (SagaExecutor): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true roles = RoleSet { roles: {(Silo, ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, "admin")} } saga_id = 19bc260e-9d03-4287-be6d-2d6f81eb2a17 saga_name = instance-delete saga_node = InstanceDeleteRecord
5812024-07-06T00:15:04.915ZDEBGnexus (SagaExecutor): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, lookup_type: ById(ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c) }, key: aac9ad5c-0170-42a6-930f-2f05e44928f2, lookup_type: ByName("proj-d35d69fc246") }, key: 415a700f-113f-4ad3-9802-e6737b3e2041, lookup_type: ByName("instance-2d04248594e") } result = Ok(()) saga_id = 19bc260e-9d03-4287-be6d-2d6f81eb2a17 saga_name = instance-delete saga_node = InstanceDeleteRecord
5822024-07-06T00:15:04.915ZDEBGnexus (SagaExecutor): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true roles = RoleSet { roles: {} } saga_id = 19bc260e-9d03-4287-be6d-2d6f81eb2a17 saga_name = instance-delete saga_node = InstanceDeleteRecord
5832024-07-06T00:15:04.915ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true resource = Database result = Ok(()) saga_id = 19bc260e-9d03-4287-be6d-2d6f81eb2a17 saga_name = instance-delete saga_node = InstanceDeleteRecord
5842024-07-06T00:15:04.996ZDEBGnexus (SagaExecutor): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true roles = RoleSet { roles: {} } saga_id = 19bc260e-9d03-4287-be6d-2d6f81eb2a17 saga_name = instance-delete saga_node = InstanceDeleteRecord
5852024-07-06T00:15:04.997ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true resource = Database result = Ok(()) saga_id = 19bc260e-9d03-4287-be6d-2d6f81eb2a17 saga_name = instance-delete saga_node = InstanceDeleteRecord
5862024-07-06T00:15:05.009ZDEBGnexus (SagaExecutor): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true roles = RoleSet { roles: {} } saga_id = 19bc260e-9d03-4287-be6d-2d6f81eb2a17 saga_name = instance-delete saga_node = InstanceDeleteRecord
5872024-07-06T00:15:05.009ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true resource = Database result = Ok(()) saga_id = 19bc260e-9d03-4287-be6d-2d6f81eb2a17 saga_name = instance-delete saga_node = InstanceDeleteRecord
5882024-07-06T00:15:05.011ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 9ff5ab27-a3ab-4401-8a23-c0799de85f2f
5892024-07-06T00:15:05.011ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 1 saga_id = 19bc260e-9d03-4287-be6d-2d6f81eb2a17
5902024-07-06T00:15:05.017ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 9ff5ab27-a3ab-4401-8a23-c0799de85f2f
5912024-07-06T00:15:05.017ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 19bc260e-9d03-4287-be6d-2d6f81eb2a17
5922024-07-06T00:15:05.022ZDEBGnexus (SagaExecutor): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true roles = RoleSet { roles: {} } saga_id = 19bc260e-9d03-4287-be6d-2d6f81eb2a17 saga_name = instance-delete saga_node = DeleteNetworkInterfaces
5932024-07-06T00:15:05.023ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true resource = Database result = Ok(()) saga_id = 19bc260e-9d03-4287-be6d-2d6f81eb2a17 saga_name = instance-delete saga_node = DeleteNetworkInterfaces
5942024-07-06T00:15:05.025ZDEBGnexus (SagaExecutor): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true roles = RoleSet { roles: {} } saga_id = 19bc260e-9d03-4287-be6d-2d6f81eb2a17 saga_name = instance-delete saga_node = DeleteNetworkInterfaces
5952024-07-06T00:15:05.025ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true resource = Database result = Ok(()) saga_id = 19bc260e-9d03-4287-be6d-2d6f81eb2a17 saga_name = instance-delete saga_node = DeleteNetworkInterfaces
5962024-07-06T00:15:05.027ZDEBGnexus (SagaExecutor): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true roles = RoleSet { roles: {} } saga_id = 19bc260e-9d03-4287-be6d-2d6f81eb2a17 saga_name = instance-delete saga_node = DeleteNetworkInterfaces
5972024-07-06T00:15:05.028ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true resource = Database result = Ok(()) saga_id = 19bc260e-9d03-4287-be6d-2d6f81eb2a17 saga_name = instance-delete saga_node = DeleteNetworkInterfaces
5982024-07-06T00:15:05.030ZDEBGnexus (SagaExecutor): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true roles = RoleSet { roles: {} } saga_id = 19bc260e-9d03-4287-be6d-2d6f81eb2a17 saga_name = instance-delete saga_node = DeleteNetworkInterfaces
5992024-07-06T00:15:05.030ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true resource = Database result = Ok(()) saga_id = 19bc260e-9d03-4287-be6d-2d6f81eb2a17 saga_name = instance-delete saga_node = DeleteNetworkInterfaces
6002024-07-06T00:15:05.032ZDEBGnexus (SagaExecutor): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true roles = RoleSet { roles: {(Silo, ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, "admin")} } saga_id = 19bc260e-9d03-4287-be6d-2d6f81eb2a17 saga_name = instance-delete saga_node = DeleteNetworkInterfaces
6012024-07-06T00:15:05.034ZDEBGnexus (SagaExecutor): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, lookup_type: ById(ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c) }, key: aac9ad5c-0170-42a6-930f-2f05e44928f2, lookup_type: ByName("proj-d35d69fc246") }, key: 415a700f-113f-4ad3-9802-e6737b3e2041, lookup_type: ByName("instance-2d04248594e") } result = Ok(()) saga_id = 19bc260e-9d03-4287-be6d-2d6f81eb2a17 saga_name = instance-delete saga_node = DeleteNetworkInterfaces
6022024-07-06T00:15:05.034ZDEBGnexus (SagaExecutor): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true roles = RoleSet { roles: {} } saga_id = 19bc260e-9d03-4287-be6d-2d6f81eb2a17 saga_name = instance-delete saga_node = DeleteNetworkInterfaces
6032024-07-06T00:15:05.034ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true resource = Database result = Ok(()) saga_id = 19bc260e-9d03-4287-be6d-2d6f81eb2a17 saga_name = instance-delete saga_node = DeleteNetworkInterfaces
6042024-07-06T00:15:05.047ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 9ff5ab27-a3ab-4401-8a23-c0799de85f2f
6052024-07-06T00:15:05.047ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 2 saga_id = 19bc260e-9d03-4287-be6d-2d6f81eb2a17
6062024-07-06T00:15:05.047ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 16 reason = Signaled
6072024-07-06T00:15:05.047ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
6082024-07-06T00:15:05.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
6092024-07-06T00:15:05.054ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 9ff5ab27-a3ab-4401-8a23-c0799de85f2f
6102024-07-06T00:15:05.054ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 19bc260e-9d03-4287-be6d-2d6f81eb2a17
6112024-07-06T00:15:05.056ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
6122024-07-06T00:15:05.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
6132024-07-06T00:15:05.063ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
6142024-07-06T00:15:05.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
6152024-07-06T00:15:05.064ZDEBGnexus (SagaExecutor): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true roles = RoleSet { roles: {} } saga_id = 19bc260e-9d03-4287-be6d-2d6f81eb2a17 saga_name = instance-delete saga_node = DeallocateExternalIp
6162024-07-06T00:15:05.064ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true resource = Database result = Ok(()) saga_id = 19bc260e-9d03-4287-be6d-2d6f81eb2a17 saga_name = instance-delete saga_node = DeallocateExternalIp
6172024-07-06T00:15:05.065ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6182024-07-06T00:15:05.066ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
6192024-07-06T00:15:05.066ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
6202024-07-06T00:15:05.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
6212024-07-06T00:15:05.067ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6222024-07-06T00:15:05.069ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
6232024-07-06T00:15:05.069ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
6242024-07-06T00:15:05.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
6252024-07-06T00:15:05.100ZDEBGnexus (BackgroundTasks): client request SledAgent = 4d88c6ce-c5a2-418b-b915-09fea24f811c background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
6262024-07-06T00:15:05.101ZDEBGnexus (BackgroundTasks): client response SledAgent = 4d88c6ce-c5a2-418b-b915-09fea24f811c background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "5690e910-f564-4dd2-87ee-23da8bb979ec", "content-length": "811", "date": "Sat, 06 Jul 2024 00:15:05 GMT"} })
6272024-07-06T00:15:05.101ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {VirtualNetworkInterfaceHost { physical_host_ip: fd00:1122:3344:101::1, virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 253, 1, 91])), vni: Vni(14109874) }} sled = sock
6282024-07-06T00:15:05.101ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [VirtualNetworkInterfaceHost { physical_host_ip: fd00:1122:3344:101::1, virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 253, 1, 91])), vni: Vni(14109874) }] sled = sock
6292024-07-06T00:15:05.101ZDEBGnexus (BackgroundTasks): client request SledAgent = 4d88c6ce-c5a2-418b-b915-09fea24f811c background_task = v2p_manager body = Some(Body) method = DELETE uri = http://[fd00:1122:3344:101::1]:12345/v2p
6302024-07-06T00:15:05.102ZDEBGnexus (BackgroundTasks): client response SledAgent = 4d88c6ce-c5a2-418b-b915-09fea24f811c background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 204, headers: {"x-request-id": "aa0d9198-ed28-426f-942c-fde491f03d02", "date": "Sat, 06 Jul 2024 00:15:05 GMT"} })
6312024-07-06T00:15:05.102ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
6322024-07-06T00:15:05.102ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 55.13443ms iteration = 16
6332024-07-06T00:15:05.131ZDEBGnexus (SagaExecutor): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true roles = RoleSet { roles: {} } saga_id = 19bc260e-9d03-4287-be6d-2d6f81eb2a17 saga_name = instance-delete saga_node = DeallocateExternalIp
6342024-07-06T00:15:05.132ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true resource = Database result = Ok(()) saga_id = 19bc260e-9d03-4287-be6d-2d6f81eb2a17 saga_name = instance-delete saga_node = DeallocateExternalIp
6352024-07-06T00:15:05.196ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 9ff5ab27-a3ab-4401-8a23-c0799de85f2f
6362024-07-06T00:15:05.196ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = 19bc260e-9d03-4287-be6d-2d6f81eb2a17
6372024-07-06T00:15:05.202ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = 9ff5ab27-a3ab-4401-8a23-c0799de85f2f
6382024-07-06T00:15:05.202ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = 19bc260e-9d03-4287-be6d-2d6f81eb2a17
6392024-07-06T00:15:05.208ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = 9ff5ab27-a3ab-4401-8a23-c0799de85f2f
6402024-07-06T00:15:05.208ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = 19bc260e-9d03-4287-be6d-2d6f81eb2a17
6412024-07-06T00:15:05.212ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 19bc260e-9d03-4287-be6d-2d6f81eb2a17 sec_id = 9ff5ab27-a3ab-4401-8a23-c0799de85f2f
6422024-07-06T00:15:05.212ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:131 new_state = done saga_id = 19bc260e-9d03-4287-be6d-2d6f81eb2a17
6432024-07-06T00:15:05.230ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = 19bc260e-9d03-4287-be6d-2d6f81eb2a17 saga_name = instance-delete sec_id = 9ff5ab27-a3ab-4401-8a23-c0799de85f2f
6442024-07-06T00:15:05.230ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:344 saga_id = 19bc260e-9d03-4287-be6d-2d6f81eb2a17 saga_name = instance-delete saga_result = SagaResult { saga_id: 19bc260e-9d03-4287-be6d-2d6f81eb2a17, saga_log: SagaLog { saga_id: 19bc260e-9d03-4287-be6d-2d6f81eb2a17, unwinding: false, events: [N004 started, N004 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N005 started, N005 succeeded], node_status: {0: Succeeded(Null), 1: Succeeded(Null), 2: Succeeded(Null), 3: Succeeded(Null), 4: Succeeded(Null), 5: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"no_result1": Null, "no_result2": Null, "no_result3": Null, "no_result4": Null} }) }
6452024-07-06T00:15:05.230ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/6a3f84c/dropshot/src/server.rs:878 latency_us = 522394 local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 6f9e86ba-f51c-402c-9ef0-c428cb2209bd response_code = 204 uri = /v1/instances/instance-2d04248594e?project=proj-d35d69fc246
6462024-07-06T00:15:05.231ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
6472024-07-06T00:15:05.231ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
6482024-07-06T00:15:05.232ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
6492024-07-06T00:15:05.232ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
6502024-07-06T00:15:05.234ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
6512024-07-06T00:15:05.235ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "871c52af06a2f4799eefbb9da74e17d3a62de46e", lookup_type: ByCompositeId("token = \\"871c52af06a2f4799eefbb9da74e17d3a62de46e\\"") } result = Ok(())
6522024-07-06T00:15:05.235ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
6532024-07-06T00:15:05.235ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
6542024-07-06T00:15:05.236ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
6552024-07-06T00:15:05.236ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
6562024-07-06T00:15:05.237ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
6572024-07-06T00:15:05.237ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
6582024-07-06T00:15:05.238ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
6592024-07-06T00:15:05.239ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
6602024-07-06T00:15:05.240ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
6612024-07-06T00:15:05.241ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, lookup_type: ById(ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c) }, key: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, lookup_type: ById(49d08b27-316b-4c97-97fd-dd3a8bf02b58) } result = Ok(())
6622024-07-06T00:15:05.241ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
6632024-07-06T00:15:05.241ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
6642024-07-06T00:15:05.242ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
6652024-07-06T00:15:05.243ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "871c52af06a2f4799eefbb9da74e17d3a62de46e", lookup_type: ByCompositeId("871c52af06a2f4799eefbb9da74e17d3a62de46e") } result = Ok(())
6662024-07-06T00:15:05.243ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
6672024-07-06T00:15:05.243ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
6682024-07-06T00:15:05.252ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
6692024-07-06T00:15:05.252ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
6702024-07-06T00:15:05.253ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
6712024-07-06T00:15:05.253ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
6722024-07-06T00:15:05.255ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
6732024-07-06T00:15:05.255ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
6742024-07-06T00:15:05.256ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
6752024-07-06T00:15:05.256ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
6762024-07-06T00:15:05.257ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
6772024-07-06T00:15:05.258ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, lookup_type: ById(ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c) }, key: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, lookup_type: ById(49d08b27-316b-4c97-97fd-dd3a8bf02b58) } result = Ok(())
6782024-07-06T00:15:05.258ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
6792024-07-06T00:15:05.258ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
6802024-07-06T00:15:05.259ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
6812024-07-06T00:15:05.259ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
6822024-07-06T00:15:05.260ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
6832024-07-06T00:15:05.260ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
6842024-07-06T00:15:05.261ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
6852024-07-06T00:15:05.262ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, lookup_type: ById(ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c) } result = Ok(())
6862024-07-06T00:15:05.262ZDEBGnexus (dropshot_external): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 53691803-5f62-4b12-8c38-6ed5691741d9 roles = RoleSet { roles: {} } uri = /v1/disks/disk-e32a9e62137?project=proj-d35d69fc246
6872024-07-06T00:15:05.262ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 53691803-5f62-4b12-8c38-6ed5691741d9 resource = Database result = Ok(()) uri = /v1/disks/disk-e32a9e62137?project=proj-d35d69fc246
6882024-07-06T00:15:05.263ZDEBGnexus (dropshot_external): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 53691803-5f62-4b12-8c38-6ed5691741d9 roles = RoleSet { roles: {} } uri = /v1/disks/disk-e32a9e62137?project=proj-d35d69fc246
6892024-07-06T00:15:05.264ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 53691803-5f62-4b12-8c38-6ed5691741d9 resource = Database result = Ok(()) uri = /v1/disks/disk-e32a9e62137?project=proj-d35d69fc246
6902024-07-06T00:15:05.265ZDEBGnexus (dropshot_external): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 53691803-5f62-4b12-8c38-6ed5691741d9 roles = RoleSet { roles: {} } uri = /v1/disks/disk-e32a9e62137?project=proj-d35d69fc246
6912024-07-06T00:15:05.265ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 53691803-5f62-4b12-8c38-6ed5691741d9 resource = Database result = Ok(()) uri = /v1/disks/disk-e32a9e62137?project=proj-d35d69fc246
6922024-07-06T00:15:05.267ZDEBGnexus (dropshot_external): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 53691803-5f62-4b12-8c38-6ed5691741d9 roles = RoleSet { roles: {} } uri = /v1/disks/disk-e32a9e62137?project=proj-d35d69fc246
6932024-07-06T00:15:05.267ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 53691803-5f62-4b12-8c38-6ed5691741d9 resource = Database result = Ok(()) uri = /v1/disks/disk-e32a9e62137?project=proj-d35d69fc246
6942024-07-06T00:15:05.269ZDEBGnexus (dropshot_external): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 53691803-5f62-4b12-8c38-6ed5691741d9 roles = RoleSet { roles: {} } uri = /v1/disks/disk-e32a9e62137?project=proj-d35d69fc246
6952024-07-06T00:15:05.269ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 53691803-5f62-4b12-8c38-6ed5691741d9 resource = Database result = Ok(()) uri = /v1/disks/disk-e32a9e62137?project=proj-d35d69fc246
6962024-07-06T00:15:05.271ZDEBGnexus (dropshot_external): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 53691803-5f62-4b12-8c38-6ed5691741d9 roles = RoleSet { roles: {} } uri = /v1/disks/disk-e32a9e62137?project=proj-d35d69fc246
6972024-07-06T00:15:05.271ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 53691803-5f62-4b12-8c38-6ed5691741d9 resource = Database result = Ok(()) uri = /v1/disks/disk-e32a9e62137?project=proj-d35d69fc246
6982024-07-06T00:15:05.272ZDEBGnexus (dropshot_external): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 53691803-5f62-4b12-8c38-6ed5691741d9 roles = RoleSet { roles: {} } uri = /v1/disks/disk-e32a9e62137?project=proj-d35d69fc246
6992024-07-06T00:15:05.273ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 53691803-5f62-4b12-8c38-6ed5691741d9 resource = Database result = Ok(()) uri = /v1/disks/disk-e32a9e62137?project=proj-d35d69fc246
7002024-07-06T00:15:05.274ZDEBGnexus (dropshot_external): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 53691803-5f62-4b12-8c38-6ed5691741d9 roles = RoleSet { roles: {(Silo, ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, "admin")} } uri = /v1/disks/disk-e32a9e62137?project=proj-d35d69fc246
7012024-07-06T00:15:05.277ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 53691803-5f62-4b12-8c38-6ed5691741d9 resource = Disk { parent: Project { parent: Silo { parent: Fleet, key: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, lookup_type: ById(ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c) }, key: aac9ad5c-0170-42a6-930f-2f05e44928f2, lookup_type: ByName("proj-d35d69fc246") }, key: 6b05bd11-5d10-4e2f-bcb8-d9867d31bb05, lookup_type: ByName("disk-e32a9e62137") } result = Ok(()) uri = /v1/disks/disk-e32a9e62137?project=proj-d35d69fc246
7022024-07-06T00:15:05.277ZDEBGnexus (dropshot_external): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 53691803-5f62-4b12-8c38-6ed5691741d9 roles = RoleSet { roles: {} } uri = /v1/disks/disk-e32a9e62137?project=proj-d35d69fc246
7032024-07-06T00:15:05.277ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 53691803-5f62-4b12-8c38-6ed5691741d9 resource = Database result = Ok(()) uri = /v1/disks/disk-e32a9e62137?project=proj-d35d69fc246
7042024-07-06T00:15:05.278ZDEBGnexus (dropshot_external): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 53691803-5f62-4b12-8c38-6ed5691741d9 roles = RoleSet { roles: {} } uri = /v1/disks/disk-e32a9e62137?project=proj-d35d69fc246
7052024-07-06T00:15:05.278ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 53691803-5f62-4b12-8c38-6ed5691741d9 resource = Database result = Ok(()) uri = /v1/disks/disk-e32a9e62137?project=proj-d35d69fc246
7062024-07-06T00:15:05.279ZDEBGnexus (dropshot_external): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 53691803-5f62-4b12-8c38-6ed5691741d9 roles = RoleSet { roles: {} } uri = /v1/disks/disk-e32a9e62137?project=proj-d35d69fc246
7072024-07-06T00:15:05.279ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 53691803-5f62-4b12-8c38-6ed5691741d9 resource = Database result = Ok(()) uri = /v1/disks/disk-e32a9e62137?project=proj-d35d69fc246
7082024-07-06T00:15:05.280ZDEBGnexus (dropshot_external): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 53691803-5f62-4b12-8c38-6ed5691741d9 roles = RoleSet { roles: {} } uri = /v1/disks/disk-e32a9e62137?project=proj-d35d69fc246
7092024-07-06T00:15:05.281ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 53691803-5f62-4b12-8c38-6ed5691741d9 resource = Database result = Ok(()) uri = /v1/disks/disk-e32a9e62137?project=proj-d35d69fc246
7102024-07-06T00:15:05.282ZDEBGnexus (dropshot_external): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 53691803-5f62-4b12-8c38-6ed5691741d9 roles = RoleSet { roles: {} } uri = /v1/disks/disk-e32a9e62137?project=proj-d35d69fc246
7112024-07-06T00:15:05.282ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 53691803-5f62-4b12-8c38-6ed5691741d9 resource = Database result = Ok(()) uri = /v1/disks/disk-e32a9e62137?project=proj-d35d69fc246
7122024-07-06T00:15:05.284ZDEBGnexus (dropshot_external): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 53691803-5f62-4b12-8c38-6ed5691741d9 roles = RoleSet { roles: {} } uri = /v1/disks/disk-e32a9e62137?project=proj-d35d69fc246
7132024-07-06T00:15:05.284ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 53691803-5f62-4b12-8c38-6ed5691741d9 resource = Database result = Ok(()) uri = /v1/disks/disk-e32a9e62137?project=proj-d35d69fc246
7142024-07-06T00:15:05.286ZDEBGnexus (dropshot_external): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 53691803-5f62-4b12-8c38-6ed5691741d9 roles = RoleSet { roles: {} } uri = /v1/disks/disk-e32a9e62137?project=proj-d35d69fc246
7152024-07-06T00:15:05.286ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 53691803-5f62-4b12-8c38-6ed5691741d9 resource = Database result = Ok(()) uri = /v1/disks/disk-e32a9e62137?project=proj-d35d69fc246
7162024-07-06T00:15:05.288ZDEBGnexus (dropshot_external): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 53691803-5f62-4b12-8c38-6ed5691741d9 roles = RoleSet { roles: {(Silo, ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, "admin")} } uri = /v1/disks/disk-e32a9e62137?project=proj-d35d69fc246
7172024-07-06T00:15:05.291ZDEBGnexus (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 53691803-5f62-4b12-8c38-6ed5691741d9 resource = Disk { parent: Project { parent: Silo { parent: Fleet, key: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, lookup_type: ById(ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c) }, key: aac9ad5c-0170-42a6-930f-2f05e44928f2, lookup_type: ById(aac9ad5c-0170-42a6-930f-2f05e44928f2) }, key: 6b05bd11-5d10-4e2f-bcb8-d9867d31bb05, lookup_type: ById(6b05bd11-5d10-4e2f-bcb8-d9867d31bb05) } result = Ok(()) uri = /v1/disks/disk-e32a9e62137?project=proj-d35d69fc246
7182024-07-06T00:15:05.291ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:194 saga_id = 3e360cd7-aef2-4d43-85b9-404254a36f75 saga_name = disk-delete
7192024-07-06T00:15:05.291ZINFOnexus (SEC): saga create dag = {"end_node":13,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[4,5,null],[4,6,null],[6,7,null],[5,7,null],[7,8,null],[8,9,null],[9,10,null],[3,4,null],[10,11,null],[12,0,null],[11,13,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"disk_delete.delete_disk_record","label":"DeleteDiskRecord","name":"deleted_disk"}},{"Action":{"action_name":"disk_delete.space_account","label":"SpaceAccount","name":"no_result1"}},{"Constant":{"name":"params_for_volume_delete_subsaga","value":{"serialized_authn":{"kind":{"Authenticated":[{"actor":{"SiloUser":{"silo_id":"ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c","silo_user_id":"49d08b27-316b-4c97-97fd-dd3a8bf02b58"}}},{"mapped_fleet_roles":{"admin":["admin"]}}]}},"volume_id":"49fd34f9-d993-49dc-973f-946c46106e50"}}},{"SubsagaStart":{"params_node_name":"params_for_volume_delete_subsaga","saga_name":"volume-delete"}},{"Action":{"action_name":"volume_delete.decrease_crucible_resource_count","label":"DecreaseCrucibleResourceCount","name":"crucible_resources_to_delete"}},{"Action":{"action_name":"volume_delete.delete_crucible_regions","label":"DeleteCrucibleRegions","name":"no_result_1"}},{"Action":{"action_name":"volume_delete.delete_crucible_running_snapshots","label":"DeleteCrucibleRunningSnapshots","name":"no_result_2"}},{"Action":{"action_name":"volume_delete.delete_crucible_snapshots","label":"DeleteCrucibleSnapshots","name":"no_result_3"}},{"Action":{"action_name":"volume_delete.delete_crucible_snapshot_records","label":"DeleteCrucibleSnapshotRecords","name":"no_result_4"}},{"Action":{"action_name":"volume_delete.delete_freed_crucible_regions","label":"DeleteFreedCrucibleRegions","name":"no_result_5"}},{"Action":{"action_name":"volume_delete.hard_delete_volume_record","label":"HardDeleteVolumeRecord","name":"final_no_result"}},{"SubsagaEnd":{"name":"volume_delete_subsaga_no_result"}},{"Start":{"params":{"disk_id":"6b05bd11-5d10-4e2f-bcb8-d9867d31bb05","project_id":"aac9ad5c-0170-42a6-930f-2f05e44928f2","serialized_authn":{"kind":{"Authenticated":[{"actor":{"SiloUser":{"silo_id":"ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c","silo_user_id":"49d08b27-316b-4c97-97fd-dd3a8bf02b58"}}},{"mapped_fleet_roles":{"admin":["admin"]}}]}},"volume_id":"49fd34f9-d993-49dc-973f-946c46106e50"}}},"End"]},"saga_name":"disk-delete","start_node":12} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = 3e360cd7-aef2-4d43-85b9-404254a36f75 saga_name = disk-delete sec_id = 9ff5ab27-a3ab-4401-8a23-c0799de85f2f
7202024-07-06T00:15:05.291ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:49 saga_id = 3e360cd7-aef2-4d43-85b9-404254a36f75 saga_name = disk-delete
7212024-07-06T00:15:05.300ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:293 saga_id = 3e360cd7-aef2-4d43-85b9-404254a36f75 saga_name = disk-delete
7222024-07-06T00:15:05.303ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = 3e360cd7-aef2-4d43-85b9-404254a36f75 saga_name = disk-delete sec_id = 9ff5ab27-a3ab-4401-8a23-c0799de85f2f
7232024-07-06T00:15:05.303ZDEBGnexus (SEC): saga log event new_state = N012 started sec_id = 9ff5ab27-a3ab-4401-8a23-c0799de85f2f
7242024-07-06T00:15:05.303ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 12 saga_id = 3e360cd7-aef2-4d43-85b9-404254a36f75
7252024-07-06T00:15:05.338ZDEBGnexus (SEC): saga log event new_state = N012 succeeded sec_id = 9ff5ab27-a3ab-4401-8a23-c0799de85f2f
7262024-07-06T00:15:05.338ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 12 saga_id = 3e360cd7-aef2-4d43-85b9-404254a36f75
7272024-07-06T00:15:05.351ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 9ff5ab27-a3ab-4401-8a23-c0799de85f2f
7282024-07-06T00:15:05.351ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 3e360cd7-aef2-4d43-85b9-404254a36f75
7292024-07-06T00:15:05.401ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 9ff5ab27-a3ab-4401-8a23-c0799de85f2f
7302024-07-06T00:15:05.401ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"block_size": String("Traditional"), "create_image_id": String("b5ead273-160a-4bad-90d6-a12f92b55226"), "create_snapshot_id": Null, "identity": Object {"description": String(""), "id": String("6b05bd11-5d10-4e2f-bcb8-d9867d31bb05"), "name": String("disk-e32a9e62137"), "time_created": String("2024-07-06T00:14:33.795890Z"), "time_deleted": Null, "time_modified": String("2024-07-06T00:14:33.795890Z")}, "pantry_address": Null, "project_id": String("aac9ad5c-0170-42a6-930f-2f05e44928f2"), "rcgen": Number(1), "runtime_state": Object {"attach_instance_id": Null, "disk_state": String("detached"), "gen": Number(2), "time_updated": String("2024-07-06T00:14:34.781372Z")}, "size": Number(2147483648), "slot": Null, "volume_id": String("49fd34f9-d993-49dc-973f-946c46106e50")}) node_id = 0 saga_id = 3e360cd7-aef2-4d43-85b9-404254a36f75
7312024-07-06T00:15:05.409ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 9ff5ab27-a3ab-4401-8a23-c0799de85f2f
7322024-07-06T00:15:05.409ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 3e360cd7-aef2-4d43-85b9-404254a36f75
7332024-07-06T00:15:05.413ZDEBGnexus (SagaExecutor): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true roles = RoleSet { roles: {} } saga_id = 3e360cd7-aef2-4d43-85b9-404254a36f75 saga_name = disk-delete saga_node = SpaceAccount
7342024-07-06T00:15:05.413ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true resource = Database result = Ok(()) saga_id = 3e360cd7-aef2-4d43-85b9-404254a36f75 saga_name = disk-delete saga_node = SpaceAccount
7352024-07-06T00:15:05.437ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 9ff5ab27-a3ab-4401-8a23-c0799de85f2f
7362024-07-06T00:15:05.437ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 1 saga_id = 3e360cd7-aef2-4d43-85b9-404254a36f75
7372024-07-06T00:15:05.445ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 9ff5ab27-a3ab-4401-8a23-c0799de85f2f
7382024-07-06T00:15:05.445ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 3e360cd7-aef2-4d43-85b9-404254a36f75
7392024-07-06T00:15:05.457ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 9ff5ab27-a3ab-4401-8a23-c0799de85f2f
7402024-07-06T00:15:05.457ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"SiloUser": Object {"silo_id": String("ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c"), "silo_user_id": String("49d08b27-316b-4c97-97fd-dd3a8bf02b58")}}}, Object {"mapped_fleet_roles": Object {"admin": Array [String("admin")]}}]}}, "volume_id": String("49fd34f9-d993-49dc-973f-946c46106e50")}) node_id = 2 saga_id = 3e360cd7-aef2-4d43-85b9-404254a36f75
7412024-07-06T00:15:05.464ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 9ff5ab27-a3ab-4401-8a23-c0799de85f2f
7422024-07-06T00:15:05.464ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 3e360cd7-aef2-4d43-85b9-404254a36f75
7432024-07-06T00:15:05.468ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 9ff5ab27-a3ab-4401-8a23-c0799de85f2f
7442024-07-06T00:15:05.468ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = 3e360cd7-aef2-4d43-85b9-404254a36f75
7452024-07-06T00:15:05.473ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 9ff5ab27-a3ab-4401-8a23-c0799de85f2f
7462024-07-06T00:15:05.473ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 3e360cd7-aef2-4d43-85b9-404254a36f75
7472024-07-06T00:15:05.517ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 9ff5ab27-a3ab-4401-8a23-c0799de85f2f
7482024-07-06T00:15:05.517ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"V3": Object {"region_snapshots": Array [], "regions": Array []}}) node_id = 4 saga_id = 3e360cd7-aef2-4d43-85b9-404254a36f75
7492024-07-06T00:15:05.519ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = 9ff5ab27-a3ab-4401-8a23-c0799de85f2f
7502024-07-06T00:15:05.519ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = 3e360cd7-aef2-4d43-85b9-404254a36f75
7512024-07-06T00:15:05.525ZDEBGnexus (SEC): saga log event new_state = N006 started sec_id = 9ff5ab27-a3ab-4401-8a23-c0799de85f2f
7522024-07-06T00:15:05.525ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 6 saga_id = 3e360cd7-aef2-4d43-85b9-404254a36f75
7532024-07-06T00:15:05.528ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = 9ff5ab27-a3ab-4401-8a23-c0799de85f2f
7542024-07-06T00:15:05.528ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = 3e360cd7-aef2-4d43-85b9-404254a36f75
7552024-07-06T00:15:05.531ZDEBGnexus (SEC): saga log event new_state = N006 succeeded sec_id = 9ff5ab27-a3ab-4401-8a23-c0799de85f2f
7562024-07-06T00:15:05.531ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 6 saga_id = 3e360cd7-aef2-4d43-85b9-404254a36f75
7572024-07-06T00:15:05.537ZDEBGnexus (SEC): saga log event new_state = N007 started sec_id = 9ff5ab27-a3ab-4401-8a23-c0799de85f2f
7582024-07-06T00:15:05.537ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 7 saga_id = 3e360cd7-aef2-4d43-85b9-404254a36f75
7592024-07-06T00:15:05.542ZDEBGnexus (SEC): saga log event new_state = N007 succeeded sec_id = 9ff5ab27-a3ab-4401-8a23-c0799de85f2f
7602024-07-06T00:15:05.542ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 7 saga_id = 3e360cd7-aef2-4d43-85b9-404254a36f75
7612024-07-06T00:15:05.547ZDEBGnexus (SEC): saga log event new_state = N008 started sec_id = 9ff5ab27-a3ab-4401-8a23-c0799de85f2f
7622024-07-06T00:15:05.547ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 8 saga_id = 3e360cd7-aef2-4d43-85b9-404254a36f75
7632024-07-06T00:15:05.551ZDEBGnexus (SEC): saga log event new_state = N008 succeeded sec_id = 9ff5ab27-a3ab-4401-8a23-c0799de85f2f
7642024-07-06T00:15:05.551ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 8 saga_id = 3e360cd7-aef2-4d43-85b9-404254a36f75
7652024-07-06T00:15:05.556ZDEBGnexus (SEC): saga log event new_state = N009 started sec_id = 9ff5ab27-a3ab-4401-8a23-c0799de85f2f
7662024-07-06T00:15:05.556ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 9 saga_id = 3e360cd7-aef2-4d43-85b9-404254a36f75
7672024-07-06T00:15:05.593ZINFOnexus (SagaExecutor): Transient(region not deleted yet), trying again in 55.185539ms file = nexus/src/app/crucible.rs:578 region_id = 794e241a-6108-4844-97ce-1e861fc7eb1a saga_id = 3e360cd7-aef2-4d43-85b9-404254a36f75 saga_name = disk-delete
7682024-07-06T00:15:05.652ZINFOnexus (SagaExecutor): Transient(region not deleted yet), trying again in 133.510723ms file = nexus/src/app/crucible.rs:578 region_id = 794e241a-6108-4844-97ce-1e861fc7eb1a saga_id = 3e360cd7-aef2-4d43-85b9-404254a36f75 saga_name = disk-delete
7692024-07-06T00:15:05.788ZINFOnexus (SagaExecutor): region deleted file = nexus/src/app/crucible.rs:563 region_id = 794e241a-6108-4844-97ce-1e861fc7eb1a saga_id = 3e360cd7-aef2-4d43-85b9-404254a36f75 saga_name = disk-delete
7702024-07-06T00:15:05.841ZINFOnexus (SagaExecutor): Transient(region not deleted yet), trying again in 72.684229ms file = nexus/src/app/crucible.rs:578 region_id = 61f22532-f76d-4fad-8c33-2a4e32f03b5f saga_id = 3e360cd7-aef2-4d43-85b9-404254a36f75 saga_name = disk-delete
7712024-07-06T00:15:05.919ZINFOnexus (SagaExecutor): Transient(region not deleted yet), trying again in 140.788534ms file = nexus/src/app/crucible.rs:578 region_id = 61f22532-f76d-4fad-8c33-2a4e32f03b5f saga_id = 3e360cd7-aef2-4d43-85b9-404254a36f75 saga_name = disk-delete
7722024-07-06T00:15:06.064ZINFOnexus (SagaExecutor): region deleted file = nexus/src/app/crucible.rs:563 region_id = 61f22532-f76d-4fad-8c33-2a4e32f03b5f saga_id = 3e360cd7-aef2-4d43-85b9-404254a36f75 saga_name = disk-delete
7732024-07-06T00:15:06.129ZINFOnexus (SagaExecutor): Transient(region not deleted yet), trying again in 73.804705ms file = nexus/src/app/crucible.rs:578 region_id = ce0f849b-e816-42eb-9986-0adab4142b46 saga_id = 3e360cd7-aef2-4d43-85b9-404254a36f75 saga_name = disk-delete
7742024-07-06T00:15:06.208ZINFOnexus (SagaExecutor): Transient(region not deleted yet), trying again in 103.132538ms file = nexus/src/app/crucible.rs:578 region_id = ce0f849b-e816-42eb-9986-0adab4142b46 saga_id = 3e360cd7-aef2-4d43-85b9-404254a36f75 saga_name = disk-delete
7752024-07-06T00:15:06.315ZINFOnexus (SagaExecutor): region deleted file = nexus/src/app/crucible.rs:563 region_id = ce0f849b-e816-42eb-9986-0adab4142b46 saga_id = 3e360cd7-aef2-4d43-85b9-404254a36f75 saga_name = disk-delete
7762024-07-06T00:15:06.337ZDEBGnexus (SEC): saga log event new_state = N009 succeeded sec_id = 9ff5ab27-a3ab-4401-8a23-c0799de85f2f
7772024-07-06T00:15:06.337ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 9 saga_id = 3e360cd7-aef2-4d43-85b9-404254a36f75
7782024-07-06T00:15:06.367ZDEBGnexus (SEC): saga log event new_state = N010 started sec_id = 9ff5ab27-a3ab-4401-8a23-c0799de85f2f
7792024-07-06T00:15:06.367ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 10 saga_id = 3e360cd7-aef2-4d43-85b9-404254a36f75
7802024-07-06T00:15:06.389ZDEBGnexus (SEC): saga log event new_state = N010 succeeded sec_id = 9ff5ab27-a3ab-4401-8a23-c0799de85f2f
7812024-07-06T00:15:06.389ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = 3e360cd7-aef2-4d43-85b9-404254a36f75
7822024-07-06T00:15:06.401ZDEBGnexus (SEC): saga log event new_state = N011 started sec_id = 9ff5ab27-a3ab-4401-8a23-c0799de85f2f
7832024-07-06T00:15:06.402ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 11 saga_id = 3e360cd7-aef2-4d43-85b9-404254a36f75
7842024-07-06T00:15:06.405ZDEBGnexus (SEC): saga log event new_state = N011 succeeded sec_id = 9ff5ab27-a3ab-4401-8a23-c0799de85f2f
7852024-07-06T00:15:06.405ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 11 saga_id = 3e360cd7-aef2-4d43-85b9-404254a36f75
7862024-07-06T00:15:06.412ZDEBGnexus (SEC): saga log event new_state = N013 started sec_id = 9ff5ab27-a3ab-4401-8a23-c0799de85f2f
7872024-07-06T00:15:06.412ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 13 saga_id = 3e360cd7-aef2-4d43-85b9-404254a36f75
7882024-07-06T00:15:06.416ZDEBGnexus (SEC): saga log event new_state = N013 succeeded sec_id = 9ff5ab27-a3ab-4401-8a23-c0799de85f2f
7892024-07-06T00:15:06.416ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 13 saga_id = 3e360cd7-aef2-4d43-85b9-404254a36f75
7902024-07-06T00:15:06.423ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 3e360cd7-aef2-4d43-85b9-404254a36f75 sec_id = 9ff5ab27-a3ab-4401-8a23-c0799de85f2f
7912024-07-06T00:15:06.423ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:131 new_state = done saga_id = 3e360cd7-aef2-4d43-85b9-404254a36f75
7922024-07-06T00:15:06.439ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = 3e360cd7-aef2-4d43-85b9-404254a36f75 saga_name = disk-delete sec_id = 9ff5ab27-a3ab-4401-8a23-c0799de85f2f
7932024-07-06T00:15:06.439ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:344 saga_id = 3e360cd7-aef2-4d43-85b9-404254a36f75 saga_name = disk-delete saga_result = SagaResult { saga_id: 3e360cd7-aef2-4d43-85b9-404254a36f75, saga_log: SagaLog { saga_id: 3e360cd7-aef2-4d43-85b9-404254a36f75, unwinding: false, events: [N012 started, N012 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N006 started, N005 succeeded, N006 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N009 started, N009 succeeded, N010 started, N010 succeeded, N011 started, N011 succeeded, N013 started, N013 succeeded], node_status: {0: Succeeded(Object {"block_size": String("Traditional"), "create_image_id": String("b5ead273-160a-4bad-90d6-a12f92b55226"), "create_snapshot_id": Null, "identity": Object {"description": String(""), "id": String("6b05bd11-5d10-4e2f-bcb8-d9867d31bb05"), "name": String("disk-e32a9e62137"), "time_created": String("2024-07-06T00:14:33.795890Z"), "time_deleted": Null, "time_modified": String("2024-07-06T00:14:33.795890Z")}, "pantry_address": Null, "project_id": String("aac9ad5c-0170-42a6-930f-2f05e44928f2"), "rcgen": Number(1), "runtime_state": Object {"attach_instance_id": Null, "disk_state": String("detached"), "gen": Number(2), "time_updated": String("2024-07-06T00:14:34.781372Z")}, "size": Number(2147483648), "slot": Null, "volume_id": String("49fd34f9-d993-49dc-973f-946c46106e50")}), 1: Succeeded(Null), 2: Succeeded(Object {"serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"SiloUser": Object {"silo_id": String("ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c"), "silo_user_id": String("49d08b27-316b-4c97-97fd-dd3a8bf02b58")}}}, Object {"mapped_fleet_roles": Object {"admin": Array [String("admin")]}}]}}, "volume_id": String("49fd34f9-d993-49dc-973f-946c46106e50")}), 3: Succeeded(Null), 4: Succeeded(Object {"V3": Object {"region_snapshots": Array [], "regions": Array []}}), 5: Succeeded(Null), 6: Succeeded(Null), 7: Succeeded(Null), 8: Succeeded(Null), 9: Succeeded(Null), 10: Succeeded(Null), 11: Succeeded(Null), 12: Succeeded(Null), 13: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"crucible_resources_to_delete": Object {"V3": Object {"region_snapshots": Array [], "regions": Array []}}, "deleted_disk": Object {"block_size": String("Traditional"), "create_image_id": String("b5ead273-160a-4bad-90d6-a12f92b55226"), "create_snapshot_id": Null, "identity": Object {"description": String(""), "id": String("6b05bd11-5d10-4e2f-bcb8-d9867d31bb05"), "name": String("disk-e32a9e62137"), "time_created": String("2024-07-06T00:14:33.795890Z"), "time_deleted": Null, "time_modified": String("2024-07-06T00:14:33.795890Z")}, "pantry_address": Null, "project_id": String("aac9ad5c-0170-42a6-930f-2f05e44928f2"), "rcgen": Number(1), "runtime_state": Object {"attach_instance_id": Null, "disk_state": String("detached"), "gen": Number(2), "time_updated": String("2024-07-06T00:14:34.781372Z")}, "size": Number(2147483648), "slot": Null, "volume_id": String("49fd34f9-d993-49dc-973f-946c46106e50")}, "final_no_result": Null, "no_result1": Null, "no_result_1": Null, "no_result_2": Null, "no_result_3": Null, "no_result_4": Null, "no_result_5": Null, "params_for_volume_delete_subsaga": Object {"serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"SiloUser": Object {"silo_id": String("ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c"), "silo_user_id": String("49d08b27-316b-4c97-97fd-dd3a8bf02b58")}}}, Object {"mapped_fleet_roles": Object {"admin": Array [String("admin")]}}]}}, "volume_id": String("49fd34f9-d993-49dc-973f-946c46106e50")}, "volume_delete_subsaga_no_result": Null} }) }
7942024-07-06T00:15:06.439ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/6a3f84c/dropshot/src/server.rs:878 latency_us = 1208148 local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 53691803-5f62-4b12-8c38-6ed5691741d9 response_code = 204 uri = /v1/disks/disk-e32a9e62137?project=proj-d35d69fc246
7952024-07-06T00:15:06.443ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
7962024-07-06T00:15:06.443ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
7972024-07-06T00:15:06.444ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
7982024-07-06T00:15:06.445ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
7992024-07-06T00:15:06.446ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
8002024-07-06T00:15:06.447ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "871c52af06a2f4799eefbb9da74e17d3a62de46e", lookup_type: ByCompositeId("token = \\"871c52af06a2f4799eefbb9da74e17d3a62de46e\\"") } result = Ok(())
8012024-07-06T00:15:06.447ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
8022024-07-06T00:15:06.447ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
8032024-07-06T00:15:06.448ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
8042024-07-06T00:15:06.448ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
8052024-07-06T00:15:06.449ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
8062024-07-06T00:15:06.449ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
8072024-07-06T00:15:06.450ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
8082024-07-06T00:15:06.451ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
8092024-07-06T00:15:06.452ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
8102024-07-06T00:15:06.453ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, lookup_type: ById(ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c) }, key: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, lookup_type: ById(49d08b27-316b-4c97-97fd-dd3a8bf02b58) } result = Ok(())
8112024-07-06T00:15:06.453ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
8122024-07-06T00:15:06.453ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
8132024-07-06T00:15:06.454ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
8142024-07-06T00:15:06.455ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "871c52af06a2f4799eefbb9da74e17d3a62de46e", lookup_type: ByCompositeId("871c52af06a2f4799eefbb9da74e17d3a62de46e") } result = Ok(())
8152024-07-06T00:15:06.455ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
8162024-07-06T00:15:06.455ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
8172024-07-06T00:15:06.463ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 8 reason = Timeout
8182024-07-06T00:15:06.463ZINFOnexus (BackgroundTasks): lookup region port task started background_task = lookup_region_port file = nexus/src/app/background/tasks/lookup_region_port.rs:56
8192024-07-06T00:15:06.463ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 17 reason = Timeout
8202024-07-06T00:15:06.463ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
8212024-07-06T00:15:06.463ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 8 reason = Timeout
8222024-07-06T00:15:06.463ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
8232024-07-06T00:15:06.463ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
8242024-07-06T00:15:06.463ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 15 reason = Timeout
8252024-07-06T00:15:06.463ZWARNnexus (BackgroundTasks): region replacement task started background_task = region_replacement file = nexus/src/app/background/tasks/region_replacement.rs:64
8262024-07-06T00:15:06.463ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
8272024-07-06T00:15:06.464ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 8 reason = Timeout
8282024-07-06T00:15:06.464ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 8 reason = Timeout
8292024-07-06T00:15:06.464ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-07-06 00:05:06.463943651 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
8302024-07-06T00:15:06.464ZINFOnexus (BackgroundTasks): Abandoned VMM reaper running background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:76
8312024-07-06T00:15:06.464ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
8322024-07-06T00:15:06.464ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
8332024-07-06T00:15:06.464ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 8 reason = Timeout
8342024-07-06T00:15:06.464ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
8352024-07-06T00:15:06.464ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
8362024-07-06T00:15:06.464ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 8 reason = Timeout
8372024-07-06T00:15:06.464ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 10 reason = Timeout
8382024-07-06T00:15:06.464ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 15 reason = Timeout
8392024-07-06T00:15:06.464ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
8402024-07-06T00:15:06.464ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 16 reason = Timeout
8412024-07-06T00:15:06.464ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 15 reason = Timeout
8422024-07-06T00:15:06.464ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 10 reason = Timeout
8432024-07-06T00:15:06.464ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
8442024-07-06T00:15:06.464ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
8452024-07-06T00:15:06.464ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 15 reason = Timeout
8462024-07-06T00:15:06.464ZWARNnexus (BackgroundTasks): phantom disk task started background_task = phantom_disks file = nexus/src/app/background/tasks/phantom_disks.rs:46
8472024-07-06T00:15:06.464ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 8 reason = Timeout
8482024-07-06T00:15:06.464ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
8492024-07-06T00:15:06.464ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 15 reason = Timeout
8502024-07-06T00:15:06.464ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
8512024-07-06T00:15:06.464ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 15 reason = Timeout
8522024-07-06T00:15:06.464ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8532024-07-06T00:15:06.464ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8542024-07-06T00:15:06.464ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 15 reason = Timeout
8552024-07-06T00:15:06.464ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
8562024-07-06T00:15:06.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
8572024-07-06T00:15:06.464ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 43 reason = Timeout
8582024-07-06T00:15:06.464ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 9 reason = Timeout
8592024-07-06T00:15:06.464ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:69 reason = blueprint disabled target_id = 19924212-3af7-4ff8-94f5-f62e5472fa7b
8602024-07-06T00:15:06.464ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 43 reason = Timeout
8612024-07-06T00:15:06.464ZINFOnexus (BackgroundTasks): region replacement driver task started background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:231
8622024-07-06T00:15:06.464ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
8632024-07-06T00:15:06.464ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 12.05\u{b5}s iteration = 9
8642024-07-06T00:15:06.464ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 15 reason = Timeout
8652024-07-06T00:15:06.464ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8662024-07-06T00:15:06.464ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
8672024-07-06T00:15:06.464ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 8 reason = Timeout
8682024-07-06T00:15:06.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
8692024-07-06T00:15:06.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
8702024-07-06T00:15:06.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
8712024-07-06T00:15:06.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
8722024-07-06T00:15:06.464ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
8732024-07-06T00:15:06.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
8742024-07-06T00:15:06.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
8752024-07-06T00:15:06.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
8762024-07-06T00:15:06.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
8772024-07-06T00:15:06.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
8782024-07-06T00:15:06.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
8792024-07-06T00:15:06.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8802024-07-06T00:15:06.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
8812024-07-06T00:15:06.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8822024-07-06T00:15:06.464ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("544a0264-7c3a-4ada-aa6e-553800c85da2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f0ddfaba-8652-4628-848a-f993e079fb94.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f0ddfaba-8652-4628-848a-f993e079fb94.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(fd00:1122:3344:101::9)) }], valid_until: Instant { tv_sec: 2285, tv_nsec: 98526821 } })
8832024-07-06T00:15:06.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
8842024-07-06T00:15:06.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
8852024-07-06T00:15:06.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8862024-07-06T00:15:06.464ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
8872024-07-06T00:15:06.464ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
8882024-07-06T00:15:06.465ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
8892024-07-06T00:15:06.465ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1f295afe-8b02-48b5-8b08-e8e6206ee96c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("bd5693ce-2405-4f5e-bcea-cf00f7435aea.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("cdec4b62-7244-4b80-8777-6d905a5202cd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("cdec4b62-7244-4b80-8777-6d905a5202cd.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(fd00:1122:3344:1::1)) }], valid_until: Instant { tv_sec: 2285, tv_nsec: 99543107 } })
8902024-07-06T00:15:06.466ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8912024-07-06T00:15:06.466ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
8922024-07-06T00:15:06.466ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8932024-07-06T00:15:06.466ZWARNnexus (BackgroundTasks): phantom disk task done background_task = phantom_disks file = nexus/src/app/background/tasks/phantom_disks.rs:93
8942024-07-06T00:15:06.466ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 2.639552ms iteration = 15
8952024-07-06T00:15:06.466ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
8962024-07-06T00:15:06.466ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
8972024-07-06T00:15:06.466ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 2.947267ms iteration = 8
8982024-07-06T00:15:06.467ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
8992024-07-06T00:15:06.467ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
9002024-07-06T00:15:06.467ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9012024-07-06T00:15:06.467ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-07-06 00:05:06.463943651 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
9022024-07-06T00:15:06.467ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 3.858081ms iteration = 8
9032024-07-06T00:15:06.468ZINFOnexus (BackgroundTasks): lookup region port task done background_task = lookup_region_port file = nexus/src/app/background/tasks/lookup_region_port.rs:143
9042024-07-06T00:15:06.468ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 4.124546ms iteration = 8
9052024-07-06T00:15:06.468ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0
9062024-07-06T00:15:06.468ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:189 found = 0 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0
9072024-07-06T00:15:06.468ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 4.189697ms iteration = 8
9082024-07-06T00:15:06.468ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
9092024-07-06T00:15:06.468ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 4.172637ms iteration = 8
9102024-07-06T00:15:06.468ZINFOnexus (BackgroundTasks): region replacement driver task done background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:238
9112024-07-06T00:15:06.468ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.536872ms iteration = 43
9122024-07-06T00:15:06.468ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4d88c6ce-c5a2-418b-b915-09fea24f811c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-4d88c6ce-c5a2-418b-b915-09fea24f811c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 2285, tv_nsec: 102553415 } })
9132024-07-06T00:15:06.468ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9142024-07-06T00:15:06.469ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9152024-07-06T00:15:06.469ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
9162024-07-06T00:15:06.469ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9172024-07-06T00:15:06.469ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
9182024-07-06T00:15:06.469ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9192024-07-06T00:15:06.469ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1014
9202024-07-06T00:15:06.470ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4d88c6ce-c5a2-418b-b915-09fea24f811c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-4d88c6ce-c5a2-418b-b915-09fea24f811c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 2285, tv_nsec: 104023349 } })
9212024-07-06T00:15:06.470ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
9222024-07-06T00:15:06.470ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
9232024-07-06T00:15:06.470ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
9242024-07-06T00:15:06.470ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
9252024-07-06T00:15:06.470ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
9262024-07-06T00:15:06.470ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
9272024-07-06T00:15:06.471ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
9282024-07-06T00:15:06.471ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
9292024-07-06T00:15:06.471ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1014
9302024-07-06T00:15:06.472ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
9312024-07-06T00:15:06.472ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9322024-07-06T00:15:06.472ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
9332024-07-06T00:15:06.472ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
9342024-07-06T00:15:06.472ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
9352024-07-06T00:15:06.472ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
9362024-07-06T00:15:06.472ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
9372024-07-06T00:15:06.473ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
9382024-07-06T00:15:06.473ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
9392024-07-06T00:15:06.473ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
9402024-07-06T00:15:06.473ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
9412024-07-06T00:15:06.473ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
9422024-07-06T00:15:06.474ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
9432024-07-06T00:15:06.474ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9442024-07-06T00:15:06.474ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
9452024-07-06T00:15:06.474ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
9462024-07-06T00:15:06.474ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
9472024-07-06T00:15:06.475ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
9482024-07-06T00:15:06.475ZWARNnexus (BackgroundTasks): region replacement task done background_task = region_replacement file = nexus/src/app/background/tasks/region_replacement.rs:185
9492024-07-06T00:15:06.475ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 11.360112ms iteration = 15
9502024-07-06T00:15:06.475ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
9512024-07-06T00:15:06.475ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9522024-07-06T00:15:06.475ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
9532024-07-06T00:15:06.475ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9542024-07-06T00:15:06.475ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
9552024-07-06T00:15:06.476ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
9562024-07-06T00:15:06.476ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9572024-07-06T00:15:06.476ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9582024-07-06T00:15:06.477ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, lookup_type: ById(ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c) }, key: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, lookup_type: ById(49d08b27-316b-4c97-97fd-dd3a8bf02b58) } result = Ok(())
9592024-07-06T00:15:06.477ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
9602024-07-06T00:15:06.477ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
9612024-07-06T00:15:06.477ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9622024-07-06T00:15:06.477ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9632024-07-06T00:15:06.477ZWARNnexus (BackgroundTasks): physical disk adoption task started background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:100
9642024-07-06T00:15:06.477ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
9652024-07-06T00:15:06.477ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
9662024-07-06T00:15:06.477ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
9672024-07-06T00:15:06.478ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
9682024-07-06T00:15:06.478ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
9692024-07-06T00:15:06.478ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
9702024-07-06T00:15:06.478ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
9712024-07-06T00:15:06.478ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
9722024-07-06T00:15:06.478ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
9732024-07-06T00:15:06.479ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
9742024-07-06T00:15:06.480ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
9752024-07-06T00:15:06.480ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
9762024-07-06T00:15:06.480ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
9772024-07-06T00:15:06.484ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9782024-07-06T00:15:06.484ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
9792024-07-06T00:15:06.484ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:480 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0
9802024-07-06T00:15:06.485ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
9812024-07-06T00:15:06.485ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
9822024-07-06T00:15:06.485ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 21.012785ms iteration = 15
9832024-07-06T00:15:06.485ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
9842024-07-06T00:15:06.485ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4d88c6ce-c5a2-418b-b915-09fea24f811c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-4d88c6ce-c5a2-418b-b915-09fea24f811c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 2285, tv_nsec: 118928757 } })
9852024-07-06T00:15:06.486ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9862024-07-06T00:15:06.487ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1014 rack_id = 444442ff-30f3-4f30-9be3-25f64879f808
9872024-07-06T00:15:06.487ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
9882024-07-06T00:15:06.487ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
9892024-07-06T00:15:06.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
9902024-07-06T00:15:06.489ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9912024-07-06T00:15:06.489ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9922024-07-06T00:15:06.490ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9932024-07-06T00:15:06.491ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
9942024-07-06T00:15:06.491ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9952024-07-06T00:15:06.491ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
9962024-07-06T00:15:06.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
9972024-07-06T00:15:06.492ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
9982024-07-06T00:15:06.493ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
9992024-07-06T00:15:06.493ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10002024-07-06T00:15:06.493ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10012024-07-06T00:15:06.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10022024-07-06T00:15:06.493ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
10032024-07-06T00:15:06.495ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 19924212-3af7-4ff8-94f5-f62e5472fa7b, lookup_type: ById(19924212-3af7-4ff8-94f5-f62e5472fa7b) } result = Ok(())
10042024-07-06T00:15:06.495ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10052024-07-06T00:15:06.495ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
10062024-07-06T00:15:06.495ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
10072024-07-06T00:15:06.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10082024-07-06T00:15:06.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
10092024-07-06T00:15:06.496ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, lookup_type: ById(ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c) } result = Ok(())
10102024-07-06T00:15:06.496ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
10112024-07-06T00:15:06.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
10122024-07-06T00:15:06.496ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
10132024-07-06T00:15:06.496ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
10142024-07-06T00:15:06.496ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
10152024-07-06T00:15:06.496ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
10162024-07-06T00:15:06.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
10172024-07-06T00:15:06.497ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
10182024-07-06T00:15:06.498ZDEBGnexus (dropshot_external): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 2db45677-b17c-45ab-a2be-44cd32e25661 roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-d35d69fc246&vpc=default
10192024-07-06T00:15:06.498ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10202024-07-06T00:15:06.498ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
10212024-07-06T00:15:06.498ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = b23108f8-8976-42f5-b936-c6164231772a dns_zone_name = oxide.test found_so_far = 0 version = 2
10222024-07-06T00:15:06.498ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
10232024-07-06T00:15:06.498ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 2db45677-b17c-45ab-a2be-44cd32e25661 resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-d35d69fc246&vpc=default
10242024-07-06T00:15:06.498ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10252024-07-06T00:15:06.498ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
10262024-07-06T00:15:06.499ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
10272024-07-06T00:15:06.499ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = abfdb766-11a5-43b8-8197-e24788797466 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
10282024-07-06T00:15:06.499ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
10292024-07-06T00:15:06.499ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
10302024-07-06T00:15:06.499ZDEBGnexus (dropshot_external): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 2db45677-b17c-45ab-a2be-44cd32e25661 roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-d35d69fc246&vpc=default
10312024-07-06T00:15:06.500ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10322024-07-06T00:15:06.500ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 2db45677-b17c-45ab-a2be-44cd32e25661 resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-d35d69fc246&vpc=default
10332024-07-06T00:15:06.501ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10342024-07-06T00:15:06.501ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
10352024-07-06T00:15:06.501ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
10362024-07-06T00:15:06.501ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
10372024-07-06T00:15:06.501ZDEBGnexus (dropshot_external): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 2db45677-b17c-45ab-a2be-44cd32e25661 roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-d35d69fc246&vpc=default
10382024-07-06T00:15:06.502ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
10392024-07-06T00:15:06.502ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
10402024-07-06T00:15:06.502ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 2db45677-b17c-45ab-a2be-44cd32e25661 resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-d35d69fc246&vpc=default
10412024-07-06T00:15:06.502ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
10422024-07-06T00:15:06.502ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 19924212-3af7-4ff8-94f5-f62e5472fa7b original_time_created = 2024-07-06 00:07:55.490605 UTC target_id = 19924212-3af7-4ff8-94f5-f62e5472fa7b time_created = 2024-07-06 00:07:55.490605 UTC
10432024-07-06T00:15:06.502ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 38.573866ms iteration = 43
10442024-07-06T00:15:06.503ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10452024-07-06T00:15:06.504ZDEBGnexus (dropshot_external): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 2db45677-b17c-45ab-a2be-44cd32e25661 roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-d35d69fc246&vpc=default
10462024-07-06T00:15:06.504ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10472024-07-06T00:15:06.504ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 2db45677-b17c-45ab-a2be-44cd32e25661 resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-d35d69fc246&vpc=default
10482024-07-06T00:15:06.504ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
10492024-07-06T00:15:06.504ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
10502024-07-06T00:15:06.504ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10512024-07-06T00:15:06.504ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
10522024-07-06T00:15:06.505ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
10532024-07-06T00:15:06.505ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
10542024-07-06T00:15:06.505ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
10552024-07-06T00:15:06.505ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
10562024-07-06T00:15:06.505ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
10572024-07-06T00:15:06.505ZWARNnexus (BackgroundTasks): physical disk adoption task done background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:174
10582024-07-06T00:15:06.505ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 41.768867ms iteration = 16
10592024-07-06T00:15:06.505ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
10602024-07-06T00:15:06.506ZDEBGnexus (dropshot_external): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 2db45677-b17c-45ab-a2be-44cd32e25661 roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-d35d69fc246&vpc=default
10612024-07-06T00:15:06.506ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10622024-07-06T00:15:06.506ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 2db45677-b17c-45ab-a2be-44cd32e25661 resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-d35d69fc246&vpc=default
10632024-07-06T00:15:06.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10642024-07-06T00:15:06.506ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = b23108f8-8976-42f5-b936-c6164231772a dns_zone_name = oxide.test found_so_far = 1 version = 2
10652024-07-06T00:15:06.506ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
10662024-07-06T00:15:06.506ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-07-06 00:08:56.860219 UTC dns_group = external generation = 2
10672024-07-06T00:15:06.506ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 42.655051ms iteration = 8
10682024-07-06T00:15:06.507ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = abfdb766-11a5-43b8-8197-e24788797466 dns_zone_name = control-plane.oxide.internal found_so_far = 49 version = 1
10692024-07-06T00:15:06.507ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
10702024-07-06T00:15:06.507ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-07-06 00:08:56.318024 UTC dns_group = internal generation = 1
10712024-07-06T00:15:06.507ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 43.309891ms iteration = 8
10722024-07-06T00:15:06.507ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10732024-07-06T00:15:06.507ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-07-06T00:08:05.356130Z, time_modified: 2024-07-06T00:08:05.356130Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, db_silo: Silo { identity: SiloIdentity { id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-07-06T00:08:56.821246Z, time_modified: 2024-07-06T00:08:56.821246Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "928ad9190931080b8e93bf47b49904baa52843f842ab23f7e48563bc4b1cb506" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, db_silo: Silo { identity: SiloIdentity { id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-07-06T00:08:56.821246Z, time_modified: 2024-07-06T00:08:56.821246Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "928ad9190931080b8e93bf47b49904baa52843f842ab23f7e48563bc4b1cb506" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
10742024-07-06T00:15:06.507ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 43.975042ms iteration = 8
10752024-07-06T00:15:06.508ZDEBGnexus (dropshot_external): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 2db45677-b17c-45ab-a2be-44cd32e25661 roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-d35d69fc246&vpc=default
10762024-07-06T00:15:06.508ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 2db45677-b17c-45ab-a2be-44cd32e25661 resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-d35d69fc246&vpc=default
10772024-07-06T00:15:06.509ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 4d88c6ce-c5a2-418b-b915-09fea24f811c, lookup_type: ById(4d88c6ce-c5a2-418b-b915-09fea24f811c) } result = Ok(())
10782024-07-06T00:15:06.509ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10792024-07-06T00:15:06.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10802024-07-06T00:15:06.510ZDEBGnexus (dropshot_external): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 2db45677-b17c-45ab-a2be-44cd32e25661 roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-d35d69fc246&vpc=default
10812024-07-06T00:15:06.511ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 2db45677-b17c-45ab-a2be-44cd32e25661 resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-d35d69fc246&vpc=default
10822024-07-06T00:15:06.511ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 47.160723ms iteration = 15
10832024-07-06T00:15:06.512ZDEBGnexus (dropshot_external): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 2db45677-b17c-45ab-a2be-44cd32e25661 roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-d35d69fc246&vpc=default
10842024-07-06T00:15:06.513ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 2db45677-b17c-45ab-a2be-44cd32e25661 resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-d35d69fc246&vpc=default
10852024-07-06T00:15:06.515ZDEBGnexus (dropshot_external): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 2db45677-b17c-45ab-a2be-44cd32e25661 roles = RoleSet { roles: {(Silo, ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, "admin")} } uri = /v1/vpc-subnets/default?project=proj-d35d69fc246&vpc=default
10862024-07-06T00:15:06.519ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 2db45677-b17c-45ab-a2be-44cd32e25661 resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, lookup_type: ById(ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c) }, key: aac9ad5c-0170-42a6-930f-2f05e44928f2, lookup_type: ByName("proj-d35d69fc246") }, key: a669193e-6043-4b94-b09b-33e5fdd476e5, lookup_type: ByName("default") }, key: cff097ed-0f87-45fb-bda3-e441edc3c6d3, lookup_type: ByName("default") } result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-d35d69fc246&vpc=default
10872024-07-06T00:15:06.519ZDEBGnexus (dropshot_external): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 2db45677-b17c-45ab-a2be-44cd32e25661 roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-d35d69fc246&vpc=default
10882024-07-06T00:15:06.519ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 2db45677-b17c-45ab-a2be-44cd32e25661 resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-d35d69fc246&vpc=default
10892024-07-06T00:15:06.521ZDEBGnexus (dropshot_external): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 2db45677-b17c-45ab-a2be-44cd32e25661 roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-d35d69fc246&vpc=default
10902024-07-06T00:15:06.521ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 2db45677-b17c-45ab-a2be-44cd32e25661 resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-d35d69fc246&vpc=default
10912024-07-06T00:15:06.523ZDEBGnexus (dropshot_external): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 2db45677-b17c-45ab-a2be-44cd32e25661 roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-d35d69fc246&vpc=default
10922024-07-06T00:15:06.523ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 2db45677-b17c-45ab-a2be-44cd32e25661 resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-d35d69fc246&vpc=default
10932024-07-06T00:15:06.525ZDEBGnexus (dropshot_external): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 2db45677-b17c-45ab-a2be-44cd32e25661 roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-d35d69fc246&vpc=default
10942024-07-06T00:15:06.525ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 2db45677-b17c-45ab-a2be-44cd32e25661 resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-d35d69fc246&vpc=default
10952024-07-06T00:15:06.527ZDEBGnexus (dropshot_external): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 2db45677-b17c-45ab-a2be-44cd32e25661 roles = RoleSet { roles: {(Silo, ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, "admin")} } uri = /v1/vpc-subnets/default?project=proj-d35d69fc246&vpc=default
10962024-07-06T00:15:06.530ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 2db45677-b17c-45ab-a2be-44cd32e25661 resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, lookup_type: ById(ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c) }, key: aac9ad5c-0170-42a6-930f-2f05e44928f2, lookup_type: ByName("proj-d35d69fc246") }, key: a669193e-6043-4b94-b09b-33e5fdd476e5, lookup_type: ByName("default") }, key: cff097ed-0f87-45fb-bda3-e441edc3c6d3, lookup_type: ByName("default") } result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-d35d69fc246&vpc=default
10972024-07-06T00:15:06.530ZDEBGnexus (dropshot_external): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 2db45677-b17c-45ab-a2be-44cd32e25661 roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-d35d69fc246&vpc=default
10982024-07-06T00:15:06.530ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 2db45677-b17c-45ab-a2be-44cd32e25661 resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-d35d69fc246&vpc=default
10992024-07-06T00:15:06.531ZDEBGnexus (dropshot_external): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 2db45677-b17c-45ab-a2be-44cd32e25661 roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-d35d69fc246&vpc=default
11002024-07-06T00:15:06.531ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 2db45677-b17c-45ab-a2be-44cd32e25661 resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-d35d69fc246&vpc=default
11012024-07-06T00:15:06.547ZDEBGnexus (dropshot_external): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 2db45677-b17c-45ab-a2be-44cd32e25661 roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-d35d69fc246&vpc=default
11022024-07-06T00:15:06.547ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 2db45677-b17c-45ab-a2be-44cd32e25661 resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-d35d69fc246&vpc=default
11032024-07-06T00:15:06.588ZDEBGnexus (dropshot_external): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 2db45677-b17c-45ab-a2be-44cd32e25661 roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-d35d69fc246&vpc=default
11042024-07-06T00:15:06.589ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 2db45677-b17c-45ab-a2be-44cd32e25661 resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-d35d69fc246&vpc=default
11052024-07-06T00:15:06.600ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/6a3f84c/dropshot/src/server.rs:878 latency_us = 159420 local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = 2db45677-b17c-45ab-a2be-44cd32e25661 response_code = 204 uri = /v1/vpc-subnets/default?project=proj-d35d69fc246&vpc=default
11062024-07-06T00:15:06.601ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
11072024-07-06T00:15:06.602ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
11082024-07-06T00:15:06.603ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
11092024-07-06T00:15:06.603ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
11102024-07-06T00:15:06.604ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
11112024-07-06T00:15:06.605ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "871c52af06a2f4799eefbb9da74e17d3a62de46e", lookup_type: ByCompositeId("token = \\"871c52af06a2f4799eefbb9da74e17d3a62de46e\\"") } result = Ok(())
11122024-07-06T00:15:06.605ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
11132024-07-06T00:15:06.605ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
11142024-07-06T00:15:06.606ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
11152024-07-06T00:15:06.606ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
11162024-07-06T00:15:06.608ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
11172024-07-06T00:15:06.608ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
11182024-07-06T00:15:06.609ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
11192024-07-06T00:15:06.609ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
11202024-07-06T00:15:06.610ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
11212024-07-06T00:15:06.611ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, lookup_type: ById(ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c) }, key: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, lookup_type: ById(49d08b27-316b-4c97-97fd-dd3a8bf02b58) } result = Ok(())
11222024-07-06T00:15:06.611ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
11232024-07-06T00:15:06.612ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
11242024-07-06T00:15:06.613ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
11252024-07-06T00:15:06.614ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "871c52af06a2f4799eefbb9da74e17d3a62de46e", lookup_type: ByCompositeId("871c52af06a2f4799eefbb9da74e17d3a62de46e") } result = Ok(())
11262024-07-06T00:15:06.614ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
11272024-07-06T00:15:06.614ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
11282024-07-06T00:15:06.620ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
11292024-07-06T00:15:06.620ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
11302024-07-06T00:15:06.621ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
11312024-07-06T00:15:06.621ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
11322024-07-06T00:15:06.622ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
11332024-07-06T00:15:06.622ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
11342024-07-06T00:15:06.623ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
11352024-07-06T00:15:06.624ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
11362024-07-06T00:15:06.625ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
11372024-07-06T00:15:06.626ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, lookup_type: ById(ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c) }, key: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, lookup_type: ById(49d08b27-316b-4c97-97fd-dd3a8bf02b58) } result = Ok(())
11382024-07-06T00:15:06.626ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
11392024-07-06T00:15:06.626ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
11402024-07-06T00:15:06.627ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
11412024-07-06T00:15:06.627ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
11422024-07-06T00:15:06.628ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
11432024-07-06T00:15:06.628ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
11442024-07-06T00:15:06.629ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
11452024-07-06T00:15:06.630ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, lookup_type: ById(ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c) } result = Ok(())
11462024-07-06T00:15:06.630ZDEBGnexus (dropshot_external): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = e8372e65-aec0-4f62-855b-87b3f05b22ea roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-d35d69fc246
11472024-07-06T00:15:06.631ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = e8372e65-aec0-4f62-855b-87b3f05b22ea resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-d35d69fc246
11482024-07-06T00:15:06.632ZDEBGnexus (dropshot_external): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = e8372e65-aec0-4f62-855b-87b3f05b22ea roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-d35d69fc246
11492024-07-06T00:15:06.632ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = e8372e65-aec0-4f62-855b-87b3f05b22ea resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-d35d69fc246
11502024-07-06T00:15:06.633ZDEBGnexus (dropshot_external): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = e8372e65-aec0-4f62-855b-87b3f05b22ea roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-d35d69fc246
11512024-07-06T00:15:06.633ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = e8372e65-aec0-4f62-855b-87b3f05b22ea resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-d35d69fc246
11522024-07-06T00:15:06.635ZDEBGnexus (dropshot_external): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = e8372e65-aec0-4f62-855b-87b3f05b22ea roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-d35d69fc246
11532024-07-06T00:15:06.635ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = e8372e65-aec0-4f62-855b-87b3f05b22ea resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-d35d69fc246
11542024-07-06T00:15:06.637ZDEBGnexus (dropshot_external): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = e8372e65-aec0-4f62-855b-87b3f05b22ea roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-d35d69fc246
11552024-07-06T00:15:06.637ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = e8372e65-aec0-4f62-855b-87b3f05b22ea resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-d35d69fc246
11562024-07-06T00:15:06.639ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
11572024-07-06T00:15:06.639ZDEBGnexus (dropshot_external): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = e8372e65-aec0-4f62-855b-87b3f05b22ea roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-d35d69fc246
11582024-07-06T00:15:06.639ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = e8372e65-aec0-4f62-855b-87b3f05b22ea resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-d35d69fc246
11592024-07-06T00:15:06.641ZDEBGnexus (dropshot_external): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = e8372e65-aec0-4f62-855b-87b3f05b22ea roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-d35d69fc246
11602024-07-06T00:15:06.641ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = e8372e65-aec0-4f62-855b-87b3f05b22ea resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-d35d69fc246
11612024-07-06T00:15:06.643ZDEBGnexus (dropshot_external): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = e8372e65-aec0-4f62-855b-87b3f05b22ea roles = RoleSet { roles: {(Silo, ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, "admin")} } uri = /v1/vpcs/default?project=proj-d35d69fc246
11622024-07-06T00:15:06.644ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
11632024-07-06T00:15:06.646ZDEBGnexus (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = e8372e65-aec0-4f62-855b-87b3f05b22ea resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, lookup_type: ById(ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c) }, key: aac9ad5c-0170-42a6-930f-2f05e44928f2, lookup_type: ByName("proj-d35d69fc246") }, key: a669193e-6043-4b94-b09b-33e5fdd476e5, lookup_type: ByName("default") } result = Ok(()) uri = /v1/vpcs/default?project=proj-d35d69fc246
11642024-07-06T00:15:06.646ZDEBGnexus (dropshot_external): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = e8372e65-aec0-4f62-855b-87b3f05b22ea roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-d35d69fc246
11652024-07-06T00:15:06.646ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = e8372e65-aec0-4f62-855b-87b3f05b22ea resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-d35d69fc246
11662024-07-06T00:15:06.648ZDEBGnexus (dropshot_external): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = e8372e65-aec0-4f62-855b-87b3f05b22ea roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-d35d69fc246
11672024-07-06T00:15:06.648ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = e8372e65-aec0-4f62-855b-87b3f05b22ea resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-d35d69fc246
11682024-07-06T00:15:06.650ZDEBGnexus (dropshot_external): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = e8372e65-aec0-4f62-855b-87b3f05b22ea roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-d35d69fc246
11692024-07-06T00:15:06.650ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = e8372e65-aec0-4f62-855b-87b3f05b22ea resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-d35d69fc246
11702024-07-06T00:15:06.652ZDEBGnexus (dropshot_external): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = e8372e65-aec0-4f62-855b-87b3f05b22ea roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-d35d69fc246
11712024-07-06T00:15:06.652ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = e8372e65-aec0-4f62-855b-87b3f05b22ea resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-d35d69fc246
11722024-07-06T00:15:06.654ZDEBGnexus (dropshot_external): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = e8372e65-aec0-4f62-855b-87b3f05b22ea roles = RoleSet { roles: {(Silo, ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, "admin")} } uri = /v1/vpcs/default?project=proj-d35d69fc246
11732024-07-06T00:15:06.657ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = e8372e65-aec0-4f62-855b-87b3f05b22ea resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, lookup_type: ById(ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c) }, key: aac9ad5c-0170-42a6-930f-2f05e44928f2, lookup_type: ByName("proj-d35d69fc246") }, key: a669193e-6043-4b94-b09b-33e5fdd476e5, lookup_type: ByName("default") } result = Ok(()) uri = /v1/vpcs/default?project=proj-d35d69fc246
11742024-07-06T00:15:06.657ZDEBGnexus (dropshot_external): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = e8372e65-aec0-4f62-855b-87b3f05b22ea roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-d35d69fc246
11752024-07-06T00:15:06.657ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = e8372e65-aec0-4f62-855b-87b3f05b22ea resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-d35d69fc246
11762024-07-06T00:15:06.658ZDEBGnexus (dropshot_external): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = e8372e65-aec0-4f62-855b-87b3f05b22ea roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-d35d69fc246
11772024-07-06T00:15:06.658ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = e8372e65-aec0-4f62-855b-87b3f05b22ea resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-d35d69fc246
11782024-07-06T00:15:06.668ZDEBGnexus (dropshot_external): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = e8372e65-aec0-4f62-855b-87b3f05b22ea roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-d35d69fc246
11792024-07-06T00:15:06.668ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = e8372e65-aec0-4f62-855b-87b3f05b22ea resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-d35d69fc246
11802024-07-06T00:15:06.670ZDEBGnexus (dropshot_external): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = e8372e65-aec0-4f62-855b-87b3f05b22ea roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-d35d69fc246
11812024-07-06T00:15:06.670ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = e8372e65-aec0-4f62-855b-87b3f05b22ea resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-d35d69fc246
11822024-07-06T00:15:06.672ZDEBGnexus (dropshot_external): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = e8372e65-aec0-4f62-855b-87b3f05b22ea roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-d35d69fc246
11832024-07-06T00:15:06.672ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = e8372e65-aec0-4f62-855b-87b3f05b22ea resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-d35d69fc246
11842024-07-06T00:15:06.676ZDEBGnexus (dropshot_external): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = e8372e65-aec0-4f62-855b-87b3f05b22ea roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-d35d69fc246
11852024-07-06T00:15:06.676ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = e8372e65-aec0-4f62-855b-87b3f05b22ea resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-d35d69fc246
11862024-07-06T00:15:06.678ZDEBGnexus (dropshot_external): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = e8372e65-aec0-4f62-855b-87b3f05b22ea roles = RoleSet { roles: {(Silo, ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, "admin")} } uri = /v1/vpcs/default?project=proj-d35d69fc246
11872024-07-06T00:15:06.681ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = e8372e65-aec0-4f62-855b-87b3f05b22ea resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, lookup_type: ById(ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c) }, key: aac9ad5c-0170-42a6-930f-2f05e44928f2, lookup_type: ByName("proj-d35d69fc246") }, key: a669193e-6043-4b94-b09b-33e5fdd476e5, lookup_type: ByName("default") }, key: dcd8ce8c-31b3-4791-b3b8-74e6e55e14ea, lookup_type: ById(dcd8ce8c-31b3-4791-b3b8-74e6e55e14ea) } result = Ok(()) uri = /v1/vpcs/default?project=proj-d35d69fc246
11882024-07-06T00:15:06.681ZDEBGnexus (dropshot_external): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = e8372e65-aec0-4f62-855b-87b3f05b22ea roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-d35d69fc246
11892024-07-06T00:15:06.681ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = e8372e65-aec0-4f62-855b-87b3f05b22ea resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-d35d69fc246
11902024-07-06T00:15:06.688ZDEBGnexus (dropshot_external): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = e8372e65-aec0-4f62-855b-87b3f05b22ea roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-d35d69fc246
11912024-07-06T00:15:06.688ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = e8372e65-aec0-4f62-855b-87b3f05b22ea resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-d35d69fc246
11922024-07-06T00:15:06.696ZDEBGnexus (dropshot_external): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = e8372e65-aec0-4f62-855b-87b3f05b22ea roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-d35d69fc246
11932024-07-06T00:15:06.696ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = e8372e65-aec0-4f62-855b-87b3f05b22ea resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-d35d69fc246
11942024-07-06T00:15:06.698ZDEBGnexus (dropshot_external): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = e8372e65-aec0-4f62-855b-87b3f05b22ea roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-d35d69fc246
11952024-07-06T00:15:06.698ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = e8372e65-aec0-4f62-855b-87b3f05b22ea resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-d35d69fc246
11962024-07-06T00:15:06.700ZDEBGnexus (dropshot_external): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = e8372e65-aec0-4f62-855b-87b3f05b22ea roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-d35d69fc246
11972024-07-06T00:15:06.701ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = e8372e65-aec0-4f62-855b-87b3f05b22ea resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-d35d69fc246
11982024-07-06T00:15:06.703ZDEBGnexus (dropshot_external): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = e8372e65-aec0-4f62-855b-87b3f05b22ea roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-d35d69fc246
11992024-07-06T00:15:06.703ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = e8372e65-aec0-4f62-855b-87b3f05b22ea resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-d35d69fc246
12002024-07-06T00:15:06.704ZDEBGnexus (dropshot_external): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = e8372e65-aec0-4f62-855b-87b3f05b22ea roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-d35d69fc246
12012024-07-06T00:15:06.705ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = e8372e65-aec0-4f62-855b-87b3f05b22ea resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-d35d69fc246
12022024-07-06T00:15:06.706ZDEBGnexus (dropshot_external): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = e8372e65-aec0-4f62-855b-87b3f05b22ea roles = RoleSet { roles: {(Silo, ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, "admin")} } uri = /v1/vpcs/default?project=proj-d35d69fc246
12032024-07-06T00:15:06.709ZDEBGnexus (dropshot_external): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = e8372e65-aec0-4f62-855b-87b3f05b22ea resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, lookup_type: ById(ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c) }, key: aac9ad5c-0170-42a6-930f-2f05e44928f2, lookup_type: ByName("proj-d35d69fc246") }, key: a669193e-6043-4b94-b09b-33e5fdd476e5, lookup_type: ByName("default") } result = Ok(()) uri = /v1/vpcs/default?project=proj-d35d69fc246
12042024-07-06T00:15:06.709ZDEBGnexus (dropshot_external): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = e8372e65-aec0-4f62-855b-87b3f05b22ea roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-d35d69fc246
12052024-07-06T00:15:06.709ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = e8372e65-aec0-4f62-855b-87b3f05b22ea resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-d35d69fc246
12062024-07-06T00:15:06.714ZDEBGnexus (BackgroundTasks): client request SledAgent = 4d88c6ce-c5a2-418b-b915-09fea24f811c background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
12072024-07-06T00:15:06.714ZDEBGnexus (BackgroundTasks): client response SledAgent = 4d88c6ce-c5a2-418b-b915-09fea24f811c background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "ccf58673-2e83-4331-9d75-aacff0c0ef85", "content-length": "691", "date": "Sat, 06 Jul 2024 00:15:06 GMT"} })
12082024-07-06T00:15:06.714ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
12092024-07-06T00:15:06.714ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
12102024-07-06T00:15:06.714ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
12112024-07-06T00:15:06.716ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 252.822517ms iteration = 17
12122024-07-06T00:15:06.717ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/6a3f84c/dropshot/src/server.rs:878 latency_us = 115723 local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = e8372e65-aec0-4f62-855b-87b3f05b22ea response_code = 204 uri = /v1/vpcs/default?project=proj-d35d69fc246
12132024-07-06T00:15:06.720ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
12142024-07-06T00:15:06.720ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
12152024-07-06T00:15:06.721ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
12162024-07-06T00:15:06.721ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
12172024-07-06T00:15:06.722ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
12182024-07-06T00:15:06.723ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "871c52af06a2f4799eefbb9da74e17d3a62de46e", lookup_type: ByCompositeId("token = \\"871c52af06a2f4799eefbb9da74e17d3a62de46e\\"") } result = Ok(())
12192024-07-06T00:15:06.723ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
12202024-07-06T00:15:06.724ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
12212024-07-06T00:15:06.725ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
12222024-07-06T00:15:06.725ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
12232024-07-06T00:15:06.726ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
12242024-07-06T00:15:06.727ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
12252024-07-06T00:15:06.728ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
12262024-07-06T00:15:06.728ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
12272024-07-06T00:15:06.729ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
12282024-07-06T00:15:06.730ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, lookup_type: ById(ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c) }, key: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, lookup_type: ById(49d08b27-316b-4c97-97fd-dd3a8bf02b58) } result = Ok(())
12292024-07-06T00:15:06.730ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
12302024-07-06T00:15:06.730ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
12312024-07-06T00:15:06.732ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
12322024-07-06T00:15:06.733ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "871c52af06a2f4799eefbb9da74e17d3a62de46e", lookup_type: ByCompositeId("871c52af06a2f4799eefbb9da74e17d3a62de46e") } result = Ok(())
12332024-07-06T00:15:06.733ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
12342024-07-06T00:15:06.733ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
12352024-07-06T00:15:06.739ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
12362024-07-06T00:15:06.739ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
12372024-07-06T00:15:06.741ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
12382024-07-06T00:15:06.741ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
12392024-07-06T00:15:06.742ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
12402024-07-06T00:15:06.742ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
12412024-07-06T00:15:06.744ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
12422024-07-06T00:15:06.744ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
12432024-07-06T00:15:06.745ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
12442024-07-06T00:15:06.747ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, lookup_type: ById(ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c) }, key: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, lookup_type: ById(49d08b27-316b-4c97-97fd-dd3a8bf02b58) } result = Ok(())
12452024-07-06T00:15:06.747ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
12462024-07-06T00:15:06.747ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
12472024-07-06T00:15:06.748ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
12482024-07-06T00:15:06.749ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
12492024-07-06T00:15:06.750ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
12502024-07-06T00:15:06.750ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
12512024-07-06T00:15:06.751ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
12522024-07-06T00:15:06.752ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, lookup_type: ById(ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c) } result = Ok(())
12532024-07-06T00:15:06.752ZDEBGnexus (dropshot_external): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = c8375ae7-53ca-427a-8ea0-f56893abcc56 roles = RoleSet { roles: {} } uri = /v1/projects/proj-d35d69fc246
12542024-07-06T00:15:06.753ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = c8375ae7-53ca-427a-8ea0-f56893abcc56 resource = Database result = Ok(()) uri = /v1/projects/proj-d35d69fc246
12552024-07-06T00:15:06.754ZDEBGnexus (dropshot_external): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = c8375ae7-53ca-427a-8ea0-f56893abcc56 roles = RoleSet { roles: {} } uri = /v1/projects/proj-d35d69fc246
12562024-07-06T00:15:06.754ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = c8375ae7-53ca-427a-8ea0-f56893abcc56 resource = Database result = Ok(()) uri = /v1/projects/proj-d35d69fc246
12572024-07-06T00:15:06.756ZDEBGnexus (dropshot_external): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = c8375ae7-53ca-427a-8ea0-f56893abcc56 roles = RoleSet { roles: {} } uri = /v1/projects/proj-d35d69fc246
12582024-07-06T00:15:06.756ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = c8375ae7-53ca-427a-8ea0-f56893abcc56 resource = Database result = Ok(()) uri = /v1/projects/proj-d35d69fc246
12592024-07-06T00:15:06.758ZDEBGnexus (dropshot_external): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = c8375ae7-53ca-427a-8ea0-f56893abcc56 roles = RoleSet { roles: {} } uri = /v1/projects/proj-d35d69fc246
12602024-07-06T00:15:06.759ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = c8375ae7-53ca-427a-8ea0-f56893abcc56 resource = Database result = Ok(()) uri = /v1/projects/proj-d35d69fc246
12612024-07-06T00:15:06.761ZDEBGnexus (dropshot_external): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = c8375ae7-53ca-427a-8ea0-f56893abcc56 roles = RoleSet { roles: {} } uri = /v1/projects/proj-d35d69fc246
12622024-07-06T00:15:06.761ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = c8375ae7-53ca-427a-8ea0-f56893abcc56 resource = Database result = Ok(()) uri = /v1/projects/proj-d35d69fc246
12632024-07-06T00:15:06.763ZDEBGnexus (dropshot_external): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = c8375ae7-53ca-427a-8ea0-f56893abcc56 roles = RoleSet { roles: {} } uri = /v1/projects/proj-d35d69fc246
12642024-07-06T00:15:06.763ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = c8375ae7-53ca-427a-8ea0-f56893abcc56 resource = Database result = Ok(()) uri = /v1/projects/proj-d35d69fc246
12652024-07-06T00:15:06.766ZDEBGnexus (dropshot_external): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = c8375ae7-53ca-427a-8ea0-f56893abcc56 roles = RoleSet { roles: {(Silo, ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, "admin")} } uri = /v1/projects/proj-d35d69fc246
12662024-07-06T00:15:06.769ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = c8375ae7-53ca-427a-8ea0-f56893abcc56 resource = Project { parent: Silo { parent: Fleet, key: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, lookup_type: ById(ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c) }, key: aac9ad5c-0170-42a6-930f-2f05e44928f2, lookup_type: ByName("proj-d35d69fc246") } result = Ok(()) uri = /v1/projects/proj-d35d69fc246
12672024-07-06T00:15:06.769ZDEBGnexus (dropshot_external): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = c8375ae7-53ca-427a-8ea0-f56893abcc56 roles = RoleSet { roles: {} } uri = /v1/projects/proj-d35d69fc246
12682024-07-06T00:15:06.769ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = c8375ae7-53ca-427a-8ea0-f56893abcc56 resource = Database result = Ok(()) uri = /v1/projects/proj-d35d69fc246
12692024-07-06T00:15:06.771ZDEBGnexus (dropshot_external): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = c8375ae7-53ca-427a-8ea0-f56893abcc56 roles = RoleSet { roles: {} } uri = /v1/projects/proj-d35d69fc246
12702024-07-06T00:15:06.771ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = c8375ae7-53ca-427a-8ea0-f56893abcc56 resource = Database result = Ok(()) uri = /v1/projects/proj-d35d69fc246
12712024-07-06T00:15:06.773ZDEBGnexus (dropshot_external): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = c8375ae7-53ca-427a-8ea0-f56893abcc56 roles = RoleSet { roles: {} } uri = /v1/projects/proj-d35d69fc246
12722024-07-06T00:15:06.773ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = c8375ae7-53ca-427a-8ea0-f56893abcc56 resource = Database result = Ok(()) uri = /v1/projects/proj-d35d69fc246
12732024-07-06T00:15:06.775ZDEBGnexus (dropshot_external): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = c8375ae7-53ca-427a-8ea0-f56893abcc56 roles = RoleSet { roles: {} } uri = /v1/projects/proj-d35d69fc246
12742024-07-06T00:15:06.775ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = c8375ae7-53ca-427a-8ea0-f56893abcc56 resource = Database result = Ok(()) uri = /v1/projects/proj-d35d69fc246
12752024-07-06T00:15:06.777ZDEBGnexus (dropshot_external): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = c8375ae7-53ca-427a-8ea0-f56893abcc56 roles = RoleSet { roles: {(Silo, ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, "admin")} } uri = /v1/projects/proj-d35d69fc246
12762024-07-06T00:15:06.779ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = c8375ae7-53ca-427a-8ea0-f56893abcc56 resource = Project { parent: Silo { parent: Fleet, key: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, lookup_type: ById(ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c) }, key: aac9ad5c-0170-42a6-930f-2f05e44928f2, lookup_type: ByName("proj-d35d69fc246") } result = Ok(()) uri = /v1/projects/proj-d35d69fc246
12772024-07-06T00:15:06.779ZDEBGnexus (dropshot_external): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = c8375ae7-53ca-427a-8ea0-f56893abcc56 roles = RoleSet { roles: {} } uri = /v1/projects/proj-d35d69fc246
12782024-07-06T00:15:06.779ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = c8375ae7-53ca-427a-8ea0-f56893abcc56 resource = Database result = Ok(()) uri = /v1/projects/proj-d35d69fc246
12792024-07-06T00:15:06.780ZDEBGnexus (dropshot_external): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = c8375ae7-53ca-427a-8ea0-f56893abcc56 roles = RoleSet { roles: {} } uri = /v1/projects/proj-d35d69fc246
12802024-07-06T00:15:06.780ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = c8375ae7-53ca-427a-8ea0-f56893abcc56 resource = Database result = Ok(()) uri = /v1/projects/proj-d35d69fc246
12812024-07-06T00:15:06.782ZDEBGnexus (dropshot_external): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = c8375ae7-53ca-427a-8ea0-f56893abcc56 roles = RoleSet { roles: {} } uri = /v1/projects/proj-d35d69fc246
12822024-07-06T00:15:06.782ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = c8375ae7-53ca-427a-8ea0-f56893abcc56 resource = Database result = Ok(()) uri = /v1/projects/proj-d35d69fc246
12832024-07-06T00:15:06.783ZDEBGnexus (dropshot_external): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = c8375ae7-53ca-427a-8ea0-f56893abcc56 roles = RoleSet { roles: {} } uri = /v1/projects/proj-d35d69fc246
12842024-07-06T00:15:06.783ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = c8375ae7-53ca-427a-8ea0-f56893abcc56 resource = Database result = Ok(()) uri = /v1/projects/proj-d35d69fc246
12852024-07-06T00:15:06.785ZDEBGnexus (dropshot_external): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = c8375ae7-53ca-427a-8ea0-f56893abcc56 roles = RoleSet { roles: {} } uri = /v1/projects/proj-d35d69fc246
12862024-07-06T00:15:06.785ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = c8375ae7-53ca-427a-8ea0-f56893abcc56 resource = Database result = Ok(()) uri = /v1/projects/proj-d35d69fc246
12872024-07-06T00:15:06.787ZDEBGnexus (dropshot_external): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = c8375ae7-53ca-427a-8ea0-f56893abcc56 roles = RoleSet { roles: {} } uri = /v1/projects/proj-d35d69fc246
12882024-07-06T00:15:06.787ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = c8375ae7-53ca-427a-8ea0-f56893abcc56 resource = Database result = Ok(()) uri = /v1/projects/proj-d35d69fc246
12892024-07-06T00:15:06.788ZDEBGnexus (dropshot_external): roles actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = c8375ae7-53ca-427a-8ea0-f56893abcc56 roles = RoleSet { roles: {} } uri = /v1/projects/proj-d35d69fc246
12902024-07-06T00:15:06.788ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 49d08b27-316b-4c97-97fd-dd3a8bf02b58, silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, .. }) actor_id = 49d08b27-316b-4c97-97fd-dd3a8bf02b58 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = c8375ae7-53ca-427a-8ea0-f56893abcc56 resource = Database result = Ok(()) uri = /v1/projects/proj-d35d69fc246
12912024-07-06T00:15:06.798ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1022 zone_address = fd00:1122:3344:101::2
12922024-07-06T00:15:06.798ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
12932024-07-06T00:15:06.799ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "d0c67cd6-3e63-453f-b2f4-fd649f81b63b", "content-length": "26", "date": "Sat, 06 Jul 2024 00:15:05 GMT"} })
12942024-07-06T00:15:06.799ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1027 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
12952024-07-06T00:15:06.800ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/6a3f84c/dropshot/src/server.rs:878 latency_us = 82298 local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:49064 req_id = c8375ae7-53ca-427a-8ea0-f56893abcc56 response_code = 204 uri = /v1/projects/proj-d35d69fc246
12962024-07-06T00:15:06.801ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1059 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
12972024-07-06T00:15:06.807ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1022 zone_address = fd00:1122:3344:101::2
12982024-07-06T00:15:06.807ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
12992024-07-06T00:15:06.807ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "38de3e99-d4d1-46ce-bd3d-275491468e52", "content-length": "26", "date": "Sat, 06 Jul 2024 00:15:05 GMT"} })
13002024-07-06T00:15:06.807ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1027 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
13012024-07-06T00:15:06.809ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1059 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
13022024-07-06T00:15:06.811ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
13032024-07-06T00:15:06.811ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::8)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "0fbf4457-c8f9-4c00-b9ec-c1b703c3790a", "date": "Sat, 06 Jul 2024 00:15:06 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
13042024-07-06T00:15:06.811ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
13052024-07-06T00:15:06.813ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::9)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "85d1f98b-c2be-41ee-8c17-c8a86763ccae", "date": "Sat, 06 Jul 2024 00:15:06 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
13062024-07-06T00:15:06.813ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
13072024-07-06T00:15:06.815ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
13082024-07-06T00:15:06.815ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 351.069346ms iteration = 10
13092024-07-06T00:15:06.821ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1022 rack_id = 444442ff-30f3-4f30-9be3-25f64879f808 zone_address = fd00:1122:3344:101::2
13102024-07-06T00:15:06.821ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 444442ff-30f3-4f30-9be3-25f64879f808 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
13112024-07-06T00:15:06.822ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 444442ff-30f3-4f30-9be3-25f64879f808 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "97438b0a-0182-4227-8f75-86030c53305c", "content-length": "26", "date": "Sat, 06 Jul 2024 00:15:05 GMT"} })
13122024-07-06T00:15:06.822ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1027 rack_id = 444442ff-30f3-4f30-9be3-25f64879f808 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
13132024-07-06T00:15:06.822ZDEBGnexus (BackgroundTasks): client request SledAgent = 4d88c6ce-c5a2-418b-b915-09fea24f811c background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
13142024-07-06T00:15:06.823ZDEBGnexus (BackgroundTasks): client response SledAgent = 4d88c6ce-c5a2-418b-b915-09fea24f811c background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "cf9ec4bf-5a41-4d85-81ec-2aa7f3f11dba", "content-length": "372", "date": "Sat, 06 Jul 2024 00:15:06 GMT"} })
13152024-07-06T00:15:06.823ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13162024-07-06T00:15:06.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13172024-07-06T00:15:06.824ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1059 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 444442ff-30f3-4f30-9be3-25f64879f808
13182024-07-06T00:15:06.825ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13192024-07-06T00:15:06.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13202024-07-06T00:15:06.827ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
13212024-07-06T00:15:06.827ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13222024-07-06T00:15:06.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13232024-07-06T00:15:06.830ZDEBGnexus (BackgroundTasks): client request SledAgent = 4d88c6ce-c5a2-418b-b915-09fea24f811c background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
13242024-07-06T00:15:06.830ZDEBGnexus (BackgroundTasks): client response SledAgent = 4d88c6ce-c5a2-418b-b915-09fea24f811c background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "802a0d95-49b7-4bbc-b268-55a8f4905bd2", "date": "Sat, 06 Jul 2024 00:15:06 GMT"} })
13252024-07-06T00:15:06.832ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 368.527945ms iteration = 15
13262024-07-06T00:15:06.832ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 16 reason = Signaled
13272024-07-06T00:15:06.832ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13282024-07-06T00:15:06.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13292024-07-06T00:15:06.834ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13302024-07-06T00:15:06.835ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
13312024-07-06T00:15:06.835ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13322024-07-06T00:15:06.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13332024-07-06T00:15:06.837ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13342024-07-06T00:15:06.838ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
13352024-07-06T00:15:06.838ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13362024-07-06T00:15:06.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13372024-07-06T00:15:06.924ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 460.193578ms iteration = 15
13382024-07-06T00:15:06.933ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
13392024-07-06T00:15:06.933ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "74c5cda6-e8ee-446b-94e7-6069ec9caa15", "content-length": "2", "date": "Sat, 06 Jul 2024 00:15:06 GMT"} })
13402024-07-06T00:15:06.935ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
13412024-07-06T00:15:06.935ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
13422024-07-06T00:15:06.936ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 472.655868ms iteration = 15
13432024-07-06T00:15:07.042ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
13442024-07-06T00:15:07.043ZDEBGnexus (BackgroundTasks): client request SledAgent = 4d88c6ce-c5a2-418b-b915-09fea24f811c background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
13452024-07-06T00:15:07.043ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:2::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "38c50aaa-70b9-4263-8177-6934c6accd14", "date": "Sat, 06 Jul 2024 00:15:06 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
13462024-07-06T00:15:07.043ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
13472024-07-06T00:15:07.043ZDEBGnexus (BackgroundTasks): client response SledAgent = 4d88c6ce-c5a2-418b-b915-09fea24f811c background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "d50d9658-2917-43de-8eb0-ec188b5ef34d", "content-length": "372", "date": "Sat, 06 Jul 2024 00:15:06 GMT"} })
13482024-07-06T00:15:07.043ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13492024-07-06T00:15:07.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13502024-07-06T00:15:07.044ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:1::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "45e705c2-f679-4a8b-85e5-65d9f2cfe208", "date": "Sat, 06 Jul 2024 00:15:06 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
13512024-07-06T00:15:07.044ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
13522024-07-06T00:15:07.046ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13532024-07-06T00:15:07.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13542024-07-06T00:15:07.046ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:3::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "1ddb9dfa-c242-4c41-95c4-1800e3207b36", "date": "Sat, 06 Jul 2024 00:15:06 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
13552024-07-06T00:15:07.047ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
13562024-07-06T00:15:07.048ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13572024-07-06T00:15:07.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13582024-07-06T00:15:07.049ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
13592024-07-06T00:15:07.049ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 585.213635ms iteration = 10
13602024-07-06T00:15:07.052ZDEBGnexus (BackgroundTasks): client request SledAgent = 4d88c6ce-c5a2-418b-b915-09fea24f811c background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
13612024-07-06T00:15:07.052ZDEBGnexus (BackgroundTasks): client response SledAgent = 4d88c6ce-c5a2-418b-b915-09fea24f811c background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "2509dd3a-316a-47ac-a3f9-07dca2322b34", "date": "Sat, 06 Jul 2024 00:15:06 GMT"} })
13622024-07-06T00:15:07.053ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 220.900367ms iteration = 16
13632024-07-06T00:15:07.068ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13642024-07-06T00:15:07.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13652024-07-06T00:15:07.069ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:145 port = SwitchPort { id: 508cd4b5-5e6e-4b63-a4ba-14ff5d540fe1, rack_id: 444442ff-30f3-4f30-9be3-25f64879f808, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(63e3634f-eb74-4143-bef9-2febaac3bb82) } rack_id = 444442ff-30f3-4f30-9be3-25f64879f808 switch_location = Switch0
13662024-07-06T00:15:07.069ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13672024-07-06T00:15:07.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13682024-07-06T00:15:07.075ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 444442ff-30f3-4f30-9be3-25f64879f808 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
13692024-07-06T00:15:07.076ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 444442ff-30f3-4f30-9be3-25f64879f808 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "674d6eb6-0d7c-4655-8fbb-57ceb3ebd6ef", "content-length": "121", "date": "Sat, 06 Jul 2024 00:15:07 GMT"} })
13702024-07-06T00:15:07.076ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1662 rack_id = 444442ff-30f3-4f30-9be3-25f64879f808 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
13712024-07-06T00:15:07.076ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1689 rack_id = 444442ff-30f3-4f30-9be3-25f64879f808 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 63e3634f-eb74-4143-bef9-2febaac3bb82
13722024-07-06T00:15:07.076ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:377 rack_id = 444442ff-30f3-4f30-9be3-25f64879f808 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None)}}
13732024-07-06T00:15:07.076ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:381 rack_id = 444442ff-30f3-4f30-9be3-25f64879f808 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None)}}
13742024-07-06T00:15:07.076ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:390 rack_id = 444442ff-30f3-4f30-9be3-25f64879f808 routes = {}
13752024-07-06T00:15:07.076ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 444442ff-30f3-4f30-9be3-25f64879f808 routes = {}
13762024-07-06T00:15:07.076ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:416 rack_id = 444442ff-30f3-4f30-9be3-25f64879f808
13772024-07-06T00:15:07.076ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13782024-07-06T00:15:07.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13792024-07-06T00:15:07.077ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 444442ff-30f3-4f30-9be3-25f64879f808 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
13802024-07-06T00:15:07.077ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 444442ff-30f3-4f30-9be3-25f64879f808 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "0bef6a17-244c-4941-87ff-f0f46eb00d20", "content-length": "2", "date": "Sat, 06 Jul 2024 00:15:07 GMT"} })
13812024-07-06T00:15:07.077ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 444442ff-30f3-4f30-9be3-25f64879f808 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
13822024-07-06T00:15:07.078ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 444442ff-30f3-4f30-9be3-25f64879f808 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "220fbb2d-2b7d-4845-aa4d-5fd3d109ff56", "content-length": "52", "date": "Sat, 06 Jul 2024 00:15:07 GMT"} })
13832024-07-06T00:15:07.078ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:465 rack_id = 444442ff-30f3-4f30-9be3-25f64879f808 switch_location = Switch0
13842024-07-06T00:15:07.078ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 444442ff-30f3-4f30-9be3-25f64879f808 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
13852024-07-06T00:15:07.125ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 444442ff-30f3-4f30-9be3-25f64879f808 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "474b8679-8d88-4848-92b7-4177917647be", "date": "Sat, 06 Jul 2024 00:15:06 GMT"} })
13862024-07-06T00:15:07.125ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:768 rack_id = 444442ff-30f3-4f30-9be3-25f64879f808 switch = Switch0
13872024-07-06T00:15:07.125ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 444442ff-30f3-4f30-9be3-25f64879f808 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
13882024-07-06T00:15:07.125ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 444442ff-30f3-4f30-9be3-25f64879f808 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "5ec65014-141c-4734-ab64-4c21aab18420", "content-length": "494", "date": "Sat, 06 Jul 2024 00:15:06 GMT"} })
13892024-07-06T00:15:07.125ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13902024-07-06T00:15:07.125ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13912024-07-06T00:15:07.128ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13922024-07-06T00:15:07.128ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13932024-07-06T00:15:07.130ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13942024-07-06T00:15:07.131ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13952024-07-06T00:15:07.132ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13962024-07-06T00:15:07.132ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13972024-07-06T00:15:07.139ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 675.554367ms iteration = 15
13982024-07-06T00:15:07.495ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/6a3f84c/dropshot/src/server.rs:878 latency_us = 1999 local_addr = [fd00:1122:3344:101::a]:49987 method = GET remote_addr = [fd00:1122:3344:101::d]:37861 req_id = fcfcd358-767b-4bc5-9c32-1578d1c92a4e response_code = 200 uri = /9ff5ab27-a3ab-4401-8a23-c0799de85f2f
13992024-07-06T00:15:16.464ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 44 reason = Timeout
14002024-07-06T00:15:16.464ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 44 reason = Timeout
14012024-07-06T00:15:16.464ZINFOnexus (BackgroundTasks): region replacement driver task started background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:231
14022024-07-06T00:15:16.464ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
14032024-07-06T00:15:16.464ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14042024-07-06T00:15:16.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
14052024-07-06T00:15:16.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14062024-07-06T00:15:16.465ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
14072024-07-06T00:15:16.465ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
14082024-07-06T00:15:16.466ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14092024-07-06T00:15:16.467ZINFOnexus (BackgroundTasks): region replacement driver task done background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:238
14102024-07-06T00:15:16.467ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 2.967917ms iteration = 44
14112024-07-06T00:15:16.468ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
14122024-07-06T00:15:16.468ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14132024-07-06T00:15:16.468ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14142024-07-06T00:15:16.469ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14152024-07-06T00:15:16.470ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14162024-07-06T00:15:16.471ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14172024-07-06T00:15:16.473ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 19924212-3af7-4ff8-94f5-f62e5472fa7b, lookup_type: ById(19924212-3af7-4ff8-94f5-f62e5472fa7b) } result = Ok(())
14182024-07-06T00:15:16.473ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14192024-07-06T00:15:16.473ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14202024-07-06T00:15:16.479ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 19924212-3af7-4ff8-94f5-f62e5472fa7b original_time_created = 2024-07-06 00:07:55.490605 UTC target_id = 19924212-3af7-4ff8-94f5-f62e5472fa7b time_created = 2024-07-06 00:07:55.490605 UTC
14212024-07-06T00:15:16.479ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 15.741351ms iteration = 44
14222024-07-06T00:15:17.496ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/6a3f84c/dropshot/src/server.rs:878 latency_us = 2472 local_addr = [fd00:1122:3344:101::a]:49987 method = GET remote_addr = [fd00:1122:3344:101::d]:37861 req_id = 0caf8f6f-f7f9-491c-adc2-06f51bcbc17b response_code = 200 uri = /9ff5ab27-a3ab-4401-8a23-c0799de85f2f
14232024-07-06T00:15:26.464ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 45 reason = Timeout
14242024-07-06T00:15:26.464ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 45 reason = Timeout
14252024-07-06T00:15:26.464ZINFOnexus (BackgroundTasks): region replacement driver task started background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:231
14262024-07-06T00:15:26.464ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
14272024-07-06T00:15:26.464ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14282024-07-06T00:15:26.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
14292024-07-06T00:15:26.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14302024-07-06T00:15:26.466ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
14312024-07-06T00:15:26.466ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
14322024-07-06T00:15:26.466ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14332024-07-06T00:15:26.467ZINFOnexus (BackgroundTasks): region replacement driver task done background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:238
14342024-07-06T00:15:26.467ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.426844ms iteration = 45
14352024-07-06T00:15:26.468ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
14362024-07-06T00:15:26.468ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14372024-07-06T00:15:26.468ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14382024-07-06T00:15:26.471ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14392024-07-06T00:15:26.471ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14402024-07-06T00:15:26.472ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14412024-07-06T00:15:26.475ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 19924212-3af7-4ff8-94f5-f62e5472fa7b, lookup_type: ById(19924212-3af7-4ff8-94f5-f62e5472fa7b) } result = Ok(())
14422024-07-06T00:15:26.475ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14432024-07-06T00:15:26.475ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14442024-07-06T00:15:26.481ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 19924212-3af7-4ff8-94f5-f62e5472fa7b original_time_created = 2024-07-06 00:07:55.490605 UTC target_id = 19924212-3af7-4ff8-94f5-f62e5472fa7b time_created = 2024-07-06 00:07:55.490605 UTC
14452024-07-06T00:15:26.481ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 16.96207ms iteration = 45
14462024-07-06T00:15:27.496ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/6a3f84c/dropshot/src/server.rs:878 latency_us = 2433 local_addr = [fd00:1122:3344:101::a]:49987 method = GET remote_addr = [fd00:1122:3344:101::d]:37861 req_id = 978f1410-7798-4fed-a19d-b1f1826370a1 response_code = 200 uri = /9ff5ab27-a3ab-4401-8a23-c0799de85f2f
14472024-07-06T00:15:36.464ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 46 reason = Timeout
14482024-07-06T00:15:36.464ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 16 reason = Timeout
14492024-07-06T00:15:36.464ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14502024-07-06T00:15:36.464ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 16 reason = Timeout
14512024-07-06T00:15:36.464ZWARNnexus (BackgroundTasks): phantom disk task started background_task = phantom_disks file = nexus/src/app/background/tasks/phantom_disks.rs:46
14522024-07-06T00:15:36.464ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
14532024-07-06T00:15:36.464ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 17 reason = Timeout
14542024-07-06T00:15:36.464ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 16 reason = Timeout
14552024-07-06T00:15:36.464ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
14562024-07-06T00:15:36.464ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
14572024-07-06T00:15:36.464ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 16 reason = Timeout
14582024-07-06T00:15:36.464ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 16 reason = Timeout
14592024-07-06T00:15:36.464ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 46 reason = Timeout
14602024-07-06T00:15:36.464ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14612024-07-06T00:15:36.464ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
14622024-07-06T00:15:36.464ZINFOnexus (BackgroundTasks): region replacement driver task started background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:231
14632024-07-06T00:15:36.464ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
14642024-07-06T00:15:36.464ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 16 reason = Timeout
14652024-07-06T00:15:36.464ZWARNnexus (BackgroundTasks): region replacement task started background_task = region_replacement file = nexus/src/app/background/tasks/region_replacement.rs:64
14662024-07-06T00:15:36.464ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 18 reason = Timeout
14672024-07-06T00:15:36.464ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
14682024-07-06T00:15:36.464ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
14692024-07-06T00:15:36.464ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 17 reason = Timeout
14702024-07-06T00:15:36.464ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14712024-07-06T00:15:36.464ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 16 reason = Timeout
14722024-07-06T00:15:36.464ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14732024-07-06T00:15:36.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
14742024-07-06T00:15:36.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14752024-07-06T00:15:36.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
14762024-07-06T00:15:36.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
14772024-07-06T00:15:36.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14782024-07-06T00:15:36.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
14792024-07-06T00:15:36.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
14802024-07-06T00:15:36.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
14812024-07-06T00:15:36.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
14822024-07-06T00:15:36.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14832024-07-06T00:15:36.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14842024-07-06T00:15:36.466ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14852024-07-06T00:15:36.466ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14862024-07-06T00:15:36.466ZWARNnexus (BackgroundTasks): phantom disk task done background_task = phantom_disks file = nexus/src/app/background/tasks/phantom_disks.rs:93
14872024-07-06T00:15:36.466ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 2.633422ms iteration = 16
14882024-07-06T00:15:36.467ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
14892024-07-06T00:15:36.467ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
14902024-07-06T00:15:36.467ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14912024-07-06T00:15:36.467ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
14922024-07-06T00:15:36.467ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4d88c6ce-c5a2-418b-b915-09fea24f811c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-4d88c6ce-c5a2-418b-b915-09fea24f811c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 2315, tv_nsec: 101669937 } })
14932024-07-06T00:15:36.468ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4d88c6ce-c5a2-418b-b915-09fea24f811c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-4d88c6ce-c5a2-418b-b915-09fea24f811c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 2315, tv_nsec: 101820630 } })
14942024-07-06T00:15:36.468ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
14952024-07-06T00:15:36.468ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14962024-07-06T00:15:36.468ZINFOnexus (BackgroundTasks): region replacement driver task done background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:238
14972024-07-06T00:15:36.468ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.549342ms iteration = 46
14982024-07-06T00:15:36.469ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1014
14992024-07-06T00:15:36.469ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
15002024-07-06T00:15:36.469ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
15012024-07-06T00:15:36.469ZWARNnexus (BackgroundTasks): region replacement task done background_task = region_replacement file = nexus/src/app/background/tasks/region_replacement.rs:185
15022024-07-06T00:15:36.469ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 5.082601ms iteration = 16
15032024-07-06T00:15:36.469ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1014
15042024-07-06T00:15:36.469ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
15052024-07-06T00:15:36.470ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
15062024-07-06T00:15:36.470ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15072024-07-06T00:15:36.470ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
15082024-07-06T00:15:36.470ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
15092024-07-06T00:15:36.470ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15102024-07-06T00:15:36.470ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
15112024-07-06T00:15:36.470ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15122024-07-06T00:15:36.471ZWARNnexus (BackgroundTasks): physical disk adoption task started background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:100
15132024-07-06T00:15:36.471ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
15142024-07-06T00:15:36.471ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
15152024-07-06T00:15:36.471ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15162024-07-06T00:15:36.471ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15172024-07-06T00:15:36.472ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
15182024-07-06T00:15:36.472ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15192024-07-06T00:15:36.472ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15202024-07-06T00:15:36.472ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15212024-07-06T00:15:36.473ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15222024-07-06T00:15:36.473ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15232024-07-06T00:15:36.474ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
15242024-07-06T00:15:36.474ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15252024-07-06T00:15:36.474ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15262024-07-06T00:15:36.474ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15272024-07-06T00:15:36.474ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
15282024-07-06T00:15:36.474ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15292024-07-06T00:15:36.474ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15302024-07-06T00:15:36.475ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
15312024-07-06T00:15:36.475ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15322024-07-06T00:15:36.475ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15332024-07-06T00:15:36.475ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
15342024-07-06T00:15:36.475ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
15352024-07-06T00:15:36.475ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
15362024-07-06T00:15:36.476ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15372024-07-06T00:15:36.477ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15382024-07-06T00:15:36.477ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 19924212-3af7-4ff8-94f5-f62e5472fa7b, lookup_type: ById(19924212-3af7-4ff8-94f5-f62e5472fa7b) } result = Ok(())
15392024-07-06T00:15:36.477ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15402024-07-06T00:15:36.477ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15412024-07-06T00:15:36.477ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4d88c6ce-c5a2-418b-b915-09fea24f811c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-4d88c6ce-c5a2-418b-b915-09fea24f811c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 2315, tv_nsec: 111313971 } })
15422024-07-06T00:15:36.477ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:480 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0
15432024-07-06T00:15:36.477ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 13.553307ms iteration = 16
15442024-07-06T00:15:36.477ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1014 rack_id = 444442ff-30f3-4f30-9be3-25f64879f808
15452024-07-06T00:15:36.477ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
15462024-07-06T00:15:36.478ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
15472024-07-06T00:15:36.480ZWARNnexus (BackgroundTasks): physical disk adoption task done background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:174
15482024-07-06T00:15:36.480ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 16.032725ms iteration = 17
15492024-07-06T00:15:36.484ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 19924212-3af7-4ff8-94f5-f62e5472fa7b original_time_created = 2024-07-06 00:07:55.490605 UTC target_id = 19924212-3af7-4ff8-94f5-f62e5472fa7b time_created = 2024-07-06 00:07:55.490605 UTC
15502024-07-06T00:15:36.484ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.877037ms iteration = 46
15512024-07-06T00:15:36.485ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
15522024-07-06T00:15:36.485ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
15532024-07-06T00:15:36.486ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15542024-07-06T00:15:36.488ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
15552024-07-06T00:15:36.488ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
15562024-07-06T00:15:36.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
15572024-07-06T00:15:36.489ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15582024-07-06T00:15:36.490ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15592024-07-06T00:15:36.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15602024-07-06T00:15:36.490ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
15612024-07-06T00:15:36.490ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
15622024-07-06T00:15:36.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
15632024-07-06T00:15:36.492ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15642024-07-06T00:15:36.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15652024-07-06T00:15:36.493ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15662024-07-06T00:15:36.495ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 4d88c6ce-c5a2-418b-b915-09fea24f811c, lookup_type: ById(4d88c6ce-c5a2-418b-b915-09fea24f811c) } result = Ok(())
15672024-07-06T00:15:36.495ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15682024-07-06T00:15:36.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15692024-07-06T00:15:36.497ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 32.795613ms iteration = 16
15702024-07-06T00:15:36.585ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1022 zone_address = fd00:1122:3344:101::2
15712024-07-06T00:15:36.585ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
15722024-07-06T00:15:36.585ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "a36a43ae-59ab-4992-a235-7ebdd97ca42b", "content-length": "26", "date": "Sat, 06 Jul 2024 00:15:35 GMT"} })
15732024-07-06T00:15:36.585ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1027 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
15742024-07-06T00:15:36.588ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1059 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
15752024-07-06T00:15:36.600ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1022 zone_address = fd00:1122:3344:101::2
15762024-07-06T00:15:36.600ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
15772024-07-06T00:15:36.600ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "25074b87-aa71-48c6-8a41-2d83f89f5809", "content-length": "26", "date": "Sat, 06 Jul 2024 00:15:35 GMT"} })
15782024-07-06T00:15:36.600ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1027 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
15792024-07-06T00:15:36.602ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1059 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
15802024-07-06T00:15:36.610ZDEBGnexus (BackgroundTasks): client request SledAgent = 4d88c6ce-c5a2-418b-b915-09fea24f811c background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
15812024-07-06T00:15:36.611ZDEBGnexus (BackgroundTasks): client response SledAgent = 4d88c6ce-c5a2-418b-b915-09fea24f811c background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "659da2d5-265c-4115-8e22-9fa25b5ec3b2", "content-length": "372", "date": "Sat, 06 Jul 2024 00:15:36 GMT"} })
15822024-07-06T00:15:36.611ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15832024-07-06T00:15:36.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15842024-07-06T00:15:36.612ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1022 rack_id = 444442ff-30f3-4f30-9be3-25f64879f808 zone_address = fd00:1122:3344:101::2
15852024-07-06T00:15:36.612ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 444442ff-30f3-4f30-9be3-25f64879f808 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
15862024-07-06T00:15:36.612ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 444442ff-30f3-4f30-9be3-25f64879f808 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "46aaea00-42e3-45be-8fd4-a793d3cf2887", "content-length": "26", "date": "Sat, 06 Jul 2024 00:15:35 GMT"} })
15872024-07-06T00:15:36.612ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1027 rack_id = 444442ff-30f3-4f30-9be3-25f64879f808 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
15882024-07-06T00:15:36.613ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15892024-07-06T00:15:36.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15902024-07-06T00:15:36.614ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1059 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 444442ff-30f3-4f30-9be3-25f64879f808
15912024-07-06T00:15:36.615ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15922024-07-06T00:15:36.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15932024-07-06T00:15:36.617ZDEBGnexus (BackgroundTasks): client request SledAgent = 4d88c6ce-c5a2-418b-b915-09fea24f811c background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
15942024-07-06T00:15:36.617ZDEBGnexus (BackgroundTasks): client response SledAgent = 4d88c6ce-c5a2-418b-b915-09fea24f811c background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "e8d9aae0-ed85-48b3-96bf-f32a9554871c", "date": "Sat, 06 Jul 2024 00:15:36 GMT"} })
15952024-07-06T00:15:36.618ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 154.458427ms iteration = 17
15962024-07-06T00:15:36.665ZDEBGnexus (BackgroundTasks): client request SledAgent = 4d88c6ce-c5a2-418b-b915-09fea24f811c background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
15972024-07-06T00:15:36.665ZDEBGnexus (BackgroundTasks): client response SledAgent = 4d88c6ce-c5a2-418b-b915-09fea24f811c background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "86e45045-dff2-4d6a-bb6d-6bf0294a9f65", "content-length": "691", "date": "Sat, 06 Jul 2024 00:15:36 GMT"} })
15982024-07-06T00:15:36.666ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
15992024-07-06T00:15:36.666ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
16002024-07-06T00:15:36.666ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
16012024-07-06T00:15:36.667ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 203.123194ms iteration = 18
16022024-07-06T00:15:36.710ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 245.949457ms iteration = 16
16032024-07-06T00:15:36.711ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
16042024-07-06T00:15:36.712ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "5d1b51f4-b745-441a-8e33-2617984d6a65", "content-length": "2", "date": "Sat, 06 Jul 2024 00:15:36 GMT"} })
16052024-07-06T00:15:36.713ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
16062024-07-06T00:15:36.713ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
16072024-07-06T00:15:36.715ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 250.931846ms iteration = 16
16082024-07-06T00:15:36.767ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16092024-07-06T00:15:36.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16102024-07-06T00:15:36.769ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:145 port = SwitchPort { id: 508cd4b5-5e6e-4b63-a4ba-14ff5d540fe1, rack_id: 444442ff-30f3-4f30-9be3-25f64879f808, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(63e3634f-eb74-4143-bef9-2febaac3bb82) } rack_id = 444442ff-30f3-4f30-9be3-25f64879f808 switch_location = Switch0
16112024-07-06T00:15:36.769ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16122024-07-06T00:15:36.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16132024-07-06T00:15:36.775ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 444442ff-30f3-4f30-9be3-25f64879f808 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
16142024-07-06T00:15:36.776ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 444442ff-30f3-4f30-9be3-25f64879f808 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "11f0f21b-bb4c-4140-8426-c0f3124db616", "content-length": "121", "date": "Sat, 06 Jul 2024 00:15:36 GMT"} })
16152024-07-06T00:15:36.776ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1662 rack_id = 444442ff-30f3-4f30-9be3-25f64879f808 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
16162024-07-06T00:15:36.776ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1689 rack_id = 444442ff-30f3-4f30-9be3-25f64879f808 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 63e3634f-eb74-4143-bef9-2febaac3bb82
16172024-07-06T00:15:36.776ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:377 rack_id = 444442ff-30f3-4f30-9be3-25f64879f808 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None)}}
16182024-07-06T00:15:36.776ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:381 rack_id = 444442ff-30f3-4f30-9be3-25f64879f808 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None)}}
16192024-07-06T00:15:36.776ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:390 rack_id = 444442ff-30f3-4f30-9be3-25f64879f808 routes = {}
16202024-07-06T00:15:36.776ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 444442ff-30f3-4f30-9be3-25f64879f808 routes = {}
16212024-07-06T00:15:36.776ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:416 rack_id = 444442ff-30f3-4f30-9be3-25f64879f808
16222024-07-06T00:15:36.776ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16232024-07-06T00:15:36.776ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16242024-07-06T00:15:36.777ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 444442ff-30f3-4f30-9be3-25f64879f808 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
16252024-07-06T00:15:36.777ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 444442ff-30f3-4f30-9be3-25f64879f808 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "b1063b34-91bd-4cd4-93c3-fcb0c721ee76", "content-length": "2", "date": "Sat, 06 Jul 2024 00:15:36 GMT"} })
16262024-07-06T00:15:36.777ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 444442ff-30f3-4f30-9be3-25f64879f808 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
16272024-07-06T00:15:36.777ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 444442ff-30f3-4f30-9be3-25f64879f808 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "87b4a541-e8b8-431d-9e8d-a0e3f0ce35b5", "content-length": "52", "date": "Sat, 06 Jul 2024 00:15:36 GMT"} })
16282024-07-06T00:15:36.777ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:465 rack_id = 444442ff-30f3-4f30-9be3-25f64879f808 switch_location = Switch0
16292024-07-06T00:15:36.777ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 444442ff-30f3-4f30-9be3-25f64879f808 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
16302024-07-06T00:15:36.826ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 444442ff-30f3-4f30-9be3-25f64879f808 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "d0423994-b58d-4f2b-a589-dec0f06d3d48", "date": "Sat, 06 Jul 2024 00:15:36 GMT"} })
16312024-07-06T00:15:36.826ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:768 rack_id = 444442ff-30f3-4f30-9be3-25f64879f808 switch = Switch0
16322024-07-06T00:15:36.826ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 444442ff-30f3-4f30-9be3-25f64879f808 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
16332024-07-06T00:15:36.830ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 444442ff-30f3-4f30-9be3-25f64879f808 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "dd8a5823-f414-4fe1-af0a-c684856dbb35", "content-length": "494", "date": "Sat, 06 Jul 2024 00:15:36 GMT"} })
16342024-07-06T00:15:36.830ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16352024-07-06T00:15:36.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16362024-07-06T00:15:36.832ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16372024-07-06T00:15:36.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16382024-07-06T00:15:36.834ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16392024-07-06T00:15:36.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16402024-07-06T00:15:36.835ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16412024-07-06T00:15:36.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16422024-07-06T00:15:36.840ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 376.34952ms iteration = 16
16432024-07-06T00:15:37.497ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/6a3f84c/dropshot/src/server.rs:878 latency_us = 2688 local_addr = [fd00:1122:3344:101::a]:49987 method = GET remote_addr = [fd00:1122:3344:101::d]:37861 req_id = 2ad393bf-e9eb-4be9-a5f8-c0b6522d0b5f response_code = 200 uri = /9ff5ab27-a3ab-4401-8a23-c0799de85f2f
16442024-07-06T00:15:46.463ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 47 reason = Timeout
16452024-07-06T00:15:46.463ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16462024-07-06T00:15:46.463ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 47 reason = Timeout
16472024-07-06T00:15:46.463ZINFOnexus (BackgroundTasks): region replacement driver task started background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:231
16482024-07-06T00:15:46.463ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
16492024-07-06T00:15:46.463ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16502024-07-06T00:15:46.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
16512024-07-06T00:15:46.465ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16522024-07-06T00:15:46.465ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
16532024-07-06T00:15:46.465ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
16542024-07-06T00:15:46.466ZINFOnexus (BackgroundTasks): region replacement driver task done background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:238
16552024-07-06T00:15:46.466ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.446695ms iteration = 47
16562024-07-06T00:15:46.467ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
16572024-07-06T00:15:46.467ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16582024-07-06T00:15:46.467ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16592024-07-06T00:15:46.468ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16602024-07-06T00:15:46.468ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16612024-07-06T00:15:46.469ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16622024-07-06T00:15:46.472ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 19924212-3af7-4ff8-94f5-f62e5472fa7b, lookup_type: ById(19924212-3af7-4ff8-94f5-f62e5472fa7b) } result = Ok(())
16632024-07-06T00:15:46.472ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16642024-07-06T00:15:46.472ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16652024-07-06T00:15:46.479ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 19924212-3af7-4ff8-94f5-f62e5472fa7b original_time_created = 2024-07-06 00:07:55.490605 UTC target_id = 19924212-3af7-4ff8-94f5-f62e5472fa7b time_created = 2024-07-06 00:07:55.490605 UTC
16662024-07-06T00:15:46.479ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 16.353081ms iteration = 47
16672024-07-06T00:15:47.496ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/6a3f84c/dropshot/src/server.rs:878 latency_us = 2068 local_addr = [fd00:1122:3344:101::a]:49987 method = GET remote_addr = [fd00:1122:3344:101::d]:37861 req_id = 131c0b51-c8c9-46db-a297-38d62bba0ba5 response_code = 200 uri = /9ff5ab27-a3ab-4401-8a23-c0799de85f2f
16682024-07-06T00:15:56.464ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 48 reason = Timeout
16692024-07-06T00:15:56.464ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 48 reason = Timeout
16702024-07-06T00:15:56.464ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16712024-07-06T00:15:56.464ZINFOnexus (BackgroundTasks): region replacement driver task started background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:231
16722024-07-06T00:15:56.464ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
16732024-07-06T00:15:56.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16742024-07-06T00:15:56.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
16752024-07-06T00:15:56.465ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16762024-07-06T00:15:56.465ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
16772024-07-06T00:15:56.466ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
16782024-07-06T00:15:56.467ZINFOnexus (BackgroundTasks): region replacement driver task done background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:238
16792024-07-06T00:15:56.467ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.201991ms iteration = 48
16802024-07-06T00:15:56.468ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
16812024-07-06T00:15:56.468ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16822024-07-06T00:15:56.468ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16832024-07-06T00:15:56.469ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16842024-07-06T00:15:56.469ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16852024-07-06T00:15:56.470ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16862024-07-06T00:15:56.472ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 19924212-3af7-4ff8-94f5-f62e5472fa7b, lookup_type: ById(19924212-3af7-4ff8-94f5-f62e5472fa7b) } result = Ok(())
16872024-07-06T00:15:56.472ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16882024-07-06T00:15:56.472ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16892024-07-06T00:15:56.478ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 19924212-3af7-4ff8-94f5-f62e5472fa7b original_time_created = 2024-07-06 00:07:55.490605 UTC target_id = 19924212-3af7-4ff8-94f5-f62e5472fa7b time_created = 2024-07-06 00:07:55.490605 UTC
16902024-07-06T00:15:56.478ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 14.910269ms iteration = 48
16912024-07-06T00:15:57.496ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/6a3f84c/dropshot/src/server.rs:878 latency_us = 2385 local_addr = [fd00:1122:3344:101::a]:49987 method = GET remote_addr = [fd00:1122:3344:101::d]:37861 req_id = c0e5b0a1-55b4-4126-9e48-104de0f98795 response_code = 200 uri = /9ff5ab27-a3ab-4401-8a23-c0799de85f2f
16922024-07-06T00:16:06.463ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 49 reason = Timeout
16932024-07-06T00:16:06.463ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16942024-07-06T00:16:06.463ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 18 reason = Timeout
16952024-07-06T00:16:06.463ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 9 reason = Timeout
16962024-07-06T00:16:06.463ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16972024-07-06T00:16:06.463ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
16982024-07-06T00:16:06.463ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
16992024-07-06T00:16:06.463ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 49 reason = Timeout
17002024-07-06T00:16:06.463ZINFOnexus (BackgroundTasks): region replacement driver task started background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:231
17012024-07-06T00:16:06.463ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17022024-07-06T00:16:06.463ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 9 reason = Timeout
17032024-07-06T00:16:06.463ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 9 reason = Timeout
17042024-07-06T00:16:06.463ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 9 reason = Timeout
17052024-07-06T00:16:06.463ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-07-06 00:06:06.463891980 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
17062024-07-06T00:16:06.463ZINFOnexus (BackgroundTasks): lookup region port task started background_task = lookup_region_port file = nexus/src/app/background/tasks/lookup_region_port.rs:56
17072024-07-06T00:16:06.463ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
17082024-07-06T00:16:06.463ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
17092024-07-06T00:16:06.463ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 11 reason = Timeout
17102024-07-06T00:16:06.463ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 9 reason = Timeout
17112024-07-06T00:16:06.463ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
17122024-07-06T00:16:06.463ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
17132024-07-06T00:16:06.463ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 17 reason = Timeout
17142024-07-06T00:16:06.464ZWARNnexus (BackgroundTasks): region replacement task started background_task = region_replacement file = nexus/src/app/background/tasks/region_replacement.rs:64
17152024-07-06T00:16:06.464ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
17162024-07-06T00:16:06.464ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 9 reason = Timeout
17172024-07-06T00:16:06.464ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
17182024-07-06T00:16:06.464ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 17 reason = Timeout
17192024-07-06T00:16:06.464ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
17202024-07-06T00:16:06.464ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 9 reason = Timeout
17212024-07-06T00:16:06.464ZINFOnexus (BackgroundTasks): Abandoned VMM reaper running background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:76
17222024-07-06T00:16:06.464ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 17 reason = Timeout
17232024-07-06T00:16:06.464ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
17242024-07-06T00:16:06.464ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 17 reason = Timeout
17252024-07-06T00:16:06.464ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
17262024-07-06T00:16:06.464ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17272024-07-06T00:16:06.464ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 17 reason = Timeout
17282024-07-06T00:16:06.464ZWARNnexus (BackgroundTasks): phantom disk task started background_task = phantom_disks file = nexus/src/app/background/tasks/phantom_disks.rs:46
17292024-07-06T00:16:06.464ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 9 reason = Timeout
17302024-07-06T00:16:06.464ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 11 reason = Timeout
17312024-07-06T00:16:06.464ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 10 reason = Timeout
17322024-07-06T00:16:06.464ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:69 reason = blueprint disabled target_id = 19924212-3af7-4ff8-94f5-f62e5472fa7b
17332024-07-06T00:16:06.464ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 11.94\u{b5}s iteration = 10
17342024-07-06T00:16:06.464ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 18 reason = Timeout
17352024-07-06T00:16:06.464ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 17 reason = Timeout
17362024-07-06T00:16:06.464ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 19 reason = Timeout
17372024-07-06T00:16:06.464ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
17382024-07-06T00:16:06.464ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
17392024-07-06T00:16:06.464ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
17402024-07-06T00:16:06.464ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 17 reason = Timeout
17412024-07-06T00:16:06.464ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
17422024-07-06T00:16:06.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17432024-07-06T00:16:06.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17442024-07-06T00:16:06.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
17452024-07-06T00:16:06.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
17462024-07-06T00:16:06.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17472024-07-06T00:16:06.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
17482024-07-06T00:16:06.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
17492024-07-06T00:16:06.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
17502024-07-06T00:16:06.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
17512024-07-06T00:16:06.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17522024-07-06T00:16:06.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
17532024-07-06T00:16:06.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
17542024-07-06T00:16:06.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
17552024-07-06T00:16:06.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
17562024-07-06T00:16:06.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
17572024-07-06T00:16:06.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
17582024-07-06T00:16:06.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
17592024-07-06T00:16:06.464ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("544a0264-7c3a-4ada-aa6e-553800c85da2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f0ddfaba-8652-4628-848a-f993e079fb94.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f0ddfaba-8652-4628-848a-f993e079fb94.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(fd00:1122:3344:101::9)) }], valid_until: Instant { tv_sec: 2345, tv_nsec: 98361282 } })
17602024-07-06T00:16:06.464ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1f295afe-8b02-48b5-8b08-e8e6206ee96c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("bd5693ce-2405-4f5e-bcea-cf00f7435aea.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("cdec4b62-7244-4b80-8777-6d905a5202cd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("cdec4b62-7244-4b80-8777-6d905a5202cd.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(fd00:1122:3344:1::1)) }], valid_until: Instant { tv_sec: 2345, tv_nsec: 98390923 } })
17612024-07-06T00:16:06.464ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
17622024-07-06T00:16:06.465ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
17632024-07-06T00:16:06.466ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17642024-07-06T00:16:06.466ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17652024-07-06T00:16:06.466ZWARNnexus (BackgroundTasks): phantom disk task done background_task = phantom_disks file = nexus/src/app/background/tasks/phantom_disks.rs:93
17662024-07-06T00:16:06.466ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 2.893196ms iteration = 17
17672024-07-06T00:16:06.467ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-07-06 00:06:06.463891980 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
17682024-07-06T00:16:06.467ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 3.13444ms iteration = 9
17692024-07-06T00:16:06.467ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
17702024-07-06T00:16:06.467ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
17712024-07-06T00:16:06.467ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 2.993598ms iteration = 9
17722024-07-06T00:16:06.467ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 3.207721ms iteration = 9
17732024-07-06T00:16:06.467ZINFOnexus (BackgroundTasks): lookup region port task done background_task = lookup_region_port file = nexus/src/app/background/tasks/lookup_region_port.rs:143
17742024-07-06T00:16:06.467ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 3.384974ms iteration = 9
17752024-07-06T00:16:06.467ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17762024-07-06T00:16:06.468ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17772024-07-06T00:16:06.468ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17782024-07-06T00:16:06.468ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17792024-07-06T00:16:06.468ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
17802024-07-06T00:16:06.468ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
17812024-07-06T00:16:06.468ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
17822024-07-06T00:16:06.468ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
17832024-07-06T00:16:06.468ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4d88c6ce-c5a2-418b-b915-09fea24f811c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-4d88c6ce-c5a2-418b-b915-09fea24f811c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 2345, tv_nsec: 102554420 } })
17842024-07-06T00:16:06.469ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
17852024-07-06T00:16:06.469ZINFOnexus (BackgroundTasks): region replacement driver task done background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:238
17862024-07-06T00:16:06.469ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 5.530689ms iteration = 49
17872024-07-06T00:16:06.470ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17882024-07-06T00:16:06.470ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17892024-07-06T00:16:06.470ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
17902024-07-06T00:16:06.470ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
17912024-07-06T00:16:06.470ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1014
17922024-07-06T00:16:06.470ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
17932024-07-06T00:16:06.470ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4d88c6ce-c5a2-418b-b915-09fea24f811c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-4d88c6ce-c5a2-418b-b915-09fea24f811c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 2345, tv_nsec: 104297757 } })
17942024-07-06T00:16:06.470ZWARNnexus (BackgroundTasks): region replacement task done background_task = region_replacement file = nexus/src/app/background/tasks/region_replacement.rs:185
17952024-07-06T00:16:06.470ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 6.729667ms iteration = 17
17962024-07-06T00:16:06.471ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1014
17972024-07-06T00:16:06.471ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
17982024-07-06T00:16:06.471ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
17992024-07-06T00:16:06.471ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
18002024-07-06T00:16:06.471ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
18012024-07-06T00:16:06.471ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18022024-07-06T00:16:06.471ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
18032024-07-06T00:16:06.471ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18042024-07-06T00:16:06.471ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
18052024-07-06T00:16:06.471ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18062024-07-06T00:16:06.471ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18072024-07-06T00:16:06.472ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18082024-07-06T00:16:06.472ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18092024-07-06T00:16:06.473ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18102024-07-06T00:16:06.473ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18112024-07-06T00:16:06.473ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18122024-07-06T00:16:06.473ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18132024-07-06T00:16:06.474ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
18142024-07-06T00:16:06.474ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18152024-07-06T00:16:06.474ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18162024-07-06T00:16:06.474ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18172024-07-06T00:16:06.475ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
18182024-07-06T00:16:06.476ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
18192024-07-06T00:16:06.476ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18202024-07-06T00:16:06.476ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
18212024-07-06T00:16:06.476ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
18222024-07-06T00:16:06.476ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
18232024-07-06T00:16:06.476ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18242024-07-06T00:16:06.476ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4d88c6ce-c5a2-418b-b915-09fea24f811c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-4d88c6ce-c5a2-418b-b915-09fea24f811c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 2345, tv_nsec: 110349794 } })
18252024-07-06T00:16:06.476ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
18262024-07-06T00:16:06.476ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
18272024-07-06T00:16:06.477ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
18282024-07-06T00:16:06.477ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
18292024-07-06T00:16:06.477ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
18302024-07-06T00:16:06.477ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
18312024-07-06T00:16:06.478ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
18322024-07-06T00:16:06.478ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
18332024-07-06T00:16:06.478ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
18342024-07-06T00:16:06.478ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
18352024-07-06T00:16:06.478ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18362024-07-06T00:16:06.478ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:480 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0
18372024-07-06T00:16:06.478ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 14.317289ms iteration = 17
18382024-07-06T00:16:06.478ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
18392024-07-06T00:16:06.478ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18402024-07-06T00:16:06.478ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1014 rack_id = 444442ff-30f3-4f30-9be3-25f64879f808
18412024-07-06T00:16:06.478ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
18422024-07-06T00:16:06.478ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
18432024-07-06T00:16:06.478ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
18442024-07-06T00:16:06.479ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
18452024-07-06T00:16:06.479ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
18462024-07-06T00:16:06.479ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 19924212-3af7-4ff8-94f5-f62e5472fa7b, lookup_type: ById(19924212-3af7-4ff8-94f5-f62e5472fa7b) } result = Ok(())
18472024-07-06T00:16:06.479ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18482024-07-06T00:16:06.479ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18492024-07-06T00:16:06.479ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18502024-07-06T00:16:06.480ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18512024-07-06T00:16:06.480ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
18522024-07-06T00:16:06.480ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
18532024-07-06T00:16:06.481ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
18542024-07-06T00:16:06.481ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
18552024-07-06T00:16:06.481ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
18562024-07-06T00:16:06.481ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
18572024-07-06T00:16:06.481ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
18582024-07-06T00:16:06.482ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
18592024-07-06T00:16:06.482ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
18602024-07-06T00:16:06.483ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
18612024-07-06T00:16:06.483ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
18622024-07-06T00:16:06.483ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
18632024-07-06T00:16:06.483ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
18642024-07-06T00:16:06.483ZWARNnexus (BackgroundTasks): physical disk adoption task started background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:100
18652024-07-06T00:16:06.483ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
18662024-07-06T00:16:06.483ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
18672024-07-06T00:16:06.484ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
18682024-07-06T00:16:06.484ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
18692024-07-06T00:16:06.484ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
18702024-07-06T00:16:06.485ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
18712024-07-06T00:16:06.485ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = b23108f8-8976-42f5-b936-c6164231772a dns_zone_name = oxide.test found_so_far = 0 version = 2
18722024-07-06T00:16:06.485ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
18732024-07-06T00:16:06.485ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18742024-07-06T00:16:06.485ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
18752024-07-06T00:16:06.486ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
18762024-07-06T00:16:06.486ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = abfdb766-11a5-43b8-8197-e24788797466 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
18772024-07-06T00:16:06.486ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
18782024-07-06T00:16:06.486ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
18792024-07-06T00:16:06.486ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 19924212-3af7-4ff8-94f5-f62e5472fa7b original_time_created = 2024-07-06 00:07:55.490605 UTC target_id = 19924212-3af7-4ff8-94f5-f62e5472fa7b time_created = 2024-07-06 00:07:55.490605 UTC
18802024-07-06T00:16:06.486ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.571921ms iteration = 49
18812024-07-06T00:16:06.486ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18822024-07-06T00:16:06.487ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18832024-07-06T00:16:06.487ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
18842024-07-06T00:16:06.487ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
18852024-07-06T00:16:06.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
18862024-07-06T00:16:06.489ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
18872024-07-06T00:16:06.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
18882024-07-06T00:16:06.489ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
18892024-07-06T00:16:06.489ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
18902024-07-06T00:16:06.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
18912024-07-06T00:16:06.490ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
18922024-07-06T00:16:06.490ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
18932024-07-06T00:16:06.490ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18942024-07-06T00:16:06.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
18952024-07-06T00:16:06.491ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = b23108f8-8976-42f5-b936-c6164231772a dns_zone_name = oxide.test found_so_far = 1 version = 2
18962024-07-06T00:16:06.491ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
18972024-07-06T00:16:06.491ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-07-06 00:08:56.860219 UTC dns_group = external generation = 2
18982024-07-06T00:16:06.491ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 27.734233ms iteration = 9
18992024-07-06T00:16:06.492ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
19002024-07-06T00:16:06.492ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
19012024-07-06T00:16:06.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
19022024-07-06T00:16:06.492ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = abfdb766-11a5-43b8-8197-e24788797466 dns_zone_name = control-plane.oxide.internal found_so_far = 49 version = 1
19032024-07-06T00:16:06.492ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
19042024-07-06T00:16:06.493ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-07-06 00:08:56.318024 UTC dns_group = internal generation = 1
19052024-07-06T00:16:06.493ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 29.050424ms iteration = 9
19062024-07-06T00:16:06.494ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19072024-07-06T00:16:06.495ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
19082024-07-06T00:16:06.495ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
19092024-07-06T00:16:06.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
19102024-07-06T00:16:06.500ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19112024-07-06T00:16:06.500ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19122024-07-06T00:16:06.502ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19132024-07-06T00:16:06.502ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19142024-07-06T00:16:06.502ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0
19152024-07-06T00:16:06.502ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:189 found = 0 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0
19162024-07-06T00:16:06.502ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 38.413584ms iteration = 9
19172024-07-06T00:16:06.503ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19182024-07-06T00:16:06.509ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 4d88c6ce-c5a2-418b-b915-09fea24f811c, lookup_type: ById(4d88c6ce-c5a2-418b-b915-09fea24f811c) } result = Ok(())
19192024-07-06T00:16:06.509ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19202024-07-06T00:16:06.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19212024-07-06T00:16:06.511ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 47.223894ms iteration = 17
19222024-07-06T00:16:06.525ZWARNnexus (BackgroundTasks): physical disk adoption task done background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:174
19232024-07-06T00:16:06.525ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 61.075285ms iteration = 18
19242024-07-06T00:16:06.528ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-07-06T00:08:05.356130Z, time_modified: 2024-07-06T00:08:05.356130Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, db_silo: Silo { identity: SiloIdentity { id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-07-06T00:08:56.821246Z, time_modified: 2024-07-06T00:08:56.821246Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "928ad9190931080b8e93bf47b49904baa52843f842ab23f7e48563bc4b1cb506" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, db_silo: Silo { identity: SiloIdentity { id: ab7e73b3-9e83-4cc6-b7be-0c5757fdaf0c, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-07-06T00:08:56.821246Z, time_modified: 2024-07-06T00:08:56.821246Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "928ad9190931080b8e93bf47b49904baa52843f842ab23f7e48563bc4b1cb506" }] }) }
19252024-07-06T00:16:06.528ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 64.235535ms iteration = 9
19262024-07-06T00:16:06.660ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1022 rack_id = 444442ff-30f3-4f30-9be3-25f64879f808 zone_address = fd00:1122:3344:101::2
19272024-07-06T00:16:06.660ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 444442ff-30f3-4f30-9be3-25f64879f808 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
19282024-07-06T00:16:06.660ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 444442ff-30f3-4f30-9be3-25f64879f808 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "807acb0b-3277-4c14-8a63-f2e30282d825", "content-length": "26", "date": "Sat, 06 Jul 2024 00:16:05 GMT"} })
19292024-07-06T00:16:06.660ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1027 rack_id = 444442ff-30f3-4f30-9be3-25f64879f808 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
19302024-07-06T00:16:06.662ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1059 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 444442ff-30f3-4f30-9be3-25f64879f808
19312024-07-06T00:16:06.679ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1022 zone_address = fd00:1122:3344:101::2
19322024-07-06T00:16:06.679ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
19332024-07-06T00:16:06.679ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "3971c876-6a66-40bb-8bae-f0d2274e7f09", "content-length": "26", "date": "Sat, 06 Jul 2024 00:16:05 GMT"} })
19342024-07-06T00:16:06.679ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1027 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
19352024-07-06T00:16:06.681ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1059 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
19362024-07-06T00:16:06.682ZDEBGnexus (BackgroundTasks): client request SledAgent = 4d88c6ce-c5a2-418b-b915-09fea24f811c background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
19372024-07-06T00:16:06.683ZDEBGnexus (BackgroundTasks): client response SledAgent = 4d88c6ce-c5a2-418b-b915-09fea24f811c background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "8c2a3c25-c13e-4e1a-ad45-14652177cc0b", "content-length": "372", "date": "Sat, 06 Jul 2024 00:16:06 GMT"} })
19382024-07-06T00:16:06.683ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19392024-07-06T00:16:06.684ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19402024-07-06T00:16:06.686ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19412024-07-06T00:16:06.686ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19422024-07-06T00:16:06.689ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19432024-07-06T00:16:06.689ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19442024-07-06T00:16:06.691ZDEBGnexus (BackgroundTasks): client request SledAgent = 4d88c6ce-c5a2-418b-b915-09fea24f811c background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
19452024-07-06T00:16:06.691ZDEBGnexus (BackgroundTasks): client response SledAgent = 4d88c6ce-c5a2-418b-b915-09fea24f811c background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "a04c86cd-dd31-42ea-83a8-537e1c7edda4", "date": "Sat, 06 Jul 2024 00:16:06 GMT"} })
19462024-07-06T00:16:06.693ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 229.378332ms iteration = 18
19472024-07-06T00:16:06.802ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1022 zone_address = fd00:1122:3344:101::2
19482024-07-06T00:16:06.802ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
19492024-07-06T00:16:06.803ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "73eba690-ea91-4dfb-8a8f-f2fbb747106b", "content-length": "26", "date": "Sat, 06 Jul 2024 00:16:05 GMT"} })
19502024-07-06T00:16:06.803ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1027 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
19512024-07-06T00:16:06.805ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1059 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
19522024-07-06T00:16:06.806ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
19532024-07-06T00:16:06.809ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
19542024-07-06T00:16:06.836ZDEBGnexus (BackgroundTasks): client request SledAgent = 4d88c6ce-c5a2-418b-b915-09fea24f811c background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
19552024-07-06T00:16:06.837ZDEBGnexus (BackgroundTasks): client response SledAgent = 4d88c6ce-c5a2-418b-b915-09fea24f811c background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "baf08766-3370-4edb-98a8-ec297c221855", "content-length": "691", "date": "Sat, 06 Jul 2024 00:16:06 GMT"} })
19562024-07-06T00:16:06.837ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
19572024-07-06T00:16:06.837ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
19582024-07-06T00:16:06.837ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
19592024-07-06T00:16:06.838ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 374.062963ms iteration = 19
19602024-07-06T00:16:06.838ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
19612024-07-06T00:16:06.839ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "644a39ff-d25b-4431-85dc-0ecaffe0dfd6", "content-length": "2", "date": "Sat, 06 Jul 2024 00:16:06 GMT"} })
19622024-07-06T00:16:06.840ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
19632024-07-06T00:16:06.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
19642024-07-06T00:16:06.842ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 378.298231ms iteration = 17
19652024-07-06T00:16:06.940ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 476.694972ms iteration = 17
19662024-07-06T00:16:07.049ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
19672024-07-06T00:16:07.050ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
19682024-07-06T00:16:07.050ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::8)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "c82e4dae-fc2f-4489-9cc3-c300147f6967", "date": "Sat, 06 Jul 2024 00:16:06 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
19692024-07-06T00:16:07.050ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
19702024-07-06T00:16:07.052ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::9)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "920c098f-cbe6-453d-a9f9-b872768961c0", "date": "Sat, 06 Jul 2024 00:16:06 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
19712024-07-06T00:16:07.052ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
19722024-07-06T00:16:07.054ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
19732024-07-06T00:16:07.054ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 590.134373ms iteration = 11
19742024-07-06T00:16:07.058ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
19752024-07-06T00:16:07.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
19762024-07-06T00:16:07.060ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:145 port = SwitchPort { id: 508cd4b5-5e6e-4b63-a4ba-14ff5d540fe1, rack_id: 444442ff-30f3-4f30-9be3-25f64879f808, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(63e3634f-eb74-4143-bef9-2febaac3bb82) } rack_id = 444442ff-30f3-4f30-9be3-25f64879f808 switch_location = Switch0
19772024-07-06T00:16:07.060ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
19782024-07-06T00:16:07.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
19792024-07-06T00:16:07.068ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 444442ff-30f3-4f30-9be3-25f64879f808 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
19802024-07-06T00:16:07.069ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 444442ff-30f3-4f30-9be3-25f64879f808 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "ab26b592-afca-4a81-a13b-ccf8cf36f6ee", "content-length": "121", "date": "Sat, 06 Jul 2024 00:16:06 GMT"} })
19812024-07-06T00:16:07.069ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1662 rack_id = 444442ff-30f3-4f30-9be3-25f64879f808 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
19822024-07-06T00:16:07.069ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1689 rack_id = 444442ff-30f3-4f30-9be3-25f64879f808 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 63e3634f-eb74-4143-bef9-2febaac3bb82
19832024-07-06T00:16:07.069ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:377 rack_id = 444442ff-30f3-4f30-9be3-25f64879f808 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None)}}
19842024-07-06T00:16:07.069ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:381 rack_id = 444442ff-30f3-4f30-9be3-25f64879f808 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None)}}
19852024-07-06T00:16:07.069ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:390 rack_id = 444442ff-30f3-4f30-9be3-25f64879f808 routes = {}
19862024-07-06T00:16:07.069ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 444442ff-30f3-4f30-9be3-25f64879f808 routes = {}
19872024-07-06T00:16:07.069ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:416 rack_id = 444442ff-30f3-4f30-9be3-25f64879f808
19882024-07-06T00:16:07.069ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
19892024-07-06T00:16:07.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
19902024-07-06T00:16:07.070ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 444442ff-30f3-4f30-9be3-25f64879f808 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
19912024-07-06T00:16:07.071ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 444442ff-30f3-4f30-9be3-25f64879f808 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "1356eb64-a26b-4022-9dc0-ebd8cff4350b", "content-length": "2", "date": "Sat, 06 Jul 2024 00:16:06 GMT"} })
19922024-07-06T00:16:07.071ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 444442ff-30f3-4f30-9be3-25f64879f808 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
19932024-07-06T00:16:07.071ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 444442ff-30f3-4f30-9be3-25f64879f808 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "74e4ea8b-a01e-4be0-b4a7-7afe15d897e6", "content-length": "52", "date": "Sat, 06 Jul 2024 00:16:06 GMT"} })
19942024-07-06T00:16:07.071ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:465 rack_id = 444442ff-30f3-4f30-9be3-25f64879f808 switch_location = Switch0
19952024-07-06T00:16:07.071ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 444442ff-30f3-4f30-9be3-25f64879f808 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
19962024-07-06T00:16:07.083ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
19972024-07-06T00:16:07.084ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:3::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "fa7a785d-60bf-4243-b69d-57cf2073a654", "date": "Sat, 06 Jul 2024 00:16:06 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
19982024-07-06T00:16:07.084ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
19992024-07-06T00:16:07.085ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:1::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "50447b84-6dc8-40f4-8504-9134df443a35", "date": "Sat, 06 Jul 2024 00:16:06 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
20002024-07-06T00:16:07.085ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
20012024-07-06T00:16:07.087ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:2::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "be28ae5c-8d19-461b-83a7-7a2abdfbe1ae", "date": "Sat, 06 Jul 2024 00:16:06 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
20022024-07-06T00:16:07.087ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
20032024-07-06T00:16:07.089ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
20042024-07-06T00:16:07.089ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 625.394886ms iteration = 11
20052024-07-06T00:16:07.117ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 444442ff-30f3-4f30-9be3-25f64879f808 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "609514d7-5140-49ea-9530-9567a97b2e08", "date": "Sat, 06 Jul 2024 00:16:07 GMT"} })
20062024-07-06T00:16:07.117ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:768 rack_id = 444442ff-30f3-4f30-9be3-25f64879f808 switch = Switch0
20072024-07-06T00:16:07.117ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 444442ff-30f3-4f30-9be3-25f64879f808 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
20082024-07-06T00:16:07.118ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 444442ff-30f3-4f30-9be3-25f64879f808 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "75dff973-dd87-4526-83b7-06fdc378972f", "content-length": "494", "date": "Sat, 06 Jul 2024 00:16:07 GMT"} })
20092024-07-06T00:16:07.118ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20102024-07-06T00:16:07.118ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20112024-07-06T00:16:07.121ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20122024-07-06T00:16:07.121ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20132024-07-06T00:16:07.123ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20142024-07-06T00:16:07.123ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20152024-07-06T00:16:07.124ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20162024-07-06T00:16:07.124ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20172024-07-06T00:16:07.130ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 666.102617ms iteration = 17
20182024-07-06T00:16:07.495ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/6a3f84c/dropshot/src/server.rs:878 latency_us = 2043 local_addr = [fd00:1122:3344:101::a]:49987 method = GET remote_addr = [fd00:1122:3344:101::d]:37861 req_id = 31c1c002-59ff-490d-863e-13b784fb8e05 response_code = 200 uri = /9ff5ab27-a3ab-4401-8a23-c0799de85f2f
20192024-07-06T00:16:16.464ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 50 reason = Timeout
20202024-07-06T00:16:16.464ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 50 reason = Timeout
20212024-07-06T00:16:16.464ZINFOnexus (BackgroundTasks): region replacement driver task started background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:231
20222024-07-06T00:16:16.464ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
20232024-07-06T00:16:16.464ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20242024-07-06T00:16:16.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
20252024-07-06T00:16:16.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20262024-07-06T00:16:16.465ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
20272024-07-06T00:16:16.465ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
20282024-07-06T00:16:16.466ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20292024-07-06T00:16:16.466ZINFOnexus (BackgroundTasks): region replacement driver task done background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:238
20302024-07-06T00:16:16.466ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 2.665352ms iteration = 50
20312024-07-06T00:16:16.468ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
20322024-07-06T00:16:16.468ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20332024-07-06T00:16:16.468ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20342024-07-06T00:16:16.469ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20352024-07-06T00:16:16.469ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20362024-07-06T00:16:16.470ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20372024-07-06T00:16:16.472ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 19924212-3af7-4ff8-94f5-f62e5472fa7b, lookup_type: ById(19924212-3af7-4ff8-94f5-f62e5472fa7b) } result = Ok(())
20382024-07-06T00:16:16.472ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20392024-07-06T00:16:16.472ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20402024-07-06T00:16:16.478ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 19924212-3af7-4ff8-94f5-f62e5472fa7b original_time_created = 2024-07-06 00:07:55.490605 UTC target_id = 19924212-3af7-4ff8-94f5-f62e5472fa7b time_created = 2024-07-06 00:07:55.490605 UTC
20412024-07-06T00:16:16.478ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 14.717945ms iteration = 50
20422024-07-06T00:16:17.496ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/6a3f84c/dropshot/src/server.rs:878 latency_us = 2098 local_addr = [fd00:1122:3344:101::a]:49987 method = GET remote_addr = [fd00:1122:3344:101::d]:37861 req_id = 0f8be528-cf92-4a56-8c2f-2adc09b74615 response_code = 200 uri = /9ff5ab27-a3ab-4401-8a23-c0799de85f2f
20432024-07-06T00:16:26.463ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 51 reason = Timeout
20442024-07-06T00:16:26.464ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 51 reason = Timeout
20452024-07-06T00:16:26.464ZINFOnexus (BackgroundTasks): region replacement driver task started background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:231
20462024-07-06T00:16:26.464ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
20472024-07-06T00:16:26.464ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20482024-07-06T00:16:26.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
20492024-07-06T00:16:26.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20502024-07-06T00:16:26.465ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20512024-07-06T00:16:26.466ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
20522024-07-06T00:16:26.466ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
20532024-07-06T00:16:26.467ZINFOnexus (BackgroundTasks): region replacement driver task done background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:238
20542024-07-06T00:16:26.467ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.459425ms iteration = 51
20552024-07-06T00:16:26.468ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
20562024-07-06T00:16:26.468ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20572024-07-06T00:16:26.468ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20582024-07-06T00:16:26.469ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20592024-07-06T00:16:26.469ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20602024-07-06T00:16:26.470ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20612024-07-06T00:16:26.472ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 19924212-3af7-4ff8-94f5-f62e5472fa7b, lookup_type: ById(19924212-3af7-4ff8-94f5-f62e5472fa7b) } result = Ok(())
20622024-07-06T00:16:26.472ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20632024-07-06T00:16:26.473ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20642024-07-06T00:16:26.478ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 19924212-3af7-4ff8-94f5-f62e5472fa7b original_time_created = 2024-07-06 00:07:55.490605 UTC target_id = 19924212-3af7-4ff8-94f5-f62e5472fa7b time_created = 2024-07-06 00:07:55.490605 UTC
20652024-07-06T00:16:26.478ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 14.988199ms iteration = 51
20662024-07-06T00:16:27.496ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/6a3f84c/dropshot/src/server.rs:878 latency_us = 2070 local_addr = [fd00:1122:3344:101::a]:49987 method = GET remote_addr = [fd00:1122:3344:101::d]:37861 req_id = 948cc762-0bc8-42a1-973a-2dc7969f8daf response_code = 200 uri = /9ff5ab27-a3ab-4401-8a23-c0799de85f2f
20672024-07-06T00:16:36.464ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 52 reason = Timeout
20682024-07-06T00:16:36.464ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 18 reason = Timeout
20692024-07-06T00:16:36.464ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20702024-07-06T00:16:36.464ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 18 reason = Timeout
20712024-07-06T00:16:36.464ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
20722024-07-06T00:16:36.464ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
20732024-07-06T00:16:36.464ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 52 reason = Timeout
20742024-07-06T00:16:36.464ZINFOnexus (BackgroundTasks): region replacement driver task started background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:231
20752024-07-06T00:16:36.464ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
20762024-07-06T00:16:36.464ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 19 reason = Timeout
20772024-07-06T00:16:36.464ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 18 reason = Timeout
20782024-07-06T00:16:36.464ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20792024-07-06T00:16:36.464ZWARNnexus (BackgroundTasks): phantom disk task started background_task = phantom_disks file = nexus/src/app/background/tasks/phantom_disks.rs:46
20802024-07-06T00:16:36.464ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 18 reason = Timeout
20812024-07-06T00:16:36.464ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
20822024-07-06T00:16:36.464ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 18 reason = Timeout
20832024-07-06T00:16:36.464ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 20 reason = Timeout
20842024-07-06T00:16:36.464ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20852024-07-06T00:16:36.464ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
20862024-07-06T00:16:36.464ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 18 reason = Timeout
20872024-07-06T00:16:36.464ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 19 reason = Timeout
20882024-07-06T00:16:36.464ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
20892024-07-06T00:16:36.464ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
20902024-07-06T00:16:36.464ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 18 reason = Timeout
20912024-07-06T00:16:36.464ZWARNnexus (BackgroundTasks): region replacement task started background_task = region_replacement file = nexus/src/app/background/tasks/region_replacement.rs:64
20922024-07-06T00:16:36.464ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
20932024-07-06T00:16:36.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20942024-07-06T00:16:36.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
20952024-07-06T00:16:36.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
20962024-07-06T00:16:36.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
20972024-07-06T00:16:36.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20982024-07-06T00:16:36.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20992024-07-06T00:16:36.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
21002024-07-06T00:16:36.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
21012024-07-06T00:16:36.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
21022024-07-06T00:16:36.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
21032024-07-06T00:16:36.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
21042024-07-06T00:16:36.466ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4d88c6ce-c5a2-418b-b915-09fea24f811c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-4d88c6ce-c5a2-418b-b915-09fea24f811c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 2375, tv_nsec: 99526118 } })
21052024-07-06T00:16:36.466ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1014
21062024-07-06T00:16:36.466ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21072024-07-06T00:16:36.466ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21082024-07-06T00:16:36.466ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21092024-07-06T00:16:36.466ZWARNnexus (BackgroundTasks): phantom disk task done background_task = phantom_disks file = nexus/src/app/background/tasks/phantom_disks.rs:93
21102024-07-06T00:16:36.466ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 2.50897ms iteration = 18
21112024-07-06T00:16:36.467ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
21122024-07-06T00:16:36.467ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21132024-07-06T00:16:36.467ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
21142024-07-06T00:16:36.467ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21152024-07-06T00:16:36.467ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21162024-07-06T00:16:36.468ZINFOnexus (BackgroundTasks): region replacement driver task done background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:238
21172024-07-06T00:16:36.468ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.024534ms iteration = 52
21182024-07-06T00:16:36.468ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4d88c6ce-c5a2-418b-b915-09fea24f811c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-4d88c6ce-c5a2-418b-b915-09fea24f811c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 2375, tv_nsec: 102120959 } })
21192024-07-06T00:16:36.469ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1014
21202024-07-06T00:16:36.470ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
21212024-07-06T00:16:36.470ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
21222024-07-06T00:16:36.470ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
21232024-07-06T00:16:36.470ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
21242024-07-06T00:16:36.470ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
21252024-07-06T00:16:36.470ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
21262024-07-06T00:16:36.470ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
21272024-07-06T00:16:36.471ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
21282024-07-06T00:16:36.471ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
21292024-07-06T00:16:36.471ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
21302024-07-06T00:16:36.471ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
21312024-07-06T00:16:36.471ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
21322024-07-06T00:16:36.471ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
21332024-07-06T00:16:36.471ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
21342024-07-06T00:16:36.471ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
21352024-07-06T00:16:36.471ZWARNnexus (BackgroundTasks): physical disk adoption task started background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:100
21362024-07-06T00:16:36.471ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21372024-07-06T00:16:36.471ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
21382024-07-06T00:16:36.471ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
21392024-07-06T00:16:36.472ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21402024-07-06T00:16:36.472ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
21412024-07-06T00:16:36.472ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21422024-07-06T00:16:36.472ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
21432024-07-06T00:16:36.472ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
21442024-07-06T00:16:36.473ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21452024-07-06T00:16:36.473ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21462024-07-06T00:16:36.473ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21472024-07-06T00:16:36.473ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4d88c6ce-c5a2-418b-b915-09fea24f811c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-4d88c6ce-c5a2-418b-b915-09fea24f811c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 2375, tv_nsec: 107193180 } })
21482024-07-06T00:16:36.474ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
21492024-07-06T00:16:36.474ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
21502024-07-06T00:16:36.474ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21512024-07-06T00:16:36.474ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
21522024-07-06T00:16:36.474ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1014 rack_id = 444442ff-30f3-4f30-9be3-25f64879f808
21532024-07-06T00:16:36.475ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
21542024-07-06T00:16:36.475ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
21552024-07-06T00:16:36.475ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
21562024-07-06T00:16:36.478ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 19924212-3af7-4ff8-94f5-f62e5472fa7b, lookup_type: ById(19924212-3af7-4ff8-94f5-f62e5472fa7b) } result = Ok(())
21572024-07-06T00:16:36.478ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21582024-07-06T00:16:36.478ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21592024-07-06T00:16:36.478ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:480 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0
21602024-07-06T00:16:36.478ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 14.372219ms iteration = 18
21612024-07-06T00:16:36.481ZWARNnexus (BackgroundTasks): physical disk adoption task done background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:174
21622024-07-06T00:16:36.481ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 16.707117ms iteration = 19
21632024-07-06T00:16:36.483ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
21642024-07-06T00:16:36.483ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
21652024-07-06T00:16:36.484ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 19924212-3af7-4ff8-94f5-f62e5472fa7b original_time_created = 2024-07-06 00:07:55.490605 UTC target_id = 19924212-3af7-4ff8-94f5-f62e5472fa7b time_created = 2024-07-06 00:07:55.490605 UTC
21662024-07-06T00:16:36.484ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.980529ms iteration = 52
21672024-07-06T00:16:36.485ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
21682024-07-06T00:16:36.485ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
21692024-07-06T00:16:36.486ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
21702024-07-06T00:16:36.486ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
21712024-07-06T00:16:36.487ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21722024-07-06T00:16:36.490ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
21732024-07-06T00:16:36.490ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 4d88c6ce-c5a2-418b-b915-09fea24f811c, lookup_type: ById(4d88c6ce-c5a2-418b-b915-09fea24f811c) } result = Ok(())
21742024-07-06T00:16:36.490ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
21752024-07-06T00:16:36.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
21762024-07-06T00:16:36.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
21772024-07-06T00:16:36.491ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21782024-07-06T00:16:36.491ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 27.058902ms iteration = 18
21792024-07-06T00:16:36.492ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
21802024-07-06T00:16:36.492ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
21812024-07-06T00:16:36.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
21822024-07-06T00:16:36.494ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21832024-07-06T00:16:36.495ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
21842024-07-06T00:16:36.495ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
21852024-07-06T00:16:36.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
21862024-07-06T00:16:36.498ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
21872024-07-06T00:16:36.498ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
21882024-07-06T00:16:36.500ZWARNnexus (BackgroundTasks): region replacement task done background_task = region_replacement file = nexus/src/app/background/tasks/region_replacement.rs:185
21892024-07-06T00:16:36.500ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 35.591458ms iteration = 18
21902024-07-06T00:16:36.621ZDEBGnexus (BackgroundTasks): client request SledAgent = 4d88c6ce-c5a2-418b-b915-09fea24f811c background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
21912024-07-06T00:16:36.621ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1022 rack_id = 444442ff-30f3-4f30-9be3-25f64879f808 zone_address = fd00:1122:3344:101::2
21922024-07-06T00:16:36.621ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 444442ff-30f3-4f30-9be3-25f64879f808 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
21932024-07-06T00:16:36.621ZDEBGnexus (BackgroundTasks): client response SledAgent = 4d88c6ce-c5a2-418b-b915-09fea24f811c background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "06f3aeda-d9f8-40a7-a4e3-0a90d0603fd4", "content-length": "372", "date": "Sat, 06 Jul 2024 00:16:36 GMT"} })
21942024-07-06T00:16:36.621ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
21952024-07-06T00:16:36.622ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 444442ff-30f3-4f30-9be3-25f64879f808 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "d7e8c36f-760b-49c5-b5d1-2b309863510a", "content-length": "26", "date": "Sat, 06 Jul 2024 00:16:35 GMT"} })
21962024-07-06T00:16:36.622ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1027 rack_id = 444442ff-30f3-4f30-9be3-25f64879f808 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
21972024-07-06T00:16:36.622ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
21982024-07-06T00:16:36.623ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
21992024-07-06T00:16:36.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
22002024-07-06T00:16:36.624ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1059 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 444442ff-30f3-4f30-9be3-25f64879f808
22012024-07-06T00:16:36.625ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
22022024-07-06T00:16:36.625ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
22032024-07-06T00:16:36.628ZDEBGnexus (BackgroundTasks): client request SledAgent = 4d88c6ce-c5a2-418b-b915-09fea24f811c background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
22042024-07-06T00:16:36.628ZDEBGnexus (BackgroundTasks): client response SledAgent = 4d88c6ce-c5a2-418b-b915-09fea24f811c background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "eea491b3-cfa1-4337-8436-b651807ae99d", "date": "Sat, 06 Jul 2024 00:16:36 GMT"} })
22052024-07-06T00:16:36.630ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 165.689665ms iteration = 19
22062024-07-06T00:16:36.645ZDEBGnexus (BackgroundTasks): client request SledAgent = 4d88c6ce-c5a2-418b-b915-09fea24f811c background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
22072024-07-06T00:16:36.646ZDEBGnexus (BackgroundTasks): client response SledAgent = 4d88c6ce-c5a2-418b-b915-09fea24f811c background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "948c9377-37e4-4650-92ab-01751eaac328", "content-length": "691", "date": "Sat, 06 Jul 2024 00:16:36 GMT"} })
22082024-07-06T00:16:36.646ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
22092024-07-06T00:16:36.646ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
22102024-07-06T00:16:36.646ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
22112024-07-06T00:16:36.648ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 184.489246ms iteration = 20
22122024-07-06T00:16:36.683ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1022 zone_address = fd00:1122:3344:101::2
22132024-07-06T00:16:36.683ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
22142024-07-06T00:16:36.683ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "19db97c8-8507-412e-859c-652d5852efe2", "content-length": "26", "date": "Sat, 06 Jul 2024 00:16:35 GMT"} })
22152024-07-06T00:16:36.683ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1027 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
22162024-07-06T00:16:36.685ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1059 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
22172024-07-06T00:16:36.692ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1022 zone_address = fd00:1122:3344:101::2
22182024-07-06T00:16:36.692ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
22192024-07-06T00:16:36.692ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "cdb11324-ee1b-4c81-a19b-950c31f317c9", "content-length": "26", "date": "Sat, 06 Jul 2024 00:16:35 GMT"} })
22202024-07-06T00:16:36.692ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1027 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
22212024-07-06T00:16:36.694ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1059 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
22222024-07-06T00:16:36.784ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
22232024-07-06T00:16:36.785ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "826d9cfe-e524-4bf0-8650-3292526a5597", "content-length": "2", "date": "Sat, 06 Jul 2024 00:16:36 GMT"} })
22242024-07-06T00:16:36.787ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
22252024-07-06T00:16:36.787ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
22262024-07-06T00:16:36.789ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 324.891267ms iteration = 18
22272024-07-06T00:16:36.866ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 402.185332ms iteration = 18
22282024-07-06T00:16:36.897ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22292024-07-06T00:16:36.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22302024-07-06T00:16:36.898ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:145 port = SwitchPort { id: 508cd4b5-5e6e-4b63-a4ba-14ff5d540fe1, rack_id: 444442ff-30f3-4f30-9be3-25f64879f808, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(63e3634f-eb74-4143-bef9-2febaac3bb82) } rack_id = 444442ff-30f3-4f30-9be3-25f64879f808 switch_location = Switch0
22312024-07-06T00:16:36.898ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22322024-07-06T00:16:36.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22332024-07-06T00:16:36.904ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 444442ff-30f3-4f30-9be3-25f64879f808 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
22342024-07-06T00:16:36.904ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 444442ff-30f3-4f30-9be3-25f64879f808 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "b78fcaa6-24bc-4fb8-b495-bcc45c31a0b1", "content-length": "121", "date": "Sat, 06 Jul 2024 00:16:36 GMT"} })
22352024-07-06T00:16:36.904ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1662 rack_id = 444442ff-30f3-4f30-9be3-25f64879f808 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
22362024-07-06T00:16:36.904ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1689 rack_id = 444442ff-30f3-4f30-9be3-25f64879f808 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 63e3634f-eb74-4143-bef9-2febaac3bb82
22372024-07-06T00:16:36.905ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:377 rack_id = 444442ff-30f3-4f30-9be3-25f64879f808 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None)}}
22382024-07-06T00:16:36.905ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:381 rack_id = 444442ff-30f3-4f30-9be3-25f64879f808 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None)}}
22392024-07-06T00:16:36.905ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:390 rack_id = 444442ff-30f3-4f30-9be3-25f64879f808 routes = {}
22402024-07-06T00:16:36.905ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 444442ff-30f3-4f30-9be3-25f64879f808 routes = {}
22412024-07-06T00:16:36.905ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:416 rack_id = 444442ff-30f3-4f30-9be3-25f64879f808
22422024-07-06T00:16:36.905ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22432024-07-06T00:16:36.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22442024-07-06T00:16:36.906ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 444442ff-30f3-4f30-9be3-25f64879f808 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
22452024-07-06T00:16:36.906ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 444442ff-30f3-4f30-9be3-25f64879f808 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "386a950f-f96c-45ce-bbe0-990f55826e4d", "content-length": "2", "date": "Sat, 06 Jul 2024 00:16:36 GMT"} })
22462024-07-06T00:16:36.906ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 444442ff-30f3-4f30-9be3-25f64879f808 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
22472024-07-06T00:16:36.906ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 444442ff-30f3-4f30-9be3-25f64879f808 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "faa3f4d3-afac-44ae-93f4-ca236e7c4054", "content-length": "52", "date": "Sat, 06 Jul 2024 00:16:36 GMT"} })
22482024-07-06T00:16:36.906ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:465 rack_id = 444442ff-30f3-4f30-9be3-25f64879f808 switch_location = Switch0
22492024-07-06T00:16:36.906ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 444442ff-30f3-4f30-9be3-25f64879f808 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
22502024-07-06T00:16:36.950ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 444442ff-30f3-4f30-9be3-25f64879f808 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "e2578bc2-015a-4b2e-99bc-9883baaeb3f8", "date": "Sat, 06 Jul 2024 00:16:36 GMT"} })
22512024-07-06T00:16:36.950ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:768 rack_id = 444442ff-30f3-4f30-9be3-25f64879f808 switch = Switch0
22522024-07-06T00:16:36.950ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 444442ff-30f3-4f30-9be3-25f64879f808 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
22532024-07-06T00:16:36.951ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 444442ff-30f3-4f30-9be3-25f64879f808 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "29d5a9d3-3e5d-45cc-ae80-b6612e4a699c", "content-length": "494", "date": "Sat, 06 Jul 2024 00:16:36 GMT"} })
22542024-07-06T00:16:36.951ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22552024-07-06T00:16:36.951ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22562024-07-06T00:16:36.954ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22572024-07-06T00:16:36.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22582024-07-06T00:16:36.955ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22592024-07-06T00:16:36.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22602024-07-06T00:16:36.956ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22612024-07-06T00:16:36.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22622024-07-06T00:16:36.963ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 499.397825ms iteration = 18
22632024-07-06T00:16:37.496ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/6a3f84c/dropshot/src/server.rs:878 latency_us = 1975 local_addr = [fd00:1122:3344:101::a]:49987 method = GET remote_addr = [fd00:1122:3344:101::d]:37861 req_id = 3e62c3b8-49dd-4045-a87c-e918112b2483 response_code = 200 uri = /9ff5ab27-a3ab-4401-8a23-c0799de85f2f
22642024-07-06T00:16:37.496ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
22652024-07-06T00:16:37.496ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::a]:12221
22662024-07-06T00:16:37.525ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::a]:12221/metrics/producers
22672024-07-06T00:16:37.525ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/6a3f84c/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::a]:12221 remote_addr = [fd00:1122:3344:101::a]:50351
22682024-07-06T00:16:37.526ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::a]:50351 req_id = e1527be7-99a0-44b6-9154-d8dc853b830f roles = RoleSet { roles: {} } uri = /metrics/producers
22692024-07-06T00:16:37.526ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::a]:50351 req_id = e1527be7-99a0-44b6-9154-d8dc853b830f resource = Database result = Ok(()) uri = /metrics/producers
22702024-07-06T00:16:37.558ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = da35a429-5291-41f8-8c2f-7377bb15ed38
22712024-07-06T00:16:37.558ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::a]:50351 req_id = e1527be7-99a0-44b6-9154-d8dc853b830f roles = RoleSet { roles: {} } uri = /metrics/producers
22722024-07-06T00:16:37.559ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::a]:50351 req_id = e1527be7-99a0-44b6-9154-d8dc853b830f resource = Database result = Ok(()) uri = /metrics/producers
22732024-07-06T00:16:37.601ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = da35a429-5291-41f8-8c2f-7377bb15ed38 uri = http://[fd00:1122:3344:101::d]:12223/producers
22742024-07-06T00:16:37.601ZDEBGnexus: client response oximeter-collector = da35a429-5291-41f8-8c2f-7377bb15ed38 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "80b9aaa2-65db-47b4-a8ad-3801e55ea2b7", "date": "Sat, 06 Jul 2024 00:16:37 GMT"} })
22752024-07-06T00:16:37.601ZINFOnexus: assigned collector to new producer collector_id = da35a429-5291-41f8-8c2f-7377bb15ed38 file = nexus/src/app/oximeter.rs:125 producer_id = 9ff5ab27-a3ab-4401-8a23-c0799de85f2f
22762024-07-06T00:16:37.603ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/6a3f84c/dropshot/src/server.rs:878 latency_us = 77131 local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::a]:50351 req_id = e1527be7-99a0-44b6-9154-d8dc853b830f response_code = 201 uri = /metrics/producers
22772024-07-06T00:16:37.603ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::a)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, status: 201, headers: {"content-type": "application/json", "x-request-id": "e1527be7-99a0-44b6-9154-d8dc853b830f", "content-length": "41", "date": "Sat, 06 Jul 2024 00:16:37 GMT"} })
22782024-07-06T00:16:37.604ZDEBGnexus (producer-registration-task): registered with nexus successfully
22792024-07-06T00:16:37.604ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
22802024-07-06T00:16:46.463ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 53 reason = Timeout
22812024-07-06T00:16:46.463ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 53 reason = Timeout
22822024-07-06T00:16:46.463ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22832024-07-06T00:16:46.463ZINFOnexus (BackgroundTasks): region replacement driver task started background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:231
22842024-07-06T00:16:46.463ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
22852024-07-06T00:16:46.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22862024-07-06T00:16:46.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
22872024-07-06T00:16:46.466ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
22882024-07-06T00:16:46.466ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22892024-07-06T00:16:46.466ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
22902024-07-06T00:16:46.467ZINFOnexus (BackgroundTasks): region replacement driver task done background_task = region_replacement_driver file = nexus/src/app/background/tasks/region_replacement_driver.rs:238
22912024-07-06T00:16:46.467ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.581457ms iteration = 53
22922024-07-06T00:16:46.468ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
22932024-07-06T00:16:46.468ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22942024-07-06T00:16:46.468ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22952024-07-06T00:16:46.469ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22962024-07-06T00:16:46.469ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22972024-07-06T00:16:46.471ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22982024-07-06T00:16:46.473ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 19924212-3af7-4ff8-94f5-f62e5472fa7b, lookup_type: ById(19924212-3af7-4ff8-94f5-f62e5472fa7b) } result = Ok(())
22992024-07-06T00:16:46.473ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23002024-07-06T00:16:46.473ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23012024-07-06T00:16:46.479ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 19924212-3af7-4ff8-94f5-f62e5472fa7b original_time_created = 2024-07-06 00:07:55.490605 UTC target_id = 19924212-3af7-4ff8-94f5-f62e5472fa7b time_created = 2024-07-06 00:07:55.490605 UTC
23022024-07-06T00:16:46.479ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 15.894444ms iteration = 53
23032024-07-06T00:16:47.604ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/6a3f84c/dropshot/src/server.rs:878 latency_us = 2089 local_addr = [fd00:1122:3344:101::a]:49987 method = GET remote_addr = [fd00:1122:3344:101::d]:37861 req_id = 77545c8c-d023-442c-98c6-0bfba06d335e response_code = 200 uri = /9ff5ab27-a3ab-4401-8a23-c0799de85f2f